-- Logs begin at Mon 2022-08-29 19:42:27 UTC, end at Mon 2022-08-29 20:47:55 UTC. -- Aug 29 20:16:13.920381 dv-cinder-854263-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 20:16:13.931475 dv-cinder-854263-2-smb devstack@keystone.service[81526]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 20:16:13.933498 dv-cinder-854263-2-smb devstack@keystone.service[81526]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 20:16:13 2022] *** Aug 29 20:16:13.933498 dv-cinder-854263-2-smb devstack@keystone.service[81526]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 20:16:13.933498 dv-cinder-854263-2-smb devstack@keystone.service[81526]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 20:16:13.933498 dv-cinder-854263-2-smb devstack@keystone.service[81526]: nodename: dv-cinder-854263-2-smb Aug 29 20:16:13.933498 dv-cinder-854263-2-smb devstack@keystone.service[81526]: machine: x86_64 Aug 29 20:16:13.933498 dv-cinder-854263-2-smb devstack@keystone.service[81526]: clock source: unix Aug 29 20:16:13.933498 dv-cinder-854263-2-smb devstack@keystone.service[81526]: pcre jit disabled Aug 29 20:16:13.933498 dv-cinder-854263-2-smb devstack@keystone.service[81526]: detected number of CPU cores: 4 Aug 29 20:16:13.933498 dv-cinder-854263-2-smb devstack@keystone.service[81526]: current working directory: / Aug 29 20:16:13.933498 dv-cinder-854263-2-smb devstack@keystone.service[81526]: detected binary path: /usr/bin/uwsgi-core Aug 29 20:16:13.933498 dv-cinder-854263-2-smb devstack@keystone.service[81526]: your processes number limit is 47680 Aug 29 20:16:13.933498 dv-cinder-854263-2-smb devstack@keystone.service[81526]: your memory page size is 4096 bytes Aug 29 20:16:13.933498 dv-cinder-854263-2-smb devstack@keystone.service[81526]: detected max file descriptor number: 2048 Aug 29 20:16:13.933498 dv-cinder-854263-2-smb devstack@keystone.service[81526]: lock engine: pthread robust mutexes Aug 29 20:16:13.934965 dv-cinder-854263-2-smb devstack@keystone.service[81526]: thunder lock: enabled Aug 29 20:16:13.934965 dv-cinder-854263-2-smb devstack@keystone.service[81526]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 20:16:13.934965 dv-cinder-854263-2-smb devstack@keystone.service[81526]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 20:16:13.973750 dv-cinder-854263-2-smb devstack@keystone.service[81526]: Python main interpreter initialized at 0x55e3c975e9c0 Aug 29 20:16:13.973750 dv-cinder-854263-2-smb devstack@keystone.service[81526]: python threads support enabled Aug 29 20:16:13.973750 dv-cinder-854263-2-smb devstack@keystone.service[81526]: your server socket listen backlog is limited to 100 connections Aug 29 20:16:13.973750 dv-cinder-854263-2-smb devstack@keystone.service[81526]: your mercy for graceful operations on workers is 90 seconds Aug 29 20:16:13.974262 dv-cinder-854263-2-smb devstack@keystone.service[81526]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 20:16:13.974262 dv-cinder-854263-2-smb devstack@keystone.service[81526]: *** Operational MODE: preforking *** Aug 29 20:16:13.974455 dv-cinder-854263-2-smb devstack@keystone.service[81526]: *** uWSGI is running in multiple interpreter mode *** Aug 29 20:16:13.974455 dv-cinder-854263-2-smb devstack@keystone.service[81526]: spawned uWSGI master process (pid: 81526) Aug 29 20:16:13.974652 dv-cinder-854263-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 29 20:16:13.975374 dv-cinder-854263-2-smb devstack@keystone.service[81526]: spawned uWSGI worker 1 (pid: 81539, cores: 1) Aug 29 20:16:13.975906 dv-cinder-854263-2-smb devstack@keystone.service[81526]: spawned uWSGI worker 2 (pid: 81540, cores: 1) Aug 29 20:16:13.976149 dv-cinder-854263-2-smb devstack@keystone.service[81526]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 20:16:18.544917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:16:18.544917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: from cryptography.utils import int_from_bytes Aug 29 20:16:18.546315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:16:18.546315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: from cryptography.utils import int_from_bytes Aug 29 20:16:18.546533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:16:18.546533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: from cryptography.utils import int_from_bytes Aug 29 20:16:18.546533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:16:18.546533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: from cryptography.utils import int_from_bytes Aug 29 20:16:18.595498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:16:18.595825 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:16:18.596286 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] command line args: [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:16:18.596625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:16:18.596802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ================================================================================ {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:16:18.597056 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] admin_token = **** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.597303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] config_dir = [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.597509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.597722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] config_source = [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.597851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:16:18.598048 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] debug = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.598466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:16:18.598612 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.599740 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] command line args: [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:16:18.599867 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.599972 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:16:18.600067 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.600151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ================================================================================ {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:16:18.600272 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.600358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] admin_token = **** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.600475 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.600557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] config_dir = [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.600557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.600726 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] list_limit = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.600790 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] config_source = [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.600910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] log_config_append = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.600983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] debug = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.601086 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.601193 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.601295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] log_dir = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.601455 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.601531 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] log_file = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.601640 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.601747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.601819 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.601939 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.602019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.602134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.602206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] list_limit = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.602318 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.602475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] log_config_append = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.602566 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.602653 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.602819 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.602903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] log_dir = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.602903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] log_file = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.603077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.603195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.603276 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.603387 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.603465 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.603465 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.603675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.603800 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.603875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.603998 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.604076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.604076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.604274 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.604356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.604472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.604557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.604676 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.604762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.604762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.604762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.605036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.605108 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.605210 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] publish_errors = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.605291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.605291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.605476 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.605594 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.605673 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.605673 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.605673 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.605912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.606011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.606084 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] publish_errors = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.606160 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] standard_threads = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.606275 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.606275 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.606424 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.606499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.606569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.606662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.606772 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.606853 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.606929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] use_journal = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.607048 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] standard_threads = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.607120 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] use_json = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.607120 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] use_stderr = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.607296 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.607367 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] use_syslog = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.607477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.607477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.607759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.607885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] use_journal = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.608071 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.608196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] use_json = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.608307 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.608391 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] use_stderr = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.608391 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] use_syslog = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.608594 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.608673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:16:18.608742 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.608809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.608934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.609014 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.609083 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.609157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.609226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.609299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.609410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.609592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.609670 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.609829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.609975 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.610053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.610232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.610311 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.610468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.610546 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.610716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.610830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.610945 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.611057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.611173 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.611282 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.611466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.611580 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.611698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.611807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.611922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.612084 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.612199 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.612315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.612503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.612646 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.612765 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.612920 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.613036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.613153 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.613270 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.613432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.613545 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.613667 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.613799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.613917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.614033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.614210 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.614310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.614425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.614533 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.614649 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.614758 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.614866 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.614973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.615087 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.615222 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.615343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.615454 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.615561 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.615669 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.615776 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.615883 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.616001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.616111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.616218 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.616325 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.616432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.616540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.616657 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.616657 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.616922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.617036 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.617144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.617236 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.617340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.617473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.617567 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.617567 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.617768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.617875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.618060 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.618221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.618337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.618446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.618554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.618671 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.618926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.619042 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.619206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.619324 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.619480 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.619721 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.619871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.619988 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.620160 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.620274 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.620473 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.620590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.620709 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.620883 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.620999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.621176 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.621444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.621565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.621752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.621863 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.621971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.622198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.622307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.622477 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.622689 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.622836 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.623095 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.623225 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.623455 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.623558 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.623745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.623898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.624016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.624218 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.624338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.624497 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.624734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.624860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.624969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.625177 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.625293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.625454 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.625648 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.625772 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.625928 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.626042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.626150 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.626481 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.626595 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.626746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.626995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.627120 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.627417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.627557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.627711 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.627876 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.628039 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.628172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.628551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.628901 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.629052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.629321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.629713 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.629894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.630115 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.630524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.630871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.631251 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.631431 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.631551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.631797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.631919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.632030 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.632236 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.632358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.632530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.632780 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.632953 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.633056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.633233 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.633351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.633635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.633820 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.633963 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.634069 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.634177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.634294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.634404 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.634511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.634630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.634769 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.635003 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.635111 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.635254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.635370 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.635486 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.635596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.635713 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.635831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.635950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] auth.external = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.636059 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.636168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.636336 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.636451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.636622 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.636622 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.636833 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.636996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.637147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] auth.password = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.637380 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.637512 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] auth.token = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.637668 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.637780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.637888 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.637997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.638142 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.638265 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.638375 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.638485 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.638648 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.638773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.638883 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.639002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.639112 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.639240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.639379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.639499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] credential.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.639611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.639611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.639888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.640060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.640210 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.640324 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.640435 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.640584 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.640696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.640814 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.640931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.641042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.641153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.641262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.641401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.641526 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.641640 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.641750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.641860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.641970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.642079 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.642202 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.642202 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.642420 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.642574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] auth.external = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.642686 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.642797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.642915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.643034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.643157 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.643282 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.643378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.643471 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] auth.password = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.643556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] federation.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.643628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] auth.token = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.643741 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.643851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.643979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.644108 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.644228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.644339 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.644449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.644562 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.644672 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.644784 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.644906 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.645018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.645128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.645237 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.645347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.645473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] credential.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.645595 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.645708 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.645818 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.645928 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.646037 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.646146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.646263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.646371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.646466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.646575 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.646693 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.646810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.646931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.647044 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.647153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.647294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.647428 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.647549 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.647662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.647773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.647883 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.647994 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.648104 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.648223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.648334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.648452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.648563 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.648673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.648833 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.649051 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.649174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.649291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] federation.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.649454 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.649566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.649677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.649800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.649919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.650032 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.650142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.650252 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.650362 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.650481 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.650593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.650714 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.650826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.650826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.651032 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.651162 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.651287 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.651398 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.651508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.651625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.651736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.651855 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.651966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.652077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.652188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.652299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.652408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.652526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.652637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.652747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.652857 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.652967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.653076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.653196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.653306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.653432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.653554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.653666 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.653782 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.653900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.653900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.654137 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.654254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.654365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.654476 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.654597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.654719 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.654830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.654940 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.655049 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.655166 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.655286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.655398 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.655512 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.655623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.655733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.655843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.655960 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.656071 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.656181 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.656292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.656403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.656513 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.656631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.656742 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.656852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.656961 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.656961 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.657168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.657285 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.657492 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.657623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.657736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.657847 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.657965 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.658114 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.658257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.658369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.658480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.658590 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.658724 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.658836 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.658986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.659117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.659250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.659362 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.659482 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.659593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.659705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.659815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.659815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.660020 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.660138 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.660248 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.660357 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.660467 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.660578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.660687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.660804 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.660915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.661025 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.661133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.661242 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.661351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.661489 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.661602 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.661711 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.661820 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.661929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.662037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.662154 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.662271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.662382 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.662491 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.662602 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.662722 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.662840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.662950 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.663060 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.663185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.663314 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.663425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.663543 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.663659 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.663770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.663880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.663991 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.664101 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.664243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.664357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.664468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.664578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.664688 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.664798 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.664922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.665033 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.665143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.665259 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.665399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.665512 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.665634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.665747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.665856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.665966 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.666075 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.666185 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.666303 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.666414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] resource.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.666525 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.666645 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.666759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.666869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.666987 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.667116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.667297 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.667581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.667747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.667870 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.667998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.668112 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.668223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.668333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.668444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.668554 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.668666 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.668762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.668872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.668991 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] role.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.669102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.669212 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] role.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.669331 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.669468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.669580 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.669690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.669831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.669947 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.670074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.670186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.670297 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.670407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.670552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.670676 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.670854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.670969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.671081 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.671191 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.671338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.671529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.671642 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.671752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.671862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.671972 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.672084 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.672203 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.672314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.672425 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.672535 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.672644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.672933 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.673055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.673168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.673278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.673441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.673557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] resource.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.673694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.673843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.673955 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.674064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.674206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.674320 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.674430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.674547 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.674669 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.674781 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.674920 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.675034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.675144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.675263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.675374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.675484 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.675596 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.675705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.675815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.675932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] role.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.676043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.676153 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] role.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.676293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.676427 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.676548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.676667 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.676778 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.676913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.677027 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.677206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.677319 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.677502 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] token.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.677616 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.677725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.677821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.677914 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.678008 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.678147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.678263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.678403 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.678518 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.678636 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.678751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.678871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.678982 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.679119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.679233 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.679364 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.679466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.679615 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.679730 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.679840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.680075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.680187 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.680306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.680417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.680529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.680638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.680821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.680935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.681054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.681173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.681296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.681427 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.681561 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.681675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.681823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.connection = **** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.681936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.682059 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.682170 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.682300 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.682414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.682525 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.682644 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.682766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.682877 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.682988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.683098 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.683208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.683316 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.683434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.683545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.683661 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.683771 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.683881 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.683991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.684109 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.684328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.684443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.684597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.684712 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.684831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] token.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.684831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.685040 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.685040 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.685253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.685253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.685544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.685544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.685752 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.685862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.686033 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.686150 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.686271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.686382 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:16:18.686493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.686493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.686718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.686867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.687094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.687368 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.687614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.687955 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.688184 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.688507 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.688838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.689018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.connection = **** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.689263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.689659 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.689904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.690216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.690452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.690689 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.690998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.691247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.691492 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.691725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.691969 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.692203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.692448 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.692681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.692924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.693154 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.693414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.693657 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:16:18.693813 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:16:18.715825 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:18.716073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:18.716264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:18.718661 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:18.718900 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:18.719097 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:18.725215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:18.728373 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:18.753755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:18.754014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:18.754779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:18.755006 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:18.809110 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:18.809801 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:18.859011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:18.859232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:18.862536 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:18.862788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.017686 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.017947 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.018225 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.018457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.018714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.018925 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.023574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.023864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.024151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.024436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.024718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.024995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.042525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.042716 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.042839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.042958 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.043087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.043270 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.043381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.043501 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.043622 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.043736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.043855 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.043983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.044093 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.044214 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.055418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.055709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.069254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.069618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.069814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.070034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.070161 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.070298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.070410 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.070520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.070627 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.070741 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.070899 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.070899 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.071115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.071323 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:16:19.088474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.088684 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.088861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 20:16:19.088988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 20:16:19.089101 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.089185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.089313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 20:16:19.089423 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 20:16:19.089545 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.089663 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.089812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.090004 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.090087 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.090263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.090346 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.090801 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.100296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.100579 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.100760 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.100916 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.101053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.101175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.101285 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.101632 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.108381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.108724 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.111478 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.111720 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.111804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.111987 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.112137 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.112281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.112470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.112579 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.112682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.112814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.112959 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.113070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.113229 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.113421 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.113560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.113734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.113820 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.113932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.114095 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.114190 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.114364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.114635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.139008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.139392 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.140933 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.141217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.141407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.141725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.146030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.146322 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.146544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.146666 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.146835 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.147115 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.153116 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.153419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.153739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.154028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.157637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.157929 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.158053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.158306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.158429 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.158707 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.158831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.158993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.159120 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.159304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.159425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.159699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.159970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.161589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.161899 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.162187 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.178419 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.178619 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.178773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.178891 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.182646 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.183099 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.185811 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.186112 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.186321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.186619 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.190647 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.190976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.193883 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.194174 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.196991 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.197291 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.197421 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.197607 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.197720 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.197887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.198020 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.198179 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.198267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.198818 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.198969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.199065 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.214707 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.215019 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.215222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.215412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.215524 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.215649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.215763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.215876 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.222685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.223355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.224364 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.224906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.225957 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.226237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.226563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.226903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.228979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.229272 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.229577 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.229713 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.229871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.230185 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.230316 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.230465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.230597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.230988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.242115 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.242413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.242548 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.242705 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.242830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.243094 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.243229 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.243371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.243484 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.243599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.243712 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.243831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.243942 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.244177 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.259661 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.260202 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.262783 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.263174 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.265717 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.266210 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.267190 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.267729 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.268752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.269010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.269298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.269432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.269653 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.269946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.275972 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.276637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.277453 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.278195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.280318 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.280605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.280896 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.281177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.281301 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.281574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.281857 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.282129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.289286 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.289601 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.289894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.290453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.290746 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.291021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.296927 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.297214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.297523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.297859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.298079 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.298163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:16:19.298355 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.298436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.298637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.298781 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.298940 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.299021 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.299233 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.299351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.299509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.299613 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.299763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.299865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.300026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.300152 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.300291 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.300440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.300577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.300736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.301008 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.301269 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.301556 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.301834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:16:19.335427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e3c975e9c0 pid: 81540 (default app) Aug 29 20:16:19.337836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e3c975e9c0 pid: 81539 (default app) Aug 29 20:16:19.339186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96e384-2f56-4d1f-95fd-5eec08f33654 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:19.339500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96e384-2f56-4d1f-95fd-5eec08f33654 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:19.339772 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96e384-2f56-4d1f-95fd-5eec08f33654 None None] PATH_INFO: `/v3` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:19.343995 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Mon Aug 29 20:16:19 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:26.012796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed3aab-5e69-470e-8a0d-ac15ab81af30 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:26.013774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed3aab-5e69-470e-8a0d-ac15ab81af30 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:26.013774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed3aab-5e69-470e-8a0d-ac15ab81af30 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:26.020821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:26 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:26.030358 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ce13-1c94-4099-97c0-503587f4c131 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:26.030958 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ce13-1c94-4099-97c0-503587f4c131 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:26.030958 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ce13-1c94-4099-97c0-503587f4c131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:26.104685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: INFO dbcounter [None req-5cb3ce13-1c94-4099-97c0-503587f4c131 None None] Registered counter for database keystone Aug 29 20:16:26.126112 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG oslo_db.sqlalchemy.engines [None req-5cb3ce13-1c94-4099-97c0-503587f4c131 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:16:26.134589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writer thread running {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:16:26.318998 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG passlib.handlers.bcrypt [None req-5cb3ce13-1c94-4099-97c0-503587f4c131 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81540) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 20:16:26.319330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG passlib.handlers.bcrypt [None req-5cb3ce13-1c94-4099-97c0-503587f4c131 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81540) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 20:16:26.382563 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5cb3ce13-1c94-4099-97c0-503587f4c131 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:26.385079 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5cb3ce13-1c94-4099-97c0-503587f4c131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:26.537602 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 20:16:27.035399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed3aab-5e69-470e-8a0d-ac15ab81af30 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:27.107141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: INFO dbcounter [None req-35ed3aab-5e69-470e-8a0d-ac15ab81af30 None None] Registered counter for database keystone Aug 29 20:16:27.132073 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG oslo_db.sqlalchemy.engines [None req-35ed3aab-5e69-470e-8a0d-ac15ab81af30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:16:27.143805 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writer thread running {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:16:27.261758 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed3aab-5e69-470e-8a0d-ac15ab81af30 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:27.267359 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11196607-4618-486b-bf54-bcc5b6c434ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:27.268021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11196607-4618-486b-bf54-bcc5b6c434ab admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:27.268273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11196607-4618-486b-bf54-bcc5b6c434ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:27.268576 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11196607-4618-486b-bf54-bcc5b6c434ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:27.277854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11196607-4618-486b-bf54-bcc5b6c434ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:27.335802 dv-cinder-854263-2-smb devstack@keystone.service[81539]: WARNING keystone.common.rbac_enforcer.enforcer [None req-11196607-4618-486b-bf54-bcc5b6c434ab admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 20:16:27.336037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11196607-4618-486b-bf54-bcc5b6c434ab admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:27.348232 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1324 bytes} [Mon Aug 29 20:16:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:16:27.358664 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3ce13-1c94-4099-97c0-503587f4c131 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:27.375449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3ce13-1c94-4099-97c0-503587f4c131 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:27.381243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf20f7-6d2a-425d-a1e3-20699fd8f46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:27.382499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf20f7-6d2a-425d-a1e3-20699fd8f46a admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:27.382814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf20f7-6d2a-425d-a1e3-20699fd8f46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:27.383128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf20f7-6d2a-425d-a1e3-20699fd8f46a admin admin] PATH_INFO: `/v3/projects/e848cede7541492584effd880adbb5d7` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:27.384996 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf20f7-6d2a-425d-a1e3-20699fd8f46a admin admin] RBAC: Authorizing `identity:get_project(project_id=e848cede7541492584effd880adbb5d7)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:27.438509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3eaf20f7-6d2a-425d-a1e3-20699fd8f46a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 20:16:27.438854 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf20f7-6d2a-425d-a1e3-20699fd8f46a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:27.443580 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 3/5] 10.222.0.52 () {56 vars in 1207 bytes} [Mon Aug 29 20:16:27 2022] GET /identity/v3/projects/e848cede7541492584effd880adbb5d7 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:29.395387 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0685b8f-00e4-4021-a247-b71120207e53 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:29.396238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0685b8f-00e4-4021-a247-b71120207e53 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:29.396238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0685b8f-00e4-4021-a247-b71120207e53 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:29.403128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 3/6] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:29.408927 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08174e3-690a-4a3d-b613-f13ab92481aa None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:29.409390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08174e3-690a-4a3d-b613-f13ab92481aa None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:29.409517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08174e3-690a-4a3d-b613-f13ab92481aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:29.431714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c08174e3-690a-4a3d-b613-f13ab92481aa None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:29.433250 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c08174e3-690a-4a3d-b613-f13ab92481aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:29.441558 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 20:16:29.710955 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0685b8f-00e4-4021-a247-b71120207e53 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:29.733682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0685b8f-00e4-4021-a247-b71120207e53 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:29.739543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577f7d4-6b7d-4acc-98cb-cfeb9e948653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:29.740158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577f7d4-6b7d-4acc-98cb-cfeb9e948653 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:29.740440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577f7d4-6b7d-4acc-98cb-cfeb9e948653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:29.740713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577f7d4-6b7d-4acc-98cb-cfeb9e948653 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:29.749228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577f7d4-6b7d-4acc-98cb-cfeb9e948653 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:29.751055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577f7d4-6b7d-4acc-98cb-cfeb9e948653 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:29.760090 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1324 bytes} [Mon Aug 29 20:16:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:16:29.766512 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08174e3-690a-4a3d-b613-f13ab92481aa None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:29.778728 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08174e3-690a-4a3d-b613-f13ab92481aa None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:29.785330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a098a-29e1-415f-907b-c595e6c254bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:29.786163 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a098a-29e1-415f-907b-c595e6c254bb admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:29.786560 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a098a-29e1-415f-907b-c595e6c254bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:29.786844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a098a-29e1-415f-907b-c595e6c254bb admin admin] PATH_INFO: `/v3/users/b4834a3500ae4e84a6e9864109a0e726` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:29.788497 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a098a-29e1-415f-907b-c595e6c254bb admin admin] RBAC: Authorizing `identity:get_user(user_id=b4834a3500ae4e84a6e9864109a0e726)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:29.790701 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a098a-29e1-415f-907b-c595e6c254bb admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:29.792299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 5/9] 10.222.0.52 () {56 vars in 1198 bytes} [Mon Aug 29 20:16:29 2022] GET /identity/v3/users/b4834a3500ae4e84a6e9864109a0e726 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:31.782864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3c670-2727-4822-949b-128d5bcbf277 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:31.783521 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3c670-2727-4822-949b-128d5bcbf277 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:31.783521 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3c670-2727-4822-949b-128d5bcbf277 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:31.784809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:31.790333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cb850-70bd-4c95-a608-a852607182e9 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:31.790787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cb850-70bd-4c95-a608-a852607182e9 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:31.790888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cb850-70bd-4c95-a608-a852607182e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:31.810175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-0a5cb850-70bd-4c95-a608-a852607182e9 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:31.811382 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0a5cb850-70bd-4c95-a608-a852607182e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:31.836999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97424402-e013-4ab6-9e11-791cba9f43d3 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:31.837272 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97424402-e013-4ab6-9e11-791cba9f43d3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:31.837608 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97424402-e013-4ab6-9e11-791cba9f43d3 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:31.838910 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 6/11] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:31.844204 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f0b9b-781a-4a49-8bd2-f9287ae69f9b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:31.844483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f0b9b-781a-4a49-8bd2-f9287ae69f9b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:31.844756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f0b9b-781a-4a49-8bd2-f9287ae69f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:31.896162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG passlib.handlers.bcrypt [None req-dd9f0b9b-781a-4a49-8bd2-f9287ae69f9b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81539) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 20:16:31.896552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG passlib.handlers.bcrypt [None req-dd9f0b9b-781a-4a49-8bd2-f9287ae69f9b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81539) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 20:16:31.901918 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:31.945706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-dd9f0b9b-781a-4a49-8bd2-f9287ae69f9b None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:31.947334 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-dd9f0b9b-781a-4a49-8bd2-f9287ae69f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:32.051693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:32.166782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cb850-70bd-4c95-a608-a852607182e9 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:32.195286 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:32.274856 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cb850-70bd-4c95-a608-a852607182e9 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:32.308299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cad6b-8ed9-4379-96d9-440bee1b17cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:32.308845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cad6b-8ed9-4379-96d9-440bee1b17cf None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:32.309159 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cad6b-8ed9-4379-96d9-440bee1b17cf None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:32.309537 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cad6b-8ed9-4379-96d9-440bee1b17cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:32.321872 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cad6b-8ed9-4379-96d9-440bee1b17cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:16:32.325227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f0b9b-781a-4a49-8bd2-f9287ae69f9b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:32.330843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-914cad6b-8ed9-4379-96d9-440bee1b17cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:16:32.330843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:16:32.330843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:16:32.330843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:16:32.330843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:16:32.330843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:16:32.330843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:16:32.330843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:16:32.330843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:16:32.330843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:16:32.330843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:16:32.330843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:16:32.330843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:16:32.330843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:16:32.330843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:16:32.330843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:16:32.331830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:16:32.331830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:16:32.331830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:16:32.331830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:16:32.331830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:16:32.331830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:16:32.331830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:16:32.331830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:16:32.331830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:16:32.331830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:16:32.331830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:16:32.331830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:16:32.331830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:16:32.331830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:16:32.331830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:16:32.331830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:16:32.332630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:16:32.332630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:16:32.332630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:16:32.332630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:16:32.332630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:16:32.332630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:16:32.332630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:16:32.332630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:16:32.332630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:16:32.332630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:16:32.332630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:16:32.332630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:16:32.332630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 7/14] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:16:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:16:32.337963 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cad6b-8ed9-4379-96d9-440bee1b17cf None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:32.426121 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:32.432208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f0b9b-781a-4a49-8bd2-f9287ae69f9b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:32.434603 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:32.445986 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cad6b-8ed9-4379-96d9-440bee1b17cf None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:32.472728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fd877-c301-4c52-9def-332c958d55b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:32.473637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fd877-c301-4c52-9def-332c958d55b2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:32.473904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fd877-c301-4c52-9def-332c958d55b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:32.474169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fd877-c301-4c52-9def-332c958d55b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:32.482667 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b83b84-2374-479a-a94e-776e53e0a55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:32.483299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b83b84-2374-479a-a94e-776e53e0a55c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:32.483557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b83b84-2374-479a-a94e-776e53e0a55c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:32.483826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b83b84-2374-479a-a94e-776e53e0a55c None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:32.484646 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b83b84-2374-479a-a94e-776e53e0a55c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:32.485185 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b83b84-2374-479a-a94e-776e53e0a55c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:32.487580 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b83b84-2374-479a-a94e-776e53e0a55c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:32.502097 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 8/15] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:16:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:16:32.507911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b83b84-2374-479a-a94e-776e53e0a55c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:32.549149 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fd877-c301-4c52-9def-332c958d55b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:32.550804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fd877-c301-4c52-9def-332c958d55b2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:32.618562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b83b84-2374-479a-a94e-776e53e0a55c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:32.653960 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 8/16] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:16:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:32.654642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8785805-219a-49d1-9af8-19897b891f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:32.655287 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8785805-219a-49d1-9af8-19897b891f1d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:32.655566 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8785805-219a-49d1-9af8-19897b891f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:32.655841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8785805-219a-49d1-9af8-19897b891f1d None admin] PATH_INFO: `/v3/users/b4834a3500ae4e84a6e9864109a0e726` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:32.657006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8785805-219a-49d1-9af8-19897b891f1d None admin] RBAC: Authorizing `identity:get_user(user_id=b4834a3500ae4e84a6e9864109a0e726)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:32.658548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8785805-219a-49d1-9af8-19897b891f1d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:32.659584 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fd877-c301-4c52-9def-332c958d55b2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:32.660121 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 9/17] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:16:32 2022] GET /identity/v3/users/b4834a3500ae4e84a6e9864109a0e726 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:16:32.662669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:32.666476 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8785805-219a-49d1-9af8-19897b891f1d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:32.684406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:32.767841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fd877-c301-4c52-9def-332c958d55b2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:32.776469 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8785805-219a-49d1-9af8-19897b891f1d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:32.804493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92120c9-9def-423d-89a6-b9c492685d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:32.805329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92120c9-9def-423d-89a6-b9c492685d3a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:32.805636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92120c9-9def-423d-89a6-b9c492685d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:32.805911 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92120c9-9def-423d-89a6-b9c492685d3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:32.822696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e00ad-acb5-4b1c-bcb8-0b395af17ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:32.823319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e00ad-acb5-4b1c-bcb8-0b395af17ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:32.823612 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e00ad-acb5-4b1c-bcb8-0b395af17ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:32.823881 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e00ad-acb5-4b1c-bcb8-0b395af17ae2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:32.825020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e00ad-acb5-4b1c-bcb8-0b395af17ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:32.826534 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e00ad-acb5-4b1c-bcb8-0b395af17ae2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:32.827567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92120c9-9def-423d-89a6-b9c492685d3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:32.828384 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 10/18] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:16:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:32.829040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92120c9-9def-423d-89a6-b9c492685d3a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:32.834051 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e00ad-acb5-4b1c-bcb8-0b395af17ae2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:32.848678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-b92120c9-9def-423d-89a6-b9c492685d3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:16:32.848678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:16:32.848678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:16:32.848678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:16:32.848678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:16:32.848678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:16:32.848678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:16:32.848678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:16:32.848678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:16:32.848678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:16:32.848678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:16:32.848678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:16:32.848678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:16:32.848678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:16:32.848678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:16:32.848678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:16:32.849637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:16:32.849637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:16:32.849637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:16:32.849637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:16:32.849637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:16:32.849637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:16:32.849637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:16:32.849637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:16:32.849637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:16:32.849637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:16:32.849637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:16:32.849637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:16:32.849637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:16:32.849637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:16:32.849637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:16:32.849637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:16:32.849637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:16:32.850417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:16:32.850417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:16:32.850417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:16:32.850417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 9/19] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:16:32.856721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92120c9-9def-423d-89a6-b9c492685d3a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:32.914375 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:32.919256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:32.938899 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e00ad-acb5-4b1c-bcb8-0b395af17ae2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:32.965913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92120c9-9def-423d-89a6-b9c492685d3a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:32.974683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2ce2a-327b-4b70-b294-fe85a3e8659e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:32.975300 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2ce2a-327b-4b70-b294-fe85a3e8659e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:32.975569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2ce2a-327b-4b70-b294-fe85a3e8659e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:32.975840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2ce2a-327b-4b70-b294-fe85a3e8659e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:32.976572 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2ce2a-327b-4b70-b294-fe85a3e8659e None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.domain.id=default, user.id=b4834a3500ae4e84a6e9864109a0e726) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:32.976875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2ce2a-327b-4b70-b294-fe85a3e8659e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:32.978353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2ce2a-327b-4b70-b294-fe85a3e8659e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:32.985245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 11/20] 10.222.0.52 () {56 vars in 1322 bytes} [Mon Aug 29 20:16:32 2022] GET /identity/v3/role_assignments?user.id=b4834a3500ae4e84a6e9864109a0e726&scope.domain.id=default&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:33.008144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22482cc-c23d-47dc-a3b7-9ace86a7fbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:33.008896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22482cc-c23d-47dc-a3b7-9ace86a7fbb8 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:33.009178 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22482cc-c23d-47dc-a3b7-9ace86a7fbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:33.009477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22482cc-c23d-47dc-a3b7-9ace86a7fbb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:33.010144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22482cc-c23d-47dc-a3b7-9ace86a7fbb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:33.010450 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22482cc-c23d-47dc-a3b7-9ace86a7fbb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:33.011900 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22482cc-c23d-47dc-a3b7-9ace86a7fbb8 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:33.031470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 10/21] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:16:35.065093 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617dde9-c26c-494d-8698-38eb84010f36 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:35.065662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617dde9-c26c-494d-8698-38eb84010f36 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:35.065751 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617dde9-c26c-494d-8698-38eb84010f36 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:35.067315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 12/22] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:35.073242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585bf97-5b51-462e-9ef0-afa1b897df12 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:35.073785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585bf97-5b51-462e-9ef0-afa1b897df12 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:35.073785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585bf97-5b51-462e-9ef0-afa1b897df12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:35.098541 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b585bf97-5b51-462e-9ef0-afa1b897df12 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:35.099847 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b585bf97-5b51-462e-9ef0-afa1b897df12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:35.183367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 11/23] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:35.305483 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeaca1-e618-4526-8641-3b555bc0cd66 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:35.305806 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeaca1-e618-4526-8641-3b555bc0cd66 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:35.306040 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeaca1-e618-4526-8641-3b555bc0cd66 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:35.307389 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:35.314437 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e147aa-f869-48ca-9f8f-7da5b00368b4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:35.314753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e147aa-f869-48ca-9f8f-7da5b00368b4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:35.314998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e147aa-f869-48ca-9f8f-7da5b00368b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:35.347413 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-56e147aa-f869-48ca-9f8f-7da5b00368b4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:35.347590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-56e147aa-f869-48ca-9f8f-7da5b00368b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:35.414113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:35.451995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 12/25] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:35.620500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeaca1-e618-4526-8641-3b555bc0cd66 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:35.755257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeaca1-e618-4526-8641-3b555bc0cd66 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:35.807926 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabf7d6-5d5f-4bb8-8e87-9e3d2e8783f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:35.808568 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabf7d6-5d5f-4bb8-8e87-9e3d2e8783f4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:35.808847 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabf7d6-5d5f-4bb8-8e87-9e3d2e8783f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:35.809118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabf7d6-5d5f-4bb8-8e87-9e3d2e8783f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:35.842477 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eabf7d6-5d5f-4bb8-8e87-9e3d2e8783f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:16:35.848402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-3eabf7d6-5d5f-4bb8-8e87-9e3d2e8783f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:16:35.848402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:16:35.848402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:16:35.848402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:16:35.848402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:16:35.848402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:16:35.848402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:16:35.848402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:16:35.848402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:16:35.848402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:16:35.848402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:16:35.848402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:16:35.848402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:16:35.848402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:16:35.848402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:16:35.848402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:16:35.849859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:16:35.849859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:16:35.849859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:16:35.849859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:16:35.849859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:16:35.849859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:16:35.849859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:16:35.849859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:16:35.849859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:16:35.849859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:16:35.849859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:16:35.849859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:16:35.849859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:16:35.849859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:16:35.849859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:16:35.849859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:16:35.851100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:16:35.851100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:16:35.851100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:16:35.851100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:16:35.851100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:16:35.851100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:16:35.851100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:16:35.851100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:16:35.851100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:16:35.851100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:16:35.851100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:16:35.851100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:16:35.851100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 14/26] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:16:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:16:35.855759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e147aa-f869-48ca-9f8f-7da5b00368b4 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:35.912628 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1c363-f1ac-491c-8a8c-e62d30639986 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:35.912916 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1c363-f1ac-491c-8a8c-e62d30639986 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:35.913180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1c363-f1ac-491c-8a8c-e62d30639986 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:35.915111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 15/27] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:16:35.920670 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b91b01-05d0-417e-adb5-112fe18f9ecb None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:35.920937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b91b01-05d0-417e-adb5-112fe18f9ecb None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:35.921211 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b91b01-05d0-417e-adb5-112fe18f9ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:35.936198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:35.955419 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-08b91b01-05d0-417e-adb5-112fe18f9ecb None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:35.956641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-08b91b01-05d0-417e-adb5-112fe18f9ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:36.028705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e147aa-f869-48ca-9f8f-7da5b00368b4 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:36.056557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 16/28] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:16:36.057594 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b91b01-05d0-417e-adb5-112fe18f9ecb None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:36.073211 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca53636-9d52-4f49-af03-dc8f73df21db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:36.073917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca53636-9d52-4f49-af03-dc8f73df21db None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.074457 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca53636-9d52-4f49-af03-dc8f73df21db None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.074534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca53636-9d52-4f49-af03-dc8f73df21db None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:36.075164 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca53636-9d52-4f49-af03-dc8f73df21db None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:36.075464 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca53636-9d52-4f49-af03-dc8f73df21db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:36.076884 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca53636-9d52-4f49-af03-dc8f73df21db None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:36.098786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 13/29] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:16:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:36.100077 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664195e-0a35-4921-8ca4-da08287ee9dd None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.100360 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664195e-0a35-4921-8ca4-da08287ee9dd None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.100639 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664195e-0a35-4921-8ca4-da08287ee9dd None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:36.106135 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 14/30] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:36.107670 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664195e-0a35-4921-8ca4-da08287ee9dd None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:36.160042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:36.198939 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b91b01-05d0-417e-adb5-112fe18f9ecb None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:36.237320 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ed507-d8cf-4152-b183-02df8c9ea930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:36.238007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ed507-d8cf-4152-b183-02df8c9ea930 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.238247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664195e-0a35-4921-8ca4-da08287ee9dd None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:36.238347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ed507-d8cf-4152-b183-02df8c9ea930 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.238534 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ed507-d8cf-4152-b183-02df8c9ea930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:36.240666 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:36.253981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ed507-d8cf-4152-b183-02df8c9ea930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:36.255700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ed507-d8cf-4152-b183-02df8c9ea930 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:36.274001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-f58ed507-d8cf-4152-b183-02df8c9ea930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:16:36.274001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:16:36.274001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:16:36.274001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:16:36.274001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:16:36.274001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:16:36.274001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:16:36.274001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:16:36.274001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:16:36.274001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:16:36.274001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:16:36.274001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:16:36.274001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:16:36.274001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:16:36.274001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:16:36.274001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:16:36.275009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:16:36.275009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:16:36.275009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:16:36.275009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:16:36.275009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:16:36.275009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:16:36.275009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:16:36.275009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:16:36.275009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:16:36.275009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:16:36.275009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:16:36.275009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:16:36.275009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:16:36.275009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:16:36.275009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:16:36.275009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:16:36.275009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:16:36.275799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:16:36.275799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:16:36.275799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:16:36.275799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 17/31] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:16:36.280955 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a62c2-eb83-4820-b8b8-887a1de7248b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.280955 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a62c2-eb83-4820-b8b8-887a1de7248b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.280955 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a62c2-eb83-4820-b8b8-887a1de7248b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:36.287557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed5a8a-7fcf-45b0-8971-e7f118548772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:36.288473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed5a8a-7fcf-45b0-8971-e7f118548772 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.288920 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed5a8a-7fcf-45b0-8971-e7f118548772 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.289375 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed5a8a-7fcf-45b0-8971-e7f118548772 None admin] PATH_INFO: `/v3/users/b4834a3500ae4e84a6e9864109a0e726` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:36.291089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed5a8a-7fcf-45b0-8971-e7f118548772 None admin] RBAC: Authorizing `identity:get_user(user_id=b4834a3500ae4e84a6e9864109a0e726)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:36.292776 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed5a8a-7fcf-45b0-8971-e7f118548772 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:36.295497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 15/32] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:16:36 2022] GET /identity/v3/users/b4834a3500ae4e84a6e9864109a0e726 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:36.296522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed5a8a-7fcf-45b0-8971-e7f118548772 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:36.305012 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-360a62c2-eb83-4820-b8b8-887a1de7248b None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:36.306333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-360a62c2-eb83-4820-b8b8-887a1de7248b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:36.395464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 18/33] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:36.396392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a62c2-eb83-4820-b8b8-887a1de7248b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:36.475071 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed5a8a-7fcf-45b0-8971-e7f118548772 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:36.495114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:36.544344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8f00e-87a4-4aa2-b9c4-01c0e0d08de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:36.545467 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8f00e-87a4-4aa2-b9c4-01c0e0d08de0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.546124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8f00e-87a4-4aa2-b9c4-01c0e0d08de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.546578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8f00e-87a4-4aa2-b9c4-01c0e0d08de0 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:36.547621 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8f00e-87a4-4aa2-b9c4-01c0e0d08de0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:36.548101 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8f00e-87a4-4aa2-b9c4-01c0e0d08de0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:36.553392 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8f00e-87a4-4aa2-b9c4-01c0e0d08de0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:36.576020 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 16/34] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:36.583320 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8f00e-87a4-4aa2-b9c4-01c0e0d08de0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:36.671140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a62c2-eb83-4820-b8b8-887a1de7248b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:36.712299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:36.740505 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcebf8-b25e-433a-bee7-163f9ac39690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:36.741259 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcebf8-b25e-433a-bee7-163f9ac39690 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.741592 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcebf8-b25e-433a-bee7-163f9ac39690 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.741868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcebf8-b25e-433a-bee7-163f9ac39690 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:36.746511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcebf8-b25e-433a-bee7-163f9ac39690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:36.748266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcebf8-b25e-433a-bee7-163f9ac39690 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:36.750311 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 19/35] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:16:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:36.751091 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcebf8-b25e-433a-bee7-163f9ac39690 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:36.814769 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8f00e-87a4-4aa2-b9c4-01c0e0d08de0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:36.854590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c49cd-cbc5-4c3b-ab77-2cef4d67fbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:36.855200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c49cd-cbc5-4c3b-ab77-2cef4d67fbaa None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.855480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c49cd-cbc5-4c3b-ab77-2cef4d67fbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.855748 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c49cd-cbc5-4c3b-ab77-2cef4d67fbaa None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:36.856427 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c49cd-cbc5-4c3b-ab77-2cef4d67fbaa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:36.857927 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c49cd-cbc5-4c3b-ab77-2cef4d67fbaa None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:36.875730 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcebf8-b25e-433a-bee7-163f9ac39690 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:36.911713 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df48c0f-a292-4b7f-84f9-0f22a81a7289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:36.912328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df48c0f-a292-4b7f-84f9-0f22a81a7289 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.912603 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df48c0f-a292-4b7f-84f9-0f22a81a7289 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.912867 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df48c0f-a292-4b7f-84f9-0f22a81a7289 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:36.913556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df48c0f-a292-4b7f-84f9-0f22a81a7289 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:36.915046 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df48c0f-a292-4b7f-84f9-0f22a81a7289 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:36.982360 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 17/36] 10.222.0.52 () {60 vars in 1131 bytes} [Mon Aug 29 20:16:36 2022] POST /identity/v3/roles => generated 219 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:36.983608 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c49cd-cbc5-4c3b-ab77-2cef4d67fbaa None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:37.023687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:37.048029 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 20/37] 10.222.0.52 () {60 vars in 1141 bytes} [Mon Aug 29 20:16:36 2022] POST /identity/v3/projects => generated 301 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:37.049126 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df48c0f-a292-4b7f-84f9-0f22a81a7289 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:37.133311 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:37.175465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c49cd-cbc5-4c3b-ab77-2cef4d67fbaa None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:37.223090 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503387f-dda5-4542-a23e-5630fc7e1d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:37.224375 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503387f-dda5-4542-a23e-5630fc7e1d27 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:37.224658 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503387f-dda5-4542-a23e-5630fc7e1d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:37.224934 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503387f-dda5-4542-a23e-5630fc7e1d27 None admin] PATH_INFO: `/v3/domains/default/users/b4834a3500ae4e84a6e9864109a0e726/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:37.228470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503387f-dda5-4542-a23e-5630fc7e1d27 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b4834a3500ae4e84a6e9864109a0e726, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:37.230631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503387f-dda5-4542-a23e-5630fc7e1d27 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:37.237925 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df48c0f-a292-4b7f-84f9-0f22a81a7289 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:37.247425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 18/38] 10.222.0.52 () {58 vars in 1361 bytes} [Mon Aug 29 20:16:36 2022] PUT /identity/v3/domains/default/users/b4834a3500ae4e84a6e9864109a0e726/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:37.249419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4873de-1130-4fbd-94db-6081c4a63433 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:37.249714 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4873de-1130-4fbd-94db-6081c4a63433 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:37.250033 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4873de-1130-4fbd-94db-6081c4a63433 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:37.251633 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 19/39] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:37.253178 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06a99-94d5-49d9-90a6-fa606f9baa74 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:37.253488 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06a99-94d5-49d9-90a6-fa606f9baa74 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:37.253763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06a99-94d5-49d9-90a6-fa606f9baa74 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:37.255259 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 20/40] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:37.262687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28676c-72c6-4f0a-a218-3f5e9e10fc69 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:37.262976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28676c-72c6-4f0a-a218-3f5e9e10fc69 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:37.263277 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28676c-72c6-4f0a-a218-3f5e9e10fc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:37.287456 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-bc28676c-72c6-4f0a-a218-3f5e9e10fc69 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:37.288975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bc28676c-72c6-4f0a-a218-3f5e9e10fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:37.295510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1452ee-eace-44f2-afb1-6b72a689756d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:37.296501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1452ee-eace-44f2-afb1-6b72a689756d None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:37.296952 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1452ee-eace-44f2-afb1-6b72a689756d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:37.297515 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1452ee-eace-44f2-afb1-6b72a689756d None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:37.299218 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1452ee-eace-44f2-afb1-6b72a689756d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:37.301531 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1452ee-eace-44f2-afb1-6b72a689756d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:37.333390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 21/41] 10.222.0.52 () {60 vars in 1131 bytes} [Mon Aug 29 20:16:37 2022] POST /identity/v3/roles => generated 225 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:37.335350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be948a-b428-48b4-b2af-92a52ba3465f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:37.335805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be948a-b428-48b4-b2af-92a52ba3465f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:37.336246 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be948a-b428-48b4-b2af-92a52ba3465f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:37.393402 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 21/42] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:16:37.498199 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-48be948a-b428-48b4-b2af-92a52ba3465f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:37.500118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-48be948a-b428-48b4-b2af-92a52ba3465f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:37.583330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 22/43] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:37.683091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28676c-72c6-4f0a-a218-3f5e9e10fc69 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:37.701747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:37.798770 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28676c-72c6-4f0a-a218-3f5e9e10fc69 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:37.839974 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89bf43-dabb-4da6-b5d6-f2319d3f5bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:37.840918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89bf43-dabb-4da6-b5d6-f2319d3f5bf6 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:37.841420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89bf43-dabb-4da6-b5d6-f2319d3f5bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:37.841918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89bf43-dabb-4da6-b5d6-f2319d3f5bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:37.842909 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89bf43-dabb-4da6-b5d6-f2319d3f5bf6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:37.846094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89bf43-dabb-4da6-b5d6-f2319d3f5bf6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:37.851178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be948a-b428-48b4-b2af-92a52ba3465f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:37.862990 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 22/44] 10.222.0.52 () {60 vars in 1131 bytes} [Mon Aug 29 20:16:37 2022] POST /identity/v3/roles => generated 223 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:37.884732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:37.979282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be948a-b428-48b4-b2af-92a52ba3465f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:38.019158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81846db2-d77b-4baf-8660-0a1f8d69820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:38.019799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81846db2-d77b-4baf-8660-0a1f8d69820d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:38.020078 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81846db2-d77b-4baf-8660-0a1f8d69820d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:38.020369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81846db2-d77b-4baf-8660-0a1f8d69820d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:38.021516 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81846db2-d77b-4baf-8660-0a1f8d69820d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:38.022991 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81846db2-d77b-4baf-8660-0a1f8d69820d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:38.024645 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 23/45] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:16:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:16:38.030599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89bf43-dabb-4da6-b5d6-f2319d3f5bf6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:38.122817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:38.147305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89bf43-dabb-4da6-b5d6-f2319d3f5bf6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:38.183342 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6a73c-bcb6-475e-a27f-92d9b7439c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:38.184007 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6a73c-bcb6-475e-a27f-92d9b7439c81 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:38.184183 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6a73c-bcb6-475e-a27f-92d9b7439c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:38.184498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6a73c-bcb6-475e-a27f-92d9b7439c81 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:38.185137 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6a73c-bcb6-475e-a27f-92d9b7439c81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:38.186633 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6a73c-bcb6-475e-a27f-92d9b7439c81 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:38.219901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 23/46] 10.222.0.52 () {60 vars in 1141 bytes} [Mon Aug 29 20:16:38 2022] POST /identity/v3/projects => generated 312 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:16:39.265809 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b469cb1-a76e-41da-8661-2efbfe698cc1 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:39.266388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b469cb1-a76e-41da-8661-2efbfe698cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:39.266388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b469cb1-a76e-41da-8661-2efbfe698cc1 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:39.267738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 24/47] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:39.273323 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e48a7-2f04-4b02-88ba-6423365a6137 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:39.273786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e48a7-2f04-4b02-88ba-6423365a6137 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:39.273948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e48a7-2f04-4b02-88ba-6423365a6137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:39.293435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-051e48a7-2f04-4b02-88ba-6423365a6137 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:39.294659 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-051e48a7-2f04-4b02-88ba-6423365a6137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:39.366145 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 24/48] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:39.632875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b469cb1-a76e-41da-8661-2efbfe698cc1 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:39.733350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:39.742497 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b469cb1-a76e-41da-8661-2efbfe698cc1 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:39.777566 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bccc2c-3670-4bcc-ae0b-5b7d964d59f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:39.778209 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bccc2c-3670-4bcc-ae0b-5b7d964d59f0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:39.778471 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bccc2c-3670-4bcc-ae0b-5b7d964d59f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:39.778749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bccc2c-3670-4bcc-ae0b-5b7d964d59f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:39.790696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bccc2c-3670-4bcc-ae0b-5b7d964d59f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:16:39.795973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-64bccc2c-3670-4bcc-ae0b-5b7d964d59f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:16:39.795973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:16:39.795973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:16:39.795973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:16:39.795973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:16:39.795973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:16:39.795973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:16:39.795973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:16:39.795973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:16:39.795973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:16:39.795973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:16:39.795973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:16:39.795973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:16:39.795973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:16:39.795973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:16:39.795973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:16:39.797237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:16:39.797237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:16:39.797237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:16:39.797237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:16:39.797237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:16:39.797237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:16:39.797237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:16:39.797237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:16:39.797237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:16:39.797237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:16:39.797237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:16:39.797237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:16:39.797237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:16:39.797237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:16:39.797237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:16:39.797237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:16:39.798303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:16:39.798303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:16:39.798303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:16:39.798303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:16:39.798303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:16:39.798303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:16:39.798303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:16:39.798303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:16:39.798303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:16:39.798303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:16:39.798303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:16:39.798303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:16:39.798303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 25/49] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:16:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:16:39.803161 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e48a7-2f04-4b02-88ba-6423365a6137 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:39.865936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:39.908774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e48a7-2f04-4b02-88ba-6423365a6137 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:39.944958 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d48006-b972-4dd6-ab13-c0e820534659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:39.946043 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d48006-b972-4dd6-ab13-c0e820534659 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:39.946589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d48006-b972-4dd6-ab13-c0e820534659 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:39.946894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d48006-b972-4dd6-ab13-c0e820534659 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:39.947601 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d48006-b972-4dd6-ab13-c0e820534659 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:39.948274 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d48006-b972-4dd6-ab13-c0e820534659 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:39.949729 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d48006-b972-4dd6-ab13-c0e820534659 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:39.960765 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 25/50] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:16:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:39.967210 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bccc2c-3670-4bcc-ae0b-5b7d964d59f0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:40.078419 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bccc2c-3670-4bcc-ae0b-5b7d964d59f0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:40.106768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d13266-eb72-44d9-9eb3-75b2531ca850 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:40.107027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d13266-eb72-44d9-9eb3-75b2531ca850 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:40.107304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d13266-eb72-44d9-9eb3-75b2531ca850 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:40.108669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 26/51] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:16:40.113536 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feaf7e-82e8-4558-9002-9cf629c25b2f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:40.113813 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feaf7e-82e8-4558-9002-9cf629c25b2f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:40.114084 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feaf7e-82e8-4558-9002-9cf629c25b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:40.115432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896b83f-4cc7-4218-b0c9-306948e9c4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:40.116066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896b83f-4cc7-4218-b0c9-306948e9c4ea None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:40.116345 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896b83f-4cc7-4218-b0c9-306948e9c4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:40.116622 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896b83f-4cc7-4218-b0c9-306948e9c4ea None admin] PATH_INFO: `/v3/users/b4834a3500ae4e84a6e9864109a0e726` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:40.117780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896b83f-4cc7-4218-b0c9-306948e9c4ea None admin] RBAC: Authorizing `identity:get_user(user_id=b4834a3500ae4e84a6e9864109a0e726)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:40.119240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896b83f-4cc7-4218-b0c9-306948e9c4ea None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:40.120793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 26/52] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:16:39 2022] GET /identity/v3/users/b4834a3500ae4e84a6e9864109a0e726 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:40.126466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896b83f-4cc7-4218-b0c9-306948e9c4ea None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:40.133012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a7feaf7e-82e8-4558-9002-9cf629c25b2f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:40.134231 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a7feaf7e-82e8-4558-9002-9cf629c25b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:40.152375 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:40.240460 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896b83f-4cc7-4218-b0c9-306948e9c4ea None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:40.278555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ba025-c8bd-4259-96c3-cb24f49fb290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:40.279215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ba025-c8bd-4259-96c3-cb24f49fb290 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:40.279463 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ba025-c8bd-4259-96c3-cb24f49fb290 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:40.279733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ba025-c8bd-4259-96c3-cb24f49fb290 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:40.280892 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ba025-c8bd-4259-96c3-cb24f49fb290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:40.282436 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ba025-c8bd-4259-96c3-cb24f49fb290 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:40.284104 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 27/53] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:16:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:16:40.290217 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ba025-c8bd-4259-96c3-cb24f49fb290 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:40.315253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 27/54] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:40.384752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:40.394835 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ba025-c8bd-4259-96c3-cb24f49fb290 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:40.429738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98656cf2-4f78-4cf7-a20e-74f1960f7dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:40.430364 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98656cf2-4f78-4cf7-a20e-74f1960f7dde None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:40.430649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98656cf2-4f78-4cf7-a20e-74f1960f7dde None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:40.430918 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98656cf2-4f78-4cf7-a20e-74f1960f7dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:40.431651 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98656cf2-4f78-4cf7-a20e-74f1960f7dde None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.domain.id=default, user.id=b4834a3500ae4e84a6e9864109a0e726) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:40.431956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98656cf2-4f78-4cf7-a20e-74f1960f7dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:40.433423 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98656cf2-4f78-4cf7-a20e-74f1960f7dde None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:40.439584 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 28/55] 10.222.0.52 () {56 vars in 1322 bytes} [Mon Aug 29 20:16:40 2022] GET /identity/v3/role_assignments?user.id=b4834a3500ae4e84a6e9864109a0e726&scope.domain.id=default&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:16:40.578340 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feaf7e-82e8-4558-9002-9cf629c25b2f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:40.633170 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:40.684785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feaf7e-82e8-4558-9002-9cf629c25b2f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:40.722780 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b88f73-9e30-4b8f-afd6-722f47ad1c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:40.723734 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b88f73-9e30-4b8f-afd6-722f47ad1c4a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:40.724021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b88f73-9e30-4b8f-afd6-722f47ad1c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:40.724364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b88f73-9e30-4b8f-afd6-722f47ad1c4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:40.725838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b88f73-9e30-4b8f-afd6-722f47ad1c4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:40.727307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b88f73-9e30-4b8f-afd6-722f47ad1c4a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:40.728876 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 28/56] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:16:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:40.734925 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98656cf2-4f78-4cf7-a20e-74f1960f7dde None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:40.844259 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98656cf2-4f78-4cf7-a20e-74f1960f7dde None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:40.880480 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978befd-5aeb-43b7-9cd5-b4ee1f904ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:40.881080 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978befd-5aeb-43b7-9cd5-b4ee1f904ab4 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:40.881351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978befd-5aeb-43b7-9cd5-b4ee1f904ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:40.881649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978befd-5aeb-43b7-9cd5-b4ee1f904ab4 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:40.882293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978befd-5aeb-43b7-9cd5-b4ee1f904ab4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:40.883736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978befd-5aeb-43b7-9cd5-b4ee1f904ab4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:40.913643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 29/57] 10.222.0.52 () {60 vars in 1140 bytes} [Mon Aug 29 20:16:40 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:42.831571 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04227cc0-91a5-47c8-8b1f-392c8319bf23 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:42.832096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04227cc0-91a5-47c8-8b1f-392c8319bf23 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:42.832096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04227cc0-91a5-47c8-8b1f-392c8319bf23 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:42.834090 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 29/58] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:42.842795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fa265-b1da-4f8d-bf8f-ae5a2dd5e18b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:42.843192 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fa265-b1da-4f8d-bf8f-ae5a2dd5e18b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:42.843437 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fa265-b1da-4f8d-bf8f-ae5a2dd5e18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:42.857448 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:42.864042 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-0f3fa265-b1da-4f8d-bf8f-ae5a2dd5e18b None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:42.866306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0f3fa265-b1da-4f8d-bf8f-ae5a2dd5e18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:42.936787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 30/59] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:43.203750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04227cc0-91a5-47c8-8b1f-392c8319bf23 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:43.327167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04227cc0-91a5-47c8-8b1f-392c8319bf23 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:43.346943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:43.367474 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a468452-dc8a-4833-a005-d70fad8121bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:43.368247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a468452-dc8a-4833-a005-d70fad8121bc None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:43.368568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a468452-dc8a-4833-a005-d70fad8121bc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:43.368887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a468452-dc8a-4833-a005-d70fad8121bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:43.370151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a468452-dc8a-4833-a005-d70fad8121bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:43.371786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a468452-dc8a-4833-a005-d70fad8121bc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:43.373382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 30/60] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:16:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:43.379156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fa265-b1da-4f8d-bf8f-ae5a2dd5e18b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:43.483302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fa265-b1da-4f8d-bf8f-ae5a2dd5e18b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:43.516169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3fb5b-9f7e-4db4-9185-d206db1a3bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:43.516778 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3fb5b-9f7e-4db4-9185-d206db1a3bd5 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:43.517075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3fb5b-9f7e-4db4-9185-d206db1a3bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:43.517401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3fb5b-9f7e-4db4-9185-d206db1a3bd5 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:43.518147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3fb5b-9f7e-4db4-9185-d206db1a3bd5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:43.519605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3fb5b-9f7e-4db4-9185-d206db1a3bd5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:43.531560 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:43.551885 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 31/61] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:16:43 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:46.765339 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4714b4-483b-4cca-a989-87bedfddd443 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:46.766388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4714b4-483b-4cca-a989-87bedfddd443 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:46.766940 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4714b4-483b-4cca-a989-87bedfddd443 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:46.768468 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 31/62] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:46.774320 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc64a7-39f3-4292-b1d9-718750d234f4 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:46.774741 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc64a7-39f3-4292-b1d9-718750d234f4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:46.774857 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc64a7-39f3-4292-b1d9-718750d234f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:46.801887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-07cc64a7-39f3-4292-b1d9-718750d234f4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:46.803410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-07cc64a7-39f3-4292-b1d9-718750d234f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:46.814993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0762-51bd-4f76-8b41-7140512154d2 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:46.815353 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0762-51bd-4f76-8b41-7140512154d2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:46.815714 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0762-51bd-4f76-8b41-7140512154d2 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:46.817986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 32/63] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:46.824764 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c3f3e-2c9b-4b37-b878-d637349ae3a1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:46.825313 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c3f3e-2c9b-4b37-b878-d637349ae3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:46.825840 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c3f3e-2c9b-4b37-b878-d637349ae3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:46.866208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1e9c3f3e-2c9b-4b37-b878-d637349ae3a1 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:46.867413 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1e9c3f3e-2c9b-4b37-b878-d637349ae3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:46.921909 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 32/64] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:46.930164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c30e5-6f0b-4699-9d3d-84f8916465be None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:46.930687 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c30e5-6f0b-4699-9d3d-84f8916465be None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:46.931099 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c30e5-6f0b-4699-9d3d-84f8916465be None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:46.932783 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 33/65] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:16:46.938889 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd415559-260d-4a80-bba1-3a70c6cf040b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:46.939358 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd415559-260d-4a80-bba1-3a70c6cf040b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:46.939770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd415559-260d-4a80-bba1-3a70c6cf040b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:46.963313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-cd415559-260d-4a80-bba1-3a70c6cf040b None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:46.965052 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-cd415559-260d-4a80-bba1-3a70c6cf040b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:47.007613 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 33/66] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:16:47.043860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 34/67] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:16:47.197042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55f861-a6c9-4d34-801e-ed1fe32b882f None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:47.197780 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55f861-a6c9-4d34-801e-ed1fe32b882f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:47.198253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55f861-a6c9-4d34-801e-ed1fe32b882f None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:47.200052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 34/68] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:47.205062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abc13b-d664-4153-be31-632dbd567dc2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:47.205351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abc13b-d664-4153-be31-632dbd567dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:47.205647 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abc13b-d664-4153-be31-632dbd567dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:47.224808 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-64abc13b-d664-4153-be31-632dbd567dc2 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:47.226467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-64abc13b-d664-4153-be31-632dbd567dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:47.270163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b98bda-7f9b-4663-8192-08487df3b178 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:47.270765 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b98bda-7f9b-4663-8192-08487df3b178 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:47.271259 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b98bda-7f9b-4663-8192-08487df3b178 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:47.273049 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 35/69] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:47.286974 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efb92d-4b35-49fa-952f-8d5da9403c61 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:47.287291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efb92d-4b35-49fa-952f-8d5da9403c61 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:47.287522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efb92d-4b35-49fa-952f-8d5da9403c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:47.293833 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:47.315108 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e0efb92d-4b35-49fa-952f-8d5da9403c61 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:47.316365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e0efb92d-4b35-49fa-952f-8d5da9403c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:47.326285 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 35/70] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:47.327224 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abc13b-d664-4153-be31-632dbd567dc2 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:47.426247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 36/71] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:16:47.433218 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efb92d-4b35-49fa-952f-8d5da9403c61 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:47.472067 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abc13b-d664-4153-be31-632dbd567dc2 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:47.483843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:47.524459 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc551-654f-4119-82f0-dc6961a53d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:47.525622 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc551-654f-4119-82f0-dc6961a53d5e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:47.526037 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc551-654f-4119-82f0-dc6961a53d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:47.526484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc551-654f-4119-82f0-dc6961a53d5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:47.539935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadc551-654f-4119-82f0-dc6961a53d5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:16:47.545066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-cbadc551-654f-4119-82f0-dc6961a53d5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:16:47.545066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:16:47.545066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:16:47.545066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:16:47.545066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:16:47.545066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:16:47.545066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:16:47.545066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:16:47.545066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:16:47.545066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:16:47.545066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:16:47.545066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:16:47.545066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:16:47.545066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:16:47.545066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:16:47.545066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:16:47.546136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:16:47.546136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:16:47.546136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:16:47.546136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:16:47.546136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:16:47.546136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:16:47.546136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:16:47.546136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:16:47.546136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:16:47.546136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:16:47.546136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:16:47.546136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:16:47.546136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:16:47.546136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:16:47.546136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:16:47.546136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:16:47.546891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:16:47.546891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:16:47.546891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:16:47.546891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:16:47.546891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:16:47.546891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:16:47.546891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:16:47.546891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:16:47.546891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:16:47.546891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:16:47.546891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:16:47.546891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:16:47.546891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 36/72] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:16:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:16:47.549253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efb92d-4b35-49fa-952f-8d5da9403c61 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:47.551966 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc551-654f-4119-82f0-dc6961a53d5e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:47.594536 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8dd31-5c7d-472f-8753-221ff24d0b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:47.595855 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8dd31-5c7d-472f-8753-221ff24d0b8e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:47.596320 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8dd31-5c7d-472f-8753-221ff24d0b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:47.596773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8dd31-5c7d-472f-8753-221ff24d0b8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:47.602329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:47.613554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8dd31-5c7d-472f-8753-221ff24d0b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:16:47.623688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-0bd8dd31-5c7d-472f-8753-221ff24d0b8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:16:47.623688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:16:47.623688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:16:47.623688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:16:47.623688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:16:47.623688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:16:47.623688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:16:47.623688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:16:47.623688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:16:47.623688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:16:47.623688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:16:47.623688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:16:47.623688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:16:47.623688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:16:47.623688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:16:47.623688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:16:47.624690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:16:47.624690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:16:47.624690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:16:47.624690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:16:47.624690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:16:47.624690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:16:47.624690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:16:47.624690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:16:47.624690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:16:47.624690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:16:47.624690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:16:47.624690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:16:47.624690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:16:47.624690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:16:47.624690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:16:47.624690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:16:47.625697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:16:47.625697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:16:47.625697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:16:47.625697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:16:47.625697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:16:47.625697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:16:47.625697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:16:47.625697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:16:47.625697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:16:47.625697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:16:47.625697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:16:47.625697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:16:47.628641 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 37/73] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:16:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:16:47.628641 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8dd31-5c7d-472f-8753-221ff24d0b8e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:47.685452 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc551-654f-4119-82f0-dc6961a53d5e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:47.721628 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebfb64-ca03-430f-a8ac-cbec429b88a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:47.722273 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebfb64-ca03-430f-a8ac-cbec429b88a7 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:47.722552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebfb64-ca03-430f-a8ac-cbec429b88a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:47.722828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebfb64-ca03-430f-a8ac-cbec429b88a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:47.733347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebfb64-ca03-430f-a8ac-cbec429b88a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:16:47.738422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-4aebfb64-ca03-430f-a8ac-cbec429b88a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:16:47.738422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:16:47.738422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:16:47.738422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:16:47.738422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:16:47.738422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:16:47.738422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:16:47.738422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:16:47.738422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:16:47.738422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:16:47.738422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:16:47.738422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:16:47.738422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:16:47.738422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:16:47.738422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:16:47.738422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:16:47.739294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:16:47.739294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:16:47.739294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:16:47.739294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:16:47.739294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:16:47.739294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:16:47.739294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:16:47.739294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:16:47.739294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:16:47.739294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:16:47.739294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:16:47.739294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:16:47.739294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:16:47.739294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:16:47.739294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:16:47.739294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:16:47.741932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:16:47.741932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:16:47.741932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:16:47.741932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:16:47.741932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:16:47.741932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:16:47.741932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:16:47.741932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:16:47.741932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:16:47.741932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:16:47.741932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:16:47.741932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:16:47.741932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 37/74] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:16:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:16:47.741932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebfb64-ca03-430f-a8ac-cbec429b88a7 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:47.743731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8dd31-5c7d-472f-8753-221ff24d0b8e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:47.751681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:47.779515 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0fda0-ffcd-4ce5-be6e-e106fdb76911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:47.780180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0fda0-ffcd-4ce5-be6e-e106fdb76911 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:47.780389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0fda0-ffcd-4ce5-be6e-e106fdb76911 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:47.780660 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0fda0-ffcd-4ce5-be6e-e106fdb76911 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:47.781324 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0fda0-ffcd-4ce5-be6e-e106fdb76911 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:47.781653 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0fda0-ffcd-4ce5-be6e-e106fdb76911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:47.783058 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0fda0-ffcd-4ce5-be6e-e106fdb76911 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:47.791295 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 38/75] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:16:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:47.792079 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0fda0-ffcd-4ce5-be6e-e106fdb76911 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:47.844822 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebfb64-ca03-430f-a8ac-cbec429b88a7 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:47.846800 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:47.882603 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32d211-3b6a-4e5e-9a07-6139e2f1b5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:47.883249 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32d211-3b6a-4e5e-9a07-6139e2f1b5df None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:47.883528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32d211-3b6a-4e5e-9a07-6139e2f1b5df None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:47.883789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32d211-3b6a-4e5e-9a07-6139e2f1b5df None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:47.884946 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32d211-3b6a-4e5e-9a07-6139e2f1b5df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:47.886464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32d211-3b6a-4e5e-9a07-6139e2f1b5df None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:47.888038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 38/76] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:16:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:47.889483 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32d211-3b6a-4e5e-9a07-6139e2f1b5df None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:47.896890 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0fda0-ffcd-4ce5-be6e-e106fdb76911 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:47.932563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d14d1-6c3a-4e4c-afca-dbf92c1ad3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:47.933181 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d14d1-6c3a-4e4c-afca-dbf92c1ad3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:47.933594 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d14d1-6c3a-4e4c-afca-dbf92c1ad3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:47.933749 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d14d1-6c3a-4e4c-afca-dbf92c1ad3f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:47.934420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d14d1-6c3a-4e4c-afca-dbf92c1ad3f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:47.934719 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d14d1-6c3a-4e4c-afca-dbf92c1ad3f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:47.936106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d14d1-6c3a-4e4c-afca-dbf92c1ad3f2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:47.944843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 39/77] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:16:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:47.944843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d14d1-6c3a-4e4c-afca-dbf92c1ad3f2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:47.977636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:47.998353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32d211-3b6a-4e5e-9a07-6139e2f1b5df None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:48.032978 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb89bd8-5fc4-4313-9739-2ad5edd942f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:48.033644 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb89bd8-5fc4-4313-9739-2ad5edd942f9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:48.033922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb89bd8-5fc4-4313-9739-2ad5edd942f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:48.034197 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb89bd8-5fc4-4313-9739-2ad5edd942f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:48.044919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb89bd8-5fc4-4313-9739-2ad5edd942f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:16:48.048360 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d14d1-6c3a-4e4c-afca-dbf92c1ad3f2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:48.049795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-ebb89bd8-5fc4-4313-9739-2ad5edd942f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:16:48.049795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:16:48.049795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:16:48.049795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:16:48.049795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:16:48.049795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:16:48.049795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:16:48.049795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:16:48.049795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:16:48.049795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:16:48.049795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:16:48.049795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:16:48.049795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:16:48.049795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:16:48.049795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:16:48.049795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:16:48.057353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:16:48.057353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:16:48.057353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:16:48.057353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:16:48.057353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:16:48.057353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:16:48.057353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:16:48.057353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:16:48.057353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:16:48.057353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:16:48.057353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:16:48.057353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:16:48.057353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:16:48.057353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:16:48.057353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:16:48.057353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:16:48.058339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:16:48.058339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:16:48.058339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:16:48.058339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:16:48.058339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:16:48.058339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:16:48.058339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:16:48.058339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:16:48.058339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:16:48.058339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:16:48.058339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:16:48.058339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:16:48.058339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 39/78] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:16:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:16:48.058339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb89bd8-5fc4-4313-9739-2ad5edd942f9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:48.083893 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:48.087003 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0b841-58a8-41ea-892e-e47cae972960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:48.087734 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0b841-58a8-41ea-892e-e47cae972960 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:48.088122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0b841-58a8-41ea-892e-e47cae972960 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:48.088366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0b841-58a8-41ea-892e-e47cae972960 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:48.089046 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0b841-58a8-41ea-892e-e47cae972960 None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:48.089382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0b841-58a8-41ea-892e-e47cae972960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:48.090788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0b841-58a8-41ea-892e-e47cae972960 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:48.100699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 40/79] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:16:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:48.101580 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0b841-58a8-41ea-892e-e47cae972960 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:48.158774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb89bd8-5fc4-4313-9739-2ad5edd942f9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:48.194358 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c5115-84bb-4175-989f-b5f1fa8c5b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:48.195059 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c5115-84bb-4175-989f-b5f1fa8c5b10 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:48.195285 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c5115-84bb-4175-989f-b5f1fa8c5b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:48.195557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c5115-84bb-4175-989f-b5f1fa8c5b10 None admin] PATH_INFO: `/v3/users/1646a508a727421c8e569118d78f0ee3` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:48.199663 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:48.208857 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0b841-58a8-41ea-892e-e47cae972960 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:48.210823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c5115-84bb-4175-989f-b5f1fa8c5b10 None admin] RBAC: Authorizing `identity:get_user(user_id=1646a508a727421c8e569118d78f0ee3)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:48.212317 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c5115-84bb-4175-989f-b5f1fa8c5b10 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:48.214021 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 40/80] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:16:48 2022] GET /identity/v3/users/1646a508a727421c8e569118d78f0ee3 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:48.214794 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c5115-84bb-4175-989f-b5f1fa8c5b10 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:48.251929 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35e8a1-6d4a-4f3a-8b49-95f4cd590941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:48.252920 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35e8a1-6d4a-4f3a-8b49-95f4cd590941 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:48.253381 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35e8a1-6d4a-4f3a-8b49-95f4cd590941 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:48.253833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35e8a1-6d4a-4f3a-8b49-95f4cd590941 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:48.254917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35e8a1-6d4a-4f3a-8b49-95f4cd590941 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:48.257557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35e8a1-6d4a-4f3a-8b49-95f4cd590941 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:48.293422 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 41/81] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:16:48 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:48.294074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35e8a1-6d4a-4f3a-8b49-95f4cd590941 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:48.339487 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:48.352952 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c5115-84bb-4175-989f-b5f1fa8c5b10 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:48.394123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015cfaa-5bbf-463c-b619-66a71eed7cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:48.395032 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015cfaa-5bbf-463c-b619-66a71eed7cca None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:48.395468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015cfaa-5bbf-463c-b619-66a71eed7cca None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:48.395926 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015cfaa-5bbf-463c-b619-66a71eed7cca None admin] PATH_INFO: `/v3/users/b4834a3500ae4e84a6e9864109a0e726` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:48.397439 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015cfaa-5bbf-463c-b619-66a71eed7cca None admin] RBAC: Authorizing `identity:get_user(user_id=b4834a3500ae4e84a6e9864109a0e726)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:48.399144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015cfaa-5bbf-463c-b619-66a71eed7cca None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:48.401302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 41/82] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:16:48 2022] GET /identity/v3/users/b4834a3500ae4e84a6e9864109a0e726 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:48.402303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015cfaa-5bbf-463c-b619-66a71eed7cca None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:48.422563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35e8a1-6d4a-4f3a-8b49-95f4cd590941 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:48.471993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3765cf-9f04-4a2f-8fce-0ebe2a205bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:48.472786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3765cf-9f04-4a2f-8fce-0ebe2a205bda None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:48.473075 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3765cf-9f04-4a2f-8fce-0ebe2a205bda None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:48.473347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3765cf-9f04-4a2f-8fce-0ebe2a205bda None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:48.474137 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3765cf-9f04-4a2f-8fce-0ebe2a205bda None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:48.474443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3765cf-9f04-4a2f-8fce-0ebe2a205bda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:48.475877 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3765cf-9f04-4a2f-8fce-0ebe2a205bda None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:48.488781 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 42/83] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:16:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:48.490176 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3765cf-9f04-4a2f-8fce-0ebe2a205bda None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:48.504411 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:48.543537 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015cfaa-5bbf-463c-b619-66a71eed7cca None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:48.598206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29411066-870b-44bf-bee1-c85de60ca214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:48.599599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29411066-870b-44bf-bee1-c85de60ca214 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:48.599599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29411066-870b-44bf-bee1-c85de60ca214 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:48.599599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29411066-870b-44bf-bee1-c85de60ca214 None admin] PATH_INFO: `/v3/users/1646a508a727421c8e569118d78f0ee3` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:48.601986 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29411066-870b-44bf-bee1-c85de60ca214 None admin] RBAC: Authorizing `identity:get_user(user_id=1646a508a727421c8e569118d78f0ee3)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:48.603515 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29411066-870b-44bf-bee1-c85de60ca214 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:48.605292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 42/84] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:16:48 2022] GET /identity/v3/users/1646a508a727421c8e569118d78f0ee3 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:48.605917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29411066-870b-44bf-bee1-c85de60ca214 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:48.626412 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3765cf-9f04-4a2f-8fce-0ebe2a205bda None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:48.645304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:48.680552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257ef70-188b-49e7-b9f8-024aa1710e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:48.681257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257ef70-188b-49e7-b9f8-024aa1710e2d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:48.681641 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257ef70-188b-49e7-b9f8-024aa1710e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:48.681915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257ef70-188b-49e7-b9f8-024aa1710e2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:48.751907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29411066-870b-44bf-bee1-c85de60ca214 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:48.775808 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257ef70-188b-49e7-b9f8-024aa1710e2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:48.778148 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257ef70-188b-49e7-b9f8-024aa1710e2d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:48.793481 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:48.854314 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e3b22-f243-4509-b1d4-ee2f88c6daf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:48.855044 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e3b22-f243-4509-b1d4-ee2f88c6daf7 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:48.855183 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e3b22-f243-4509-b1d4-ee2f88c6daf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:48.855520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e3b22-f243-4509-b1d4-ee2f88c6daf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:48.931233 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 43/85] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:16:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:48.937383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257ef70-188b-49e7-b9f8-024aa1710e2d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:49.026177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e3b22-f243-4509-b1d4-ee2f88c6daf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:49.031673 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e3b22-f243-4509-b1d4-ee2f88c6daf7 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:49.060129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257ef70-188b-49e7-b9f8-024aa1710e2d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:49.078845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:49.107704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:49.108683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8373171-d24b-4f09-9156-fa326ca218a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:49.109157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8373171-d24b-4f09-9156-fa326ca218a1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:49.109459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8373171-d24b-4f09-9156-fa326ca218a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:49.109729 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8373171-d24b-4f09-9156-fa326ca218a1 None admin] PATH_INFO: `/v3/users/1646a508a727421c8e569118d78f0ee3` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:49.112042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8373171-d24b-4f09-9156-fa326ca218a1 None admin] RBAC: Authorizing `identity:get_user(user_id=1646a508a727421c8e569118d78f0ee3)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:49.114627 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8373171-d24b-4f09-9156-fa326ca218a1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:49.117689 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 44/86] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:16:48 2022] GET /identity/v3/users/1646a508a727421c8e569118d78f0ee3 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:49.118894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8373171-d24b-4f09-9156-fa326ca218a1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:49.257575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 43/87] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:16:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:49.259134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e3b22-f243-4509-b1d4-ee2f88c6daf7 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:49.289729 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8373171-d24b-4f09-9156-fa326ca218a1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:49.328238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62575457-58b5-4468-9648-650444cc6ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:49.329305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62575457-58b5-4468-9648-650444cc6ffe None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:49.329856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62575457-58b5-4468-9648-650444cc6ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:49.330366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62575457-58b5-4468-9648-650444cc6ffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:49.393223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:49.395287 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e3b22-f243-4509-b1d4-ee2f88c6daf7 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:49.419391 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62575457-58b5-4468-9648-650444cc6ffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:49.421410 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62575457-58b5-4468-9648-650444cc6ffe None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:49.430492 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:49.449334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e10878-5654-422d-a938-62de1a708229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:49.450544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e10878-5654-422d-a938-62de1a708229 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:49.451155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e10878-5654-422d-a938-62de1a708229 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:49.451734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e10878-5654-422d-a938-62de1a708229 None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:49.453660 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e10878-5654-422d-a938-62de1a708229 None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:49.455848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e10878-5654-422d-a938-62de1a708229 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:49.458221 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 44/88] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:16:49 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:49.459449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e10878-5654-422d-a938-62de1a708229 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:49.561627 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 45/89] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:16:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:49.562793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62575457-58b5-4468-9648-650444cc6ffe None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:49.576345 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e10878-5654-422d-a938-62de1a708229 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:49.615111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999b43d-472d-4143-a6a7-8655e00c1348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:49.615762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999b43d-472d-4143-a6a7-8655e00c1348 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:49.616145 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999b43d-472d-4143-a6a7-8655e00c1348 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:49.616432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999b43d-472d-4143-a6a7-8655e00c1348 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:49.673480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:49.710685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:49.716894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62575457-58b5-4468-9648-650444cc6ffe None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:49.723221 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999b43d-472d-4143-a6a7-8655e00c1348 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:49.724861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999b43d-472d-4143-a6a7-8655e00c1348 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:49.767191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243e830-7e2e-4755-b371-68f735b2d353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:49.767846 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243e830-7e2e-4755-b371-68f735b2d353 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:49.768133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243e830-7e2e-4755-b371-68f735b2d353 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:49.768413 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243e830-7e2e-4755-b371-68f735b2d353 None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:49.770142 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243e830-7e2e-4755-b371-68f735b2d353 None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:49.772288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243e830-7e2e-4755-b371-68f735b2d353 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:49.774507 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 46/90] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:16:49 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:49.776020 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243e830-7e2e-4755-b371-68f735b2d353 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:49.861807 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 45/91] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:16:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:16:49.863029 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999b43d-472d-4143-a6a7-8655e00c1348 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:49.892223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243e830-7e2e-4755-b371-68f735b2d353 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:49.927552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeff083-07cc-4486-a083-8863b7499164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:49.928096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeff083-07cc-4486-a083-8863b7499164 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:49.928375 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeff083-07cc-4486-a083-8863b7499164 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:49.928645 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeff083-07cc-4486-a083-8863b7499164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:49.929396 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeff083-07cc-4486-a083-8863b7499164 None admin] RBAC: Adding query filter params (role.id=2ae4df0c2db34d5092a5a05f3e512fdc, scope.project.id=ae8e0eac9762422d8ac3147d4f823f90, user.id=1646a508a727421c8e569118d78f0ee3) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:49.929711 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeff083-07cc-4486-a083-8863b7499164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:49.931636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeff083-07cc-4486-a083-8863b7499164 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:49.942069 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 47/92] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:16:49 2022] GET /identity/v3/role_assignments?user.id=1646a508a727421c8e569118d78f0ee3&scope.project.id=ae8e0eac9762422d8ac3147d4f823f90&role.id=2ae4df0c2db34d5092a5a05f3e512fdc => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:49.943124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeff083-07cc-4486-a083-8863b7499164 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:49.962205 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:50.027980 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:50.054898 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999b43d-472d-4143-a6a7-8655e00c1348 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:50.071661 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeff083-07cc-4486-a083-8863b7499164 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:50.120247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9cb6f-361c-4a7e-8e4c-9af962ba0254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:50.121023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9cb6f-361c-4a7e-8e4c-9af962ba0254 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:50.121316 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9cb6f-361c-4a7e-8e4c-9af962ba0254 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:50.121632 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9cb6f-361c-4a7e-8e4c-9af962ba0254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:50.122388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9cb6f-361c-4a7e-8e4c-9af962ba0254 None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=ae8e0eac9762422d8ac3147d4f823f90, user.id=b4834a3500ae4e84a6e9864109a0e726) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:50.122750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9cb6f-361c-4a7e-8e4c-9af962ba0254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:50.124299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9cb6f-361c-4a7e-8e4c-9af962ba0254 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:50.131926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 48/93] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:16:49 2022] GET /identity/v3/role_assignments?user.id=b4834a3500ae4e84a6e9864109a0e726&scope.project.id=ae8e0eac9762422d8ac3147d4f823f90&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:50.138443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9cb6f-361c-4a7e-8e4c-9af962ba0254 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:50.142904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c51be7-fe09-48ea-828c-dcc067b338e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:50.143683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c51be7-fe09-48ea-828c-dcc067b338e1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:50.143963 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c51be7-fe09-48ea-828c-dcc067b338e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:50.144241 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c51be7-fe09-48ea-828c-dcc067b338e1 None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:50.150445 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c51be7-fe09-48ea-828c-dcc067b338e1 None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:50.152756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c51be7-fe09-48ea-828c-dcc067b338e1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:50.155407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 46/94] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:16:49 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:50.161875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c51be7-fe09-48ea-828c-dcc067b338e1 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:50.290159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:50.352339 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9cb6f-361c-4a7e-8e4c-9af962ba0254 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:50.397529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c51be7-fe09-48ea-828c-dcc067b338e1 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:50.419255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e185d4-49a1-4e31-bf92-cb61655354bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:50.420126 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e185d4-49a1-4e31-bf92-cb61655354bc None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:50.420429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e185d4-49a1-4e31-bf92-cb61655354bc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:50.420843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e185d4-49a1-4e31-bf92-cb61655354bc None admin] PATH_INFO: `/v3/projects/7770c2c2d95a424881d6c6de8b848b5c` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:50.424729 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e185d4-49a1-4e31-bf92-cb61655354bc None admin] RBAC: Authorizing `identity:get_project(project_id=7770c2c2d95a424881d6c6de8b848b5c)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:50.427290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e185d4-49a1-4e31-bf92-cb61655354bc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:50.429402 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 49/95] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:16:50 2022] GET /identity/v3/projects/7770c2c2d95a424881d6c6de8b848b5c => generated 312 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:50.437042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e185d4-49a1-4e31-bf92-cb61655354bc None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:50.464990 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8427de-e68d-46f8-b1f5-b55ba50dce99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:50.465873 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8427de-e68d-46f8-b1f5-b55ba50dce99 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:50.466226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8427de-e68d-46f8-b1f5-b55ba50dce99 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:50.466591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8427de-e68d-46f8-b1f5-b55ba50dce99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:50.467713 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8427de-e68d-46f8-b1f5-b55ba50dce99 None admin] RBAC: Adding query filter params (role.id=73f8d83949b241d2bcd58d267657768a, scope.project.id=ae8e0eac9762422d8ac3147d4f823f90, user.id=1646a508a727421c8e569118d78f0ee3) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:50.468144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8427de-e68d-46f8-b1f5-b55ba50dce99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:50.470833 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8427de-e68d-46f8-b1f5-b55ba50dce99 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:50.479485 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 47/96] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:16:50 2022] GET /identity/v3/role_assignments?user.id=1646a508a727421c8e569118d78f0ee3&scope.project.id=ae8e0eac9762422d8ac3147d4f823f90&role.id=73f8d83949b241d2bcd58d267657768a => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:16:50.555843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1acc5-156f-4833-9558-2c94b55b5cb4 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:50.556131 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1acc5-156f-4833-9558-2c94b55b5cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:50.556528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1acc5-156f-4833-9558-2c94b55b5cb4 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:50.558677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 48/97] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:16:50.565349 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cab28-5dc4-42d1-bda2-66f102fe5ae0 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:50.565786 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cab28-5dc4-42d1-bda2-66f102fe5ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:50.566179 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cab28-5dc4-42d1-bda2-66f102fe5ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:50.579172 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e185d4-49a1-4e31-bf92-cb61655354bc None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:50.590303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-913cab28-5dc4-42d1-bda2-66f102fe5ae0 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:50.591503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-913cab28-5dc4-42d1-bda2-66f102fe5ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:50.622000 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:50.651766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25a564-388d-45c3-8364-71008213917c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:50.652607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25a564-388d-45c3-8364-71008213917c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:50.652984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25a564-388d-45c3-8364-71008213917c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:50.653322 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25a564-388d-45c3-8364-71008213917c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:50.654318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25a564-388d-45c3-8364-71008213917c None admin] RBAC: Adding query filter params (role.id=73f8d83949b241d2bcd58d267657768a, scope.project.id=7770c2c2d95a424881d6c6de8b848b5c, user.id=1646a508a727421c8e569118d78f0ee3) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:50.654700 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25a564-388d-45c3-8364-71008213917c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:50.656605 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25a564-388d-45c3-8364-71008213917c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:50.665810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 50/98] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:16:50 2022] GET /identity/v3/role_assignments?user.id=1646a508a727421c8e569118d78f0ee3&scope.project.id=7770c2c2d95a424881d6c6de8b848b5c&role.id=73f8d83949b241d2bcd58d267657768a => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:50.748132 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 49/99] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:50.912424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a953cfa-4f21-46e9-acd3-aecedce2cea6 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:50.912906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a953cfa-4f21-46e9-acd3-aecedce2cea6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:50.913213 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a953cfa-4f21-46e9-acd3-aecedce2cea6 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:50.915457 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 51/100] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:50.921139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0150428-8787-4797-bd3e-41efc1950242 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:50.921625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0150428-8787-4797-bd3e-41efc1950242 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:50.921819 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0150428-8787-4797-bd3e-41efc1950242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:50.949808 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d0150428-8787-4797-bd3e-41efc1950242 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:50.951018 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d0150428-8787-4797-bd3e-41efc1950242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:51.056780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 50/101] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:51.110620 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a953cfa-4f21-46e9-acd3-aecedce2cea6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:51.124778 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:51.240188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a953cfa-4f21-46e9-acd3-aecedce2cea6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:51.287558 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d831-99b3-4ba8-b3b8-7e9ce91e9d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:51.288730 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d831-99b3-4ba8-b3b8-7e9ce91e9d1d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:51.289293 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d831-99b3-4ba8-b3b8-7e9ce91e9d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:51.289917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d831-99b3-4ba8-b3b8-7e9ce91e9d1d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:51.306614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045d831-99b3-4ba8-b3b8-7e9ce91e9d1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:16:51.313000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-2045d831-99b3-4ba8-b3b8-7e9ce91e9d1d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:16:51.313000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:16:51.313000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:16:51.313000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:16:51.313000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:16:51.313000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:16:51.313000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:16:51.313000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:16:51.313000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:16:51.313000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:16:51.313000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:16:51.313000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:16:51.313000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:16:51.313000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:16:51.313000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:16:51.313000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:16:51.314064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:16:51.314064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:16:51.314064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:16:51.314064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:16:51.314064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:16:51.314064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:16:51.314064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:16:51.314064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:16:51.314064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:16:51.314064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:16:51.314064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:16:51.314064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:16:51.314064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:16:51.314064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:16:51.314064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:16:51.314064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:16:51.315337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:16:51.315337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:16:51.315337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:16:51.315337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:16:51.315337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:16:51.315337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:16:51.315337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:16:51.315337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:16:51.315337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:16:51.315337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:16:51.315337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:16:51.315337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:16:51.319293 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 52/102] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:16:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:16:51.325333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0150428-8787-4797-bd3e-41efc1950242 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:51.445789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:51.465554 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0150428-8787-4797-bd3e-41efc1950242 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:51.519581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcc744-39d4-4222-83bd-676e8cbe79c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:51.520555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc744-39d4-4222-83bd-676e8cbe79c0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:51.521019 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc744-39d4-4222-83bd-676e8cbe79c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:51.521519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc744-39d4-4222-83bd-676e8cbe79c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:51.522440 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcc744-39d4-4222-83bd-676e8cbe79c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:51.523021 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcc744-39d4-4222-83bd-676e8cbe79c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:51.524897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcc744-39d4-4222-83bd-676e8cbe79c0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:51.536641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 51/103] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:16:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:51.542543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d831-99b3-4ba8-b3b8-7e9ce91e9d1d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:51.633763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:51.682739 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d831-99b3-4ba8-b3b8-7e9ce91e9d1d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:51.716466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcc744-39d4-4222-83bd-676e8cbe79c0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:51.735402 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a393fe-19d3-474d-af37-3cdc66e70608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:51.736384 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a393fe-19d3-474d-af37-3cdc66e70608 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:51.736807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a393fe-19d3-474d-af37-3cdc66e70608 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:51.737207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a393fe-19d3-474d-af37-3cdc66e70608 None admin] PATH_INFO: `/v3/users/7bc4de0b9b494ccfa342c7d3b9b053d0` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:51.766204 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a393fe-19d3-474d-af37-3cdc66e70608 None admin] RBAC: Authorizing `identity:get_user(user_id=7bc4de0b9b494ccfa342c7d3b9b053d0)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:51.768172 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a393fe-19d3-474d-af37-3cdc66e70608 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:51.770533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 53/104] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:16:51 2022] GET /identity/v3/users/7bc4de0b9b494ccfa342c7d3b9b053d0 => generated 289 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:51.776400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a393fe-19d3-474d-af37-3cdc66e70608 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:51.930146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a393fe-19d3-474d-af37-3cdc66e70608 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:51.959931 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:51.973923 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00aaf3-901d-473c-9b90-2561eb2df069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:51.974546 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00aaf3-901d-473c-9b90-2561eb2df069 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:51.974973 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00aaf3-901d-473c-9b90-2561eb2df069 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:51.975414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00aaf3-901d-473c-9b90-2561eb2df069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:52.018073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcc744-39d4-4222-83bd-676e8cbe79c0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:52.081423 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00aaf3-901d-473c-9b90-2561eb2df069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:52.083250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00aaf3-901d-473c-9b90-2561eb2df069 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:52.110697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e891b-3011-42b5-b1f2-e9ce406a8c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:52.111359 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e891b-3011-42b5-b1f2-e9ce406a8c3a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:52.111638 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e891b-3011-42b5-b1f2-e9ce406a8c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:52.111967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e891b-3011-42b5-b1f2-e9ce406a8c3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:52.114112 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e891b-3011-42b5-b1f2-e9ce406a8c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:52.115991 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e891b-3011-42b5-b1f2-e9ce406a8c3a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:52.117858 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 52/105] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:16:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:16:52.124033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e891b-3011-42b5-b1f2-e9ce406a8c3a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:52.161613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:52.207700 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 54/106] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:16:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 20:16:52.213227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00aaf3-901d-473c-9b90-2561eb2df069 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:52.247225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:52.326281 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00aaf3-901d-473c-9b90-2561eb2df069 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:52.328701 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e891b-3011-42b5-b1f2-e9ce406a8c3a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:52.393477 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f93bc-58c5-4aff-8c78-2e154a637aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:52.394417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f93bc-58c5-4aff-8c78-2e154a637aaa None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:52.394752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f93bc-58c5-4aff-8c78-2e154a637aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:52.395025 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f93bc-58c5-4aff-8c78-2e154a637aaa None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:52.396068 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f93bc-58c5-4aff-8c78-2e154a637aaa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:52.397562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f93bc-58c5-4aff-8c78-2e154a637aaa None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:52.427939 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81e8d1-319d-45a3-89b1-3c3de839337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:52.429217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81e8d1-319d-45a3-89b1-3c3de839337e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:52.429532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81e8d1-319d-45a3-89b1-3c3de839337e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:52.429862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81e8d1-319d-45a3-89b1-3c3de839337e None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:52.431304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81e8d1-319d-45a3-89b1-3c3de839337e None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:52.432912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81e8d1-319d-45a3-89b1-3c3de839337e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:52.434979 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 55/107] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:16:52 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:52.441856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81e8d1-319d-45a3-89b1-3c3de839337e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:52.448957 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 53/108] 10.222.0.52 () {60 vars in 1141 bytes} [Mon Aug 29 20:16:52 2022] POST /identity/v3/projects => generated 302 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:16:52.601596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:52.617925 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81e8d1-319d-45a3-89b1-3c3de839337e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:52.658556 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a900bb3-a191-4007-a708-2bb8481687de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:52.659179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a900bb3-a191-4007-a708-2bb8481687de None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:52.659462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a900bb3-a191-4007-a708-2bb8481687de None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:52.659740 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a900bb3-a191-4007-a708-2bb8481687de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:52.660476 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a900bb3-a191-4007-a708-2bb8481687de None admin] RBAC: Adding query filter params (role.id=50f15caac85247d9a4b34ea4e25850a1, scope.project.id=ae8e0eac9762422d8ac3147d4f823f90, user.id=7bc4de0b9b494ccfa342c7d3b9b053d0) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:52.660784 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a900bb3-a191-4007-a708-2bb8481687de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:52.662274 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a900bb3-a191-4007-a708-2bb8481687de None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:52.669084 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 56/109] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:16:52 2022] GET /identity/v3/role_assignments?user.id=7bc4de0b9b494ccfa342c7d3b9b053d0&scope.project.id=ae8e0eac9762422d8ac3147d4f823f90&role.id=50f15caac85247d9a4b34ea4e25850a1 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:16:52.912273 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3f1a-ff21-46fb-916d-663c8723e5e0 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:52.912506 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3f1a-ff21-46fb-916d-663c8723e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:52.912737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3f1a-ff21-46fb-916d-663c8723e5e0 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:52.914395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 54/110] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:52.920153 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37429d19-c5be-4562-826f-9ab387a91e61 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:52.920497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37429d19-c5be-4562-826f-9ab387a91e61 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:52.920702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37429d19-c5be-4562-826f-9ab387a91e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:52.944410 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-37429d19-c5be-4562-826f-9ab387a91e61 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:52.945672 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-37429d19-c5be-4562-826f-9ab387a91e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:53.039698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 57/111] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:16:53.290328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fe869-6a31-49b8-b300-d43a3d828ae5 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:53.290838 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fe869-6a31-49b8-b300-d43a3d828ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:53.290910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fe869-6a31-49b8-b300-d43a3d828ae5 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:53.292244 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 55/112] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:53.297797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a77f8b-537f-43cc-a690-ff250e8cbc19 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:53.298657 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a77f8b-537f-43cc-a690-ff250e8cbc19 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:53.299154 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a77f8b-537f-43cc-a690-ff250e8cbc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:53.323803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e0a77f8b-537f-43cc-a690-ff250e8cbc19 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:53.326561 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e0a77f8b-537f-43cc-a690-ff250e8cbc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:53.404770 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 58/113] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:53.599432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fe869-6a31-49b8-b300-d43a3d828ae5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:53.690189 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:53.759760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fe869-6a31-49b8-b300-d43a3d828ae5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:53.803710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a77f8b-537f-43cc-a690-ff250e8cbc19 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:53.869396 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:53.879885 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7793df3-c115-42f3-bc53-35ed43a9e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:53.881346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7793df3-c115-42f3-bc53-35ed43a9e1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:53.881649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7793df3-c115-42f3-bc53-35ed43a9e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:53.881922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7793df3-c115-42f3-bc53-35ed43a9e1c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:53.902691 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7793df3-c115-42f3-bc53-35ed43a9e1c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:16:53.907935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-c7793df3-c115-42f3-bc53-35ed43a9e1c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:16:53.907935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:16:53.907935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:16:53.907935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:16:53.907935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:16:53.907935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:16:53.907935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:16:53.907935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:16:53.907935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:16:53.907935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:16:53.907935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:16:53.907935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:16:53.907935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:16:53.907935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:16:53.907935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:16:53.907935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:16:53.909417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:16:53.909417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:16:53.909417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:16:53.909417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:16:53.909417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:16:53.909417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:16:53.909417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:16:53.909417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:16:53.909417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:16:53.909417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:16:53.909417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:16:53.909417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:16:53.909417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:16:53.909417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:16:53.909417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:16:53.909417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:16:53.910959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:16:53.910959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:16:53.910959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:16:53.910959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:16:53.910959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:16:53.910959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:16:53.910959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:16:53.910959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:16:53.910959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:16:53.910959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:16:53.910959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:16:53.910959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:16:53.910959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 56/114] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:16:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:16:53.923983 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7793df3-c115-42f3-bc53-35ed43a9e1c2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:54.101281 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a77f8b-537f-43cc-a690-ff250e8cbc19 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:54.169449 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333be02c-bc35-4822-a8ec-48648fc90681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:54.170382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333be02c-bc35-4822-a8ec-48648fc90681 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:54.170815 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333be02c-bc35-4822-a8ec-48648fc90681 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:54.171236 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333be02c-bc35-4822-a8ec-48648fc90681 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:54.197925 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333be02c-bc35-4822-a8ec-48648fc90681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:16:54.206614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-333be02c-bc35-4822-a8ec-48648fc90681 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:16:54.206614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:16:54.206614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:16:54.206614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:16:54.206614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:16:54.206614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:16:54.206614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:16:54.206614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:16:54.206614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:16:54.206614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:16:54.206614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:16:54.206614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:16:54.206614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:16:54.206614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:16:54.206614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:16:54.206614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:16:54.208288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:16:54.208288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:16:54.208288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:16:54.208288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:16:54.208288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:16:54.208288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:16:54.208288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:16:54.208288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:16:54.208288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:16:54.208288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:16:54.208288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:16:54.208288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:16:54.208288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:16:54.208288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:16:54.208288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:16:54.208288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:16:54.210012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:16:54.210012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:16:54.210012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:16:54.210012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:16:54.210012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:16:54.210012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:16:54.210012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:16:54.210012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:16:54.210012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:16:54.210012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:16:54.210012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:16:54.210012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:16:54.210012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 59/115] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:16:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:16:54.210755 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8e41-9e7e-458d-be0f-1e43756ca0c7 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:54.211553 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8e41-9e7e-458d-be0f-1e43756ca0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:54.211553 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8e41-9e7e-458d-be0f-1e43756ca0c7 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:54.212062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7793df3-c115-42f3-bc53-35ed43a9e1c2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:54.222063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 60/116] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:54 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:54.224507 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff8e41-9e7e-458d-be0f-1e43756ca0c7 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:54.259809 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:54.276177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112be75a-6b3f-47a4-843e-0765dd924252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:54.277725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112be75a-6b3f-47a4-843e-0765dd924252 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:54.278464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112be75a-6b3f-47a4-843e-0765dd924252 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:54.279187 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112be75a-6b3f-47a4-843e-0765dd924252 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:54.280709 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112be75a-6b3f-47a4-843e-0765dd924252 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:54.281563 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112be75a-6b3f-47a4-843e-0765dd924252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:54.284527 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112be75a-6b3f-47a4-843e-0765dd924252 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:54.303022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 57/117] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:16:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:54.305275 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d4cfa-8f68-4516-bbc0-852c8ed9c563 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:54.305794 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d4cfa-8f68-4516-bbc0-852c8ed9c563 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:54.306262 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d4cfa-8f68-4516-bbc0-852c8ed9c563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:54.340653 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7c8d4cfa-8f68-4516-bbc0-852c8ed9c563 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:54.343525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7c8d4cfa-8f68-4516-bbc0-852c8ed9c563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:54.386918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:54.436215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff8e41-9e7e-458d-be0f-1e43756ca0c7 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:54.459829 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 58/118] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:54.461092 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d4cfa-8f68-4516-bbc0-852c8ed9c563 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:54.521966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d30d9d-1f69-4f1a-b094-aea9fa4dbab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:54.522702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d30d9d-1f69-4f1a-b094-aea9fa4dbab1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:54.523031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d30d9d-1f69-4f1a-b094-aea9fa4dbab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:54.523404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d30d9d-1f69-4f1a-b094-aea9fa4dbab1 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:54.524911 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d30d9d-1f69-4f1a-b094-aea9fa4dbab1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:54.524911 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d30d9d-1f69-4f1a-b094-aea9fa4dbab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:54.530552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d30d9d-1f69-4f1a-b094-aea9fa4dbab1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:54.548269 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 61/119] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:16:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:54.550089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91de273-bfb9-413c-ade5-19cd7ff5b651 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:54.550382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91de273-bfb9-413c-ade5-19cd7ff5b651 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:54.550717 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91de273-bfb9-413c-ade5-19cd7ff5b651 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:54.561919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 62/120] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:54 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:54.562982 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91de273-bfb9-413c-ade5-19cd7ff5b651 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:54.704866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d4cfa-8f68-4516-bbc0-852c8ed9c563 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:54.760242 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:54.807513 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91de273-bfb9-413c-ade5-19cd7ff5b651 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:54.820385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50f8d6-980e-4a77-b10f-e981fefd59c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:54.821632 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50f8d6-980e-4a77-b10f-e981fefd59c9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:54.822137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50f8d6-980e-4a77-b10f-e981fefd59c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:54.822632 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50f8d6-980e-4a77-b10f-e981fefd59c9 None admin] PATH_INFO: `/v3/users/1646a508a727421c8e569118d78f0ee3` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:54.824976 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50f8d6-980e-4a77-b10f-e981fefd59c9 None admin] RBAC: Authorizing `identity:get_user(user_id=1646a508a727421c8e569118d78f0ee3)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:54.834483 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50f8d6-980e-4a77-b10f-e981fefd59c9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:54.838646 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 59/121] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:16:54 2022] GET /identity/v3/users/1646a508a727421c8e569118d78f0ee3 => generated 275 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:54.840978 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559bf2-0b60-4779-9688-0c811fd949d2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:54.845587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559bf2-0b60-4779-9688-0c811fd949d2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:54.851007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559bf2-0b60-4779-9688-0c811fd949d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:54.884123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9d5c0-09cb-4694-b36d-3fb2e3dbba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:54.885679 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9d5c0-09cb-4694-b36d-3fb2e3dbba29 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:54.886544 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9d5c0-09cb-4694-b36d-3fb2e3dbba29 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:54.887303 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9d5c0-09cb-4694-b36d-3fb2e3dbba29 None admin] PATH_INFO: `/v3/users/b4834a3500ae4e84a6e9864109a0e726` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:54.889719 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9d5c0-09cb-4694-b36d-3fb2e3dbba29 None admin] RBAC: Authorizing `identity:get_user(user_id=b4834a3500ae4e84a6e9864109a0e726)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:54.892808 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9d5c0-09cb-4694-b36d-3fb2e3dbba29 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:54.896122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 63/122] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:16:54 2022] GET /identity/v3/users/b4834a3500ae4e84a6e9864109a0e726 => generated 247 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:54.897904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9d5c0-09cb-4694-b36d-3fb2e3dbba29 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:54.902223 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-2e559bf2-0b60-4779-9688-0c811fd949d2 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:54.905606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2e559bf2-0b60-4779-9688-0c811fd949d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:54.917229 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:55.074085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 60/123] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:55.075303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e559bf2-0b60-4779-9688-0c811fd949d2 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:55.104253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9d5c0-09cb-4694-b36d-3fb2e3dbba29 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:55.172329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d283d-c9d3-4ddf-8d4c-2d1460dd114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:55.174094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d283d-c9d3-4ddf-8d4c-2d1460dd114c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:55.174857 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d283d-c9d3-4ddf-8d4c-2d1460dd114c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:55.175505 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d283d-c9d3-4ddf-8d4c-2d1460dd114c None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:55.177712 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d283d-c9d3-4ddf-8d4c-2d1460dd114c None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:55.181014 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d283d-c9d3-4ddf-8d4c-2d1460dd114c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:55.184427 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 64/124] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:16:54 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:55.190870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d283d-c9d3-4ddf-8d4c-2d1460dd114c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:55.275944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e559bf2-0b60-4779-9688-0c811fd949d2 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:55.296407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:55.356167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:55.363767 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df910bfd-5f6c-46cc-89d6-a84e686cb9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:55.364621 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df910bfd-5f6c-46cc-89d6-a84e686cb9ae None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:55.365025 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df910bfd-5f6c-46cc-89d6-a84e686cb9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:55.365424 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df910bfd-5f6c-46cc-89d6-a84e686cb9ae None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:55.369607 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df910bfd-5f6c-46cc-89d6-a84e686cb9ae None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:55.371439 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df910bfd-5f6c-46cc-89d6-a84e686cb9ae None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:55.373767 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 61/125] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:16:55 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:55.374892 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df910bfd-5f6c-46cc-89d6-a84e686cb9ae None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:55.417418 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d283d-c9d3-4ddf-8d4c-2d1460dd114c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:55.480534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b8565-fc09-4567-a42f-0319a59a16d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:55.481970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b8565-fc09-4567-a42f-0319a59a16d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:55.482721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b8565-fc09-4567-a42f-0319a59a16d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:55.483475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b8565-fc09-4567-a42f-0319a59a16d1 None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90/users/1646a508a727421c8e569118d78f0ee3/roles/2ae4df0c2db34d5092a5a05f3e512fdc` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:55.487713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b8565-fc09-4567-a42f-0319a59a16d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae8e0eac9762422d8ac3147d4f823f90, user_id=1646a508a727421c8e569118d78f0ee3, role_id=2ae4df0c2db34d5092a5a05f3e512fdc)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:55.490866 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b8565-fc09-4567-a42f-0319a59a16d1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:55.524789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 65/126] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:16:55 2022] PUT /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90/users/1646a508a727421c8e569118d78f0ee3/roles/2ae4df0c2db34d5092a5a05f3e512fdc => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:55.529728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b8565-fc09-4567-a42f-0319a59a16d1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:55.600027 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df910bfd-5f6c-46cc-89d6-a84e686cb9ae None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:55.672540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48e813-0dcb-4715-9625-8aae591c047b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:55.674777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48e813-0dcb-4715-9625-8aae591c047b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:55.675695 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48e813-0dcb-4715-9625-8aae591c047b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:55.676473 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48e813-0dcb-4715-9625-8aae591c047b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:55.698358 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48e813-0dcb-4715-9625-8aae591c047b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:16:55.708900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-ba48e813-0dcb-4715-9625-8aae591c047b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:16:55.708900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:16:55.708900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:16:55.708900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:16:55.708900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:16:55.708900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:16:55.708900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:16:55.708900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:16:55.708900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:16:55.708900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:16:55.708900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:16:55.708900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:16:55.708900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:16:55.708900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:16:55.708900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:16:55.708900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:16:55.710514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:16:55.710514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:16:55.710514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:16:55.710514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:16:55.710514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:16:55.710514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:16:55.710514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:16:55.710514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:16:55.710514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:16:55.710514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:16:55.710514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:16:55.710514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:16:55.710514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:16:55.710514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:16:55.710514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:16:55.710514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:16:55.711922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:16:55.711922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:16:55.711922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:16:55.711922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:16:55.711922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:16:55.711922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:16:55.711922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:16:55.711922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:16:55.711922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:16:55.711922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:16:55.711922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:16:55.711922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:16:55.716195 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 62/127] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:16:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:16:55.722607 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48e813-0dcb-4715-9625-8aae591c047b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:55.822122 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:55.838000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b8565-fc09-4567-a42f-0319a59a16d1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:55.941869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48e813-0dcb-4715-9625-8aae591c047b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:55.942233 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a98c1-cb19-45b9-b6d3-57d110190d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:55.942973 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a98c1-cb19-45b9-b6d3-57d110190d18 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:55.943291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a98c1-cb19-45b9-b6d3-57d110190d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:55.943576 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a98c1-cb19-45b9-b6d3-57d110190d18 None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90/users/b4834a3500ae4e84a6e9864109a0e726/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:55.946663 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a98c1-cb19-45b9-b6d3-57d110190d18 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae8e0eac9762422d8ac3147d4f823f90, user_id=b4834a3500ae4e84a6e9864109a0e726, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:55.949071 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a98c1-cb19-45b9-b6d3-57d110190d18 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:55.959555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:55.991694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 66/128] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:16:55 2022] PUT /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90/users/b4834a3500ae4e84a6e9864109a0e726/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:55.992753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a98c1-cb19-45b9-b6d3-57d110190d18 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:56.007811 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cba919-3c0a-4908-a8a0-dd52187912a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:56.008893 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cba919-3c0a-4908-a8a0-dd52187912a1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:56.009424 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cba919-3c0a-4908-a8a0-dd52187912a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:56.009865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cba919-3c0a-4908-a8a0-dd52187912a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:56.030294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cba919-3c0a-4908-a8a0-dd52187912a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:16:56.039232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-82cba919-3c0a-4908-a8a0-dd52187912a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:16:56.039232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:16:56.039232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:16:56.039232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:16:56.039232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:16:56.039232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:16:56.039232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:16:56.039232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:16:56.039232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:16:56.039232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:16:56.039232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:16:56.039232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:16:56.039232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:16:56.039232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:16:56.039232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:16:56.039232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:16:56.040214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:16:56.040214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:16:56.040214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:16:56.040214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:16:56.040214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:16:56.040214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:16:56.040214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:16:56.040214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:16:56.040214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:16:56.040214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:16:56.040214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:16:56.040214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:16:56.040214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:16:56.040214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:16:56.040214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:16:56.040214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:16:56.041035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:16:56.041035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:16:56.041035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:16:56.041035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:16:56.041035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:16:56.041035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:16:56.041035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:16:56.041035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:16:56.041035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:16:56.041035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:16:56.041035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:16:56.041035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:16:56.041035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 63/129] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:16:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:16:56.045124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa370c0-cf71-4700-be71-5fb8fe57153d None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:56.045124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa370c0-cf71-4700-be71-5fb8fe57153d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:56.045124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa370c0-cf71-4700-be71-5fb8fe57153d None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:56.047169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 64/130] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:56.058232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fab9f-c6ee-4608-b796-b7bbb2968b02 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:56.058683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fab9f-c6ee-4608-b796-b7bbb2968b02 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:56.059107 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fab9f-c6ee-4608-b796-b7bbb2968b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:56.100276 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-752fab9f-c6ee-4608-b796-b7bbb2968b02 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:56.102123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-752fab9f-c6ee-4608-b796-b7bbb2968b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:56.217897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a98c1-cb19-45b9-b6d3-57d110190d18 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:56.242623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 65/131] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:16:56.243611 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fab9f-c6ee-4608-b796-b7bbb2968b02 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:56.265118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee183521-f249-42fc-b72c-45f92172cbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:56.265943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee183521-f249-42fc-b72c-45f92172cbae None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:56.266435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee183521-f249-42fc-b72c-45f92172cbae None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:56.266843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee183521-f249-42fc-b72c-45f92172cbae None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:56.267599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee183521-f249-42fc-b72c-45f92172cbae None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:56.267918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee183521-f249-42fc-b72c-45f92172cbae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:56.269632 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee183521-f249-42fc-b72c-45f92172cbae None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:56.280118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 67/132] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:16:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:56.281257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ca7d9-1ffa-462b-854e-fa4352d70c02 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:56.285809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ca7d9-1ffa-462b-854e-fa4352d70c02 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:56.286119 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ca7d9-1ffa-462b-854e-fa4352d70c02 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:56.287388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:56.287871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 68/133] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:56.291186 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ca7d9-1ffa-462b-854e-fa4352d70c02 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:56.364266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fab9f-c6ee-4608-b796-b7bbb2968b02 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:56.410022 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:56.411834 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85e0c4-7e56-47db-bb18-5b757ea05447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:56.412649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85e0c4-7e56-47db-bb18-5b757ea05447 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:56.413013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85e0c4-7e56-47db-bb18-5b757ea05447 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:56.413290 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85e0c4-7e56-47db-bb18-5b757ea05447 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:56.415106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85e0c4-7e56-47db-bb18-5b757ea05447 None admin] RBAC: Adding query filter params (name=member) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:56.415451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85e0c4-7e56-47db-bb18-5b757ea05447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:56.418174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85e0c4-7e56-47db-bb18-5b757ea05447 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:56.442431 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 66/134] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:16:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:56.449267 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517db88-2a6f-4842-8e92-6e15cfc02a89 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:56.449687 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517db88-2a6f-4842-8e92-6e15cfc02a89 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:56.449831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517db88-2a6f-4842-8e92-6e15cfc02a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:56.485046 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-a517db88-2a6f-4842-8e92-6e15cfc02a89 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:56.486495 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a517db88-2a6f-4842-8e92-6e15cfc02a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:56.522777 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ca7d9-1ffa-462b-854e-fa4352d70c02 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:56.594705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5be3f-6f76-4635-82b3-7c0f31304c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:56.596634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5be3f-6f76-4635-82b3-7c0f31304c32 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:56.602065 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5be3f-6f76-4635-82b3-7c0f31304c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:56.602567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5be3f-6f76-4635-82b3-7c0f31304c32 None admin] PATH_INFO: `/v3/users/1646a508a727421c8e569118d78f0ee3` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:56.604788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5be3f-6f76-4635-82b3-7c0f31304c32 None admin] RBAC: Authorizing `identity:get_user(user_id=1646a508a727421c8e569118d78f0ee3)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:56.607628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5be3f-6f76-4635-82b3-7c0f31304c32 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:56.613408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 69/135] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:16:56 2022] GET /identity/v3/users/1646a508a727421c8e569118d78f0ee3 => generated 275 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:56.613408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5be3f-6f76-4635-82b3-7c0f31304c32 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:56.625682 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 67/136] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:56.628511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517db88-2a6f-4842-8e92-6e15cfc02a89 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:56.681150 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:56.785402 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5be3f-6f76-4635-82b3-7c0f31304c32 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:56.815859 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:56.827865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf9631-996b-4a53-a447-cc08dc83aeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:56.828570 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf9631-996b-4a53-a447-cc08dc83aeab None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:56.829088 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf9631-996b-4a53-a447-cc08dc83aeab None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:56.829452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf9631-996b-4a53-a447-cc08dc83aeab None admin] PATH_INFO: `/v3/users/1646a508a727421c8e569118d78f0ee3` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:56.832228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf9631-996b-4a53-a447-cc08dc83aeab None admin] RBAC: Authorizing `identity:get_user(user_id=1646a508a727421c8e569118d78f0ee3)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:56.833022 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf9631-996b-4a53-a447-cc08dc83aeab None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:56.840507 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 70/137] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:16:56 2022] GET /identity/v3/users/1646a508a727421c8e569118d78f0ee3 => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:56.841637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf9631-996b-4a53-a447-cc08dc83aeab None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:56.910479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517db88-2a6f-4842-8e92-6e15cfc02a89 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:56.981403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf9631-996b-4a53-a447-cc08dc83aeab None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:57.026014 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953f255-16e1-4c50-8983-0004d1606533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:57.026716 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953f255-16e1-4c50-8983-0004d1606533 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:57.027075 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953f255-16e1-4c50-8983-0004d1606533 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:57.027454 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953f255-16e1-4c50-8983-0004d1606533 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:57.028728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953f255-16e1-4c50-8983-0004d1606533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:57.030376 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953f255-16e1-4c50-8983-0004d1606533 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:57.033086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 71/138] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:16:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:57.034410 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953f255-16e1-4c50-8983-0004d1606533 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:57.035883 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3e22c-dee3-48bc-8e4c-9645b168d37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:57.037330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3e22c-dee3-48bc-8e4c-9645b168d37a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:57.038293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3e22c-dee3-48bc-8e4c-9645b168d37a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:57.038992 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3e22c-dee3-48bc-8e4c-9645b168d37a None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:57.046487 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3e22c-dee3-48bc-8e4c-9645b168d37a None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:57.049211 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3e22c-dee3-48bc-8e4c-9645b168d37a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:57.052179 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 68/139] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:16:56 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:57.059286 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3e22c-dee3-48bc-8e4c-9645b168d37a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:57.146877 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:57.225852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953f255-16e1-4c50-8983-0004d1606533 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:57.279370 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb5df3-702d-407f-9895-0851137c7ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:57.280320 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb5df3-702d-407f-9895-0851137c7ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:57.280601 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb5df3-702d-407f-9895-0851137c7ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:57.281340 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb5df3-702d-407f-9895-0851137c7ba5 None admin] PATH_INFO: `/v3/projects/7770c2c2d95a424881d6c6de8b848b5c` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:57.282987 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb5df3-702d-407f-9895-0851137c7ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=7770c2c2d95a424881d6c6de8b848b5c)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:57.284491 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb5df3-702d-407f-9895-0851137c7ba5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:57.286912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 72/140] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:16:57 2022] GET /identity/v3/projects/7770c2c2d95a424881d6c6de8b848b5c => generated 312 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:57.287783 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb5df3-702d-407f-9895-0851137c7ba5 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:57.299020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:57.308523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3e22c-dee3-48bc-8e4c-9645b168d37a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:57.358762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d0b1c-7051-43aa-9759-b5308c1cbf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:57.360271 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d0b1c-7051-43aa-9759-b5308c1cbf86 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:57.361057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d0b1c-7051-43aa-9759-b5308c1cbf86 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:57.361869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d0b1c-7051-43aa-9759-b5308c1cbf86 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:57.363337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d0b1c-7051-43aa-9759-b5308c1cbf86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:57.366404 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d0b1c-7051-43aa-9759-b5308c1cbf86 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:57.409414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 69/141] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:16:57 2022] POST /identity/v3/users => generated 283 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:57.414184 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d0b1c-7051-43aa-9759-b5308c1cbf86 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:57.431898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb5df3-702d-407f-9895-0851137c7ba5 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:57.539514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:57.570669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4de20-bc7b-4eea-bc97-23fc5455a5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:57.571406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4de20-bc7b-4eea-bc97-23fc5455a5a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:57.571691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4de20-bc7b-4eea-bc97-23fc5455a5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:57.571984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4de20-bc7b-4eea-bc97-23fc5455a5a0 None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90/users/1646a508a727421c8e569118d78f0ee3/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:57.574713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4de20-bc7b-4eea-bc97-23fc5455a5a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae8e0eac9762422d8ac3147d4f823f90, user_id=1646a508a727421c8e569118d78f0ee3, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:57.577470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4de20-bc7b-4eea-bc97-23fc5455a5a0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:57.625393 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 73/142] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:16:57 2022] PUT /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90/users/1646a508a727421c8e569118d78f0ee3/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:57.625393 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4de20-bc7b-4eea-bc97-23fc5455a5a0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:57.665610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d0b1c-7051-43aa-9759-b5308c1cbf86 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:57.754172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5955d2-e457-4197-a382-4bff3f93973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:57.754900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5955d2-e457-4197-a382-4bff3f93973a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:57.755217 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5955d2-e457-4197-a382-4bff3f93973a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:57.755540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5955d2-e457-4197-a382-4bff3f93973a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:57.777374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5955d2-e457-4197-a382-4bff3f93973a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:16:57.783716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-bf5955d2-e457-4197-a382-4bff3f93973a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:16:57.783716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:16:57.783716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:16:57.783716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:16:57.783716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:16:57.783716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:16:57.783716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:16:57.783716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:16:57.783716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:16:57.783716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:16:57.783716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:16:57.783716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:16:57.783716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:16:57.783716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:16:57.783716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:16:57.783716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:16:57.785422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:16:57.785422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:16:57.785422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:16:57.785422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:16:57.785422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:16:57.785422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:16:57.785422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:16:57.785422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:16:57.785422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:16:57.785422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:16:57.785422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:16:57.785422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:16:57.785422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:16:57.785422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:16:57.785422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:16:57.785422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:16:57.786938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:16:57.786938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:16:57.786938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:16:57.786938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:16:57.786938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:16:57.786938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:16:57.786938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:16:57.786938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:16:57.786938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:16:57.786938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:16:57.786938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:16:57.786938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:16:57.786938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 70/143] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:16:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:16:57.806833 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5955d2-e457-4197-a382-4bff3f93973a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:57.850014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:57.911429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4de20-bc7b-4eea-bc97-23fc5455a5a0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:57.979728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f6e22-3756-4de1-8f29-ac07eb4eca29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:57.981333 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f6e22-3756-4de1-8f29-ac07eb4eca29 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:57.982134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f6e22-3756-4de1-8f29-ac07eb4eca29 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:57.982885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f6e22-3756-4de1-8f29-ac07eb4eca29 None admin] PATH_INFO: `/v3/projects/7770c2c2d95a424881d6c6de8b848b5c/users/1646a508a727421c8e569118d78f0ee3/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:57.987241 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f6e22-3756-4de1-8f29-ac07eb4eca29 None admin] RBAC: Authorizing `identity:create_grant(project_id=7770c2c2d95a424881d6c6de8b848b5c, user_id=1646a508a727421c8e569118d78f0ee3, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:57.990694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f6e22-3756-4de1-8f29-ac07eb4eca29 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:58.014076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 74/144] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:16:57 2022] PUT /identity/v3/projects/7770c2c2d95a424881d6c6de8b848b5c/users/1646a508a727421c8e569118d78f0ee3/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:58.060331 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5955d2-e457-4197-a382-4bff3f93973a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:58.123296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9cffe-f560-42b0-9b7c-0a84b02abbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:58.124019 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9cffe-f560-42b0-9b7c-0a84b02abbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:58.124298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9cffe-f560-42b0-9b7c-0a84b02abbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:58.124593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9cffe-f560-42b0-9b7c-0a84b02abbb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:58.125468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9cffe-f560-42b0-9b7c-0a84b02abbb2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:58.125774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9cffe-f560-42b0-9b7c-0a84b02abbb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:58.127619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9cffe-f560-42b0-9b7c-0a84b02abbb2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:58.140749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 71/145] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:16:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:58.147341 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f6e22-3756-4de1-8f29-ac07eb4eca29 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:58.250314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:58.327117 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f6e22-3756-4de1-8f29-ac07eb4eca29 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:58.398846 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41021d5a-7945-4621-8149-bcca4912c42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:58.399567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41021d5a-7945-4621-8149-bcca4912c42b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:58.399843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41021d5a-7945-4621-8149-bcca4912c42b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:58.400110 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41021d5a-7945-4621-8149-bcca4912c42b None admin] PATH_INFO: `/v3/users/7bc4de0b9b494ccfa342c7d3b9b053d0` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:58.401602 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41021d5a-7945-4621-8149-bcca4912c42b None admin] RBAC: Authorizing `identity:get_user(user_id=7bc4de0b9b494ccfa342c7d3b9b053d0)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:58.403163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41021d5a-7945-4621-8149-bcca4912c42b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:58.405005 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 75/146] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:16:58 2022] GET /identity/v3/users/7bc4de0b9b494ccfa342c7d3b9b053d0 => generated 289 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:58.414953 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9cffe-f560-42b0-9b7c-0a84b02abbb2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:58.575390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:58.636696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9cffe-f560-42b0-9b7c-0a84b02abbb2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:58.664073 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad60ef-6d44-4a88-a8b3-80ad4ef2f272 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:58.664717 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad60ef-6d44-4a88-a8b3-80ad4ef2f272 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:58.665074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad60ef-6d44-4a88-a8b3-80ad4ef2f272 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:58.666554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 76/147] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:16:58.673210 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe5f59-5476-46ae-9720-66b3abd8fe9a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:58.673594 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe5f59-5476-46ae-9720-66b3abd8fe9a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:58.673819 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe5f59-5476-46ae-9720-66b3abd8fe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:58.717799 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a7fe5f59-5476-46ae-9720-66b3abd8fe9a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:58.719032 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a7fe5f59-5476-46ae-9720-66b3abd8fe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:58.727301 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0fb22-5e37-498f-83b4-6ecb441a4252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:58.727968 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0fb22-5e37-498f-83b4-6ecb441a4252 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:58.728245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0fb22-5e37-498f-83b4-6ecb441a4252 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:58.728514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0fb22-5e37-498f-83b4-6ecb441a4252 None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:58.729723 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0fb22-5e37-498f-83b4-6ecb441a4252 None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:58.731604 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0fb22-5e37-498f-83b4-6ecb441a4252 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:58.739859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 72/148] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:16:58 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:58.740913 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0fb22-5e37-498f-83b4-6ecb441a4252 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:58.868406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 77/149] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:16:58.961222 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0fb22-5e37-498f-83b4-6ecb441a4252 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:59.014416 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a74349-9f3c-4c11-86a6-43a0f52ec5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:59.015518 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a74349-9f3c-4c11-86a6-43a0f52ec5c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:59.015999 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a74349-9f3c-4c11-86a6-43a0f52ec5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:59.016455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a74349-9f3c-4c11-86a6-43a0f52ec5c6 None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90/users/7bc4de0b9b494ccfa342c7d3b9b053d0/roles/50f15caac85247d9a4b34ea4e25850a1` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:59.023728 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a74349-9f3c-4c11-86a6-43a0f52ec5c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae8e0eac9762422d8ac3147d4f823f90, user_id=7bc4de0b9b494ccfa342c7d3b9b053d0, role_id=50f15caac85247d9a4b34ea4e25850a1)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:59.026411 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a74349-9f3c-4c11-86a6-43a0f52ec5c6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:59.047664 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:59.053515 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 73/150] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:16:58 2022] PUT /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90/users/7bc4de0b9b494ccfa342c7d3b9b053d0/roles/50f15caac85247d9a4b34ea4e25850a1 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:59.432780 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46e5cd-1346-4abc-86af-f47a47a3c8e7 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:59.433333 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46e5cd-1346-4abc-86af-f47a47a3c8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:59.433333 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46e5cd-1346-4abc-86af-f47a47a3c8e7 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:59.435687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 78/151] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:59.442600 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be360-53f6-4629-b18e-95a89d72b843 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:59.443131 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be360-53f6-4629-b18e-95a89d72b843 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:59.443504 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be360-53f6-4629-b18e-95a89d72b843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:59.474546 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-221be360-53f6-4629-b18e-95a89d72b843 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:59.476102 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-221be360-53f6-4629-b18e-95a89d72b843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:59.560170 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46e5cd-1346-4abc-86af-f47a47a3c8e7 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:59.575477 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 74/152] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:16:59.650262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:59.766566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46e5cd-1346-4abc-86af-f47a47a3c8e7 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:59.833040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac2f84-2c25-4c77-9aa5-bb93e2550370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:59.833798 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac2f84-2c25-4c77-9aa5-bb93e2550370 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:59.834115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac2f84-2c25-4c77-9aa5-bb93e2550370 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:59.834383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac2f84-2c25-4c77-9aa5-bb93e2550370 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:59.850941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac2f84-2c25-4c77-9aa5-bb93e2550370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:16:59.855797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-6cac2f84-2c25-4c77-9aa5-bb93e2550370 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:16:59.855797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:16:59.855797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:16:59.855797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:16:59.855797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:16:59.855797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:16:59.855797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:16:59.855797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:16:59.855797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:16:59.855797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:16:59.855797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:16:59.855797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:16:59.855797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:16:59.855797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:16:59.855797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:16:59.855797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:16:59.856706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:16:59.856706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:16:59.856706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:16:59.856706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:16:59.856706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:16:59.856706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:16:59.856706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:16:59.856706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:16:59.856706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:16:59.856706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:16:59.856706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:16:59.856706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:16:59.856706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:16:59.856706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:16:59.856706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:16:59.856706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:16:59.857496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:16:59.857496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:16:59.857496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:16:59.857496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:16:59.857496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:16:59.857496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:16:59.857496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:16:59.857496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:16:59.857496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:16:59.857496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:16:59.857496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:16:59.857496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:16:59.857496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 79/153] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:16:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:16:59.864800 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221be360-53f6-4629-b18e-95a89d72b843 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:00.002758 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221be360-53f6-4629-b18e-95a89d72b843 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:00.042111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:00.047505 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2428ba-f18c-4ff2-8cd0-503b254b192a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:00.048863 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2428ba-f18c-4ff2-8cd0-503b254b192a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:00.049527 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2428ba-f18c-4ff2-8cd0-503b254b192a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:00.049800 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2428ba-f18c-4ff2-8cd0-503b254b192a None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:00.051051 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2428ba-f18c-4ff2-8cd0-503b254b192a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:00.051363 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2428ba-f18c-4ff2-8cd0-503b254b192a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:00.053223 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2428ba-f18c-4ff2-8cd0-503b254b192a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:00.064173 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 75/154] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:16:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:00.074519 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac2f84-2c25-4c77-9aa5-bb93e2550370 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:00.223266 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac2f84-2c25-4c77-9aa5-bb93e2550370 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:00.238845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2428ba-f18c-4ff2-8cd0-503b254b192a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:00.239268 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:00.278284 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710174a2-db79-4373-8156-7d8681d8ba9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:00.278862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710174a2-db79-4373-8156-7d8681d8ba9a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:00.279185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710174a2-db79-4373-8156-7d8681d8ba9a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:00.279452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710174a2-db79-4373-8156-7d8681d8ba9a None admin] PATH_INFO: `/v3/users/1646a508a727421c8e569118d78f0ee3` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:00.286393 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710174a2-db79-4373-8156-7d8681d8ba9a None admin] RBAC: Authorizing `identity:get_user(user_id=1646a508a727421c8e569118d78f0ee3)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:00.287968 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710174a2-db79-4373-8156-7d8681d8ba9a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:00.289832 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 80/155] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:00 2022] GET /identity/v3/users/1646a508a727421c8e569118d78f0ee3 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:00.296337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710174a2-db79-4373-8156-7d8681d8ba9a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:00.490141 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2428ba-f18c-4ff2-8cd0-503b254b192a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:00.497531 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710174a2-db79-4373-8156-7d8681d8ba9a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:00.551634 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9f976-e0b5-43df-898f-630d38fc09de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:00.552188 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9f976-e0b5-43df-898f-630d38fc09de None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:00.552463 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9f976-e0b5-43df-898f-630d38fc09de None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:00.552732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9f976-e0b5-43df-898f-630d38fc09de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:00.576359 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9f976-e0b5-43df-898f-630d38fc09de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:00.588826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-61c9f976-e0b5-43df-898f-630d38fc09de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:17:00.588826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:00.588826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:00.588826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:00.588826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:00.588826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:00.588826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:00.588826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:00.588826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:00.588826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:00.588826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:00.588826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:00.588826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:00.588826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:00.588826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:00.588826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:00.590790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:00.590790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:00.590790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:00.590790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:00.590790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:00.590790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:00.590790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:00.590790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:00.590790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:00.590790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:00.590790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:00.590790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:00.590790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:00.590790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:00.590790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:00.590790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:00.592467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:00.592467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:00.592467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:00.592467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:00.592467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:00.592467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:00.592467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:00.592467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:00.592467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:00.592467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:00.592467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:17:00.592467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:00.592467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 76/156] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:17:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:00.597403 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9f976-e0b5-43df-898f-630d38fc09de None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:00.606552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc83e53-408d-4fe7-9fe7-ea2c84d6ccf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:00.608021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc83e53-408d-4fe7-9fe7-ea2c84d6ccf7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:00.608774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc83e53-408d-4fe7-9fe7-ea2c84d6ccf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:00.609668 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc83e53-408d-4fe7-9fe7-ea2c84d6ccf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:00.691606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:00.740288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:00.762762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9f976-e0b5-43df-898f-630d38fc09de None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:00.822304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da99ae6-7a52-4921-b58c-df9cd616901f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:00.822825 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da99ae6-7a52-4921-b58c-df9cd616901f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:00.823104 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da99ae6-7a52-4921-b58c-df9cd616901f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:00.823367 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da99ae6-7a52-4921-b58c-df9cd616901f None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:00.824043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da99ae6-7a52-4921-b58c-df9cd616901f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:00.824341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da99ae6-7a52-4921-b58c-df9cd616901f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:00.825776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da99ae6-7a52-4921-b58c-df9cd616901f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:00.834994 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc83e53-408d-4fe7-9fe7-ea2c84d6ccf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:00.835207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 77/157] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:00.838313 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc83e53-408d-4fe7-9fe7-ea2c84d6ccf7 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:00.840894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da99ae6-7a52-4921-b58c-df9cd616901f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:01.003627 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da99ae6-7a52-4921-b58c-df9cd616901f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:01.024232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:01.070457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e23f32-f083-4e93-8a78-d6e9591b0a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:01.071383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e23f32-f083-4e93-8a78-d6e9591b0a9a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:01.071729 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e23f32-f083-4e93-8a78-d6e9591b0a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:01.072087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e23f32-f083-4e93-8a78-d6e9591b0a9a None admin] PATH_INFO: `/v3/users/b4834a3500ae4e84a6e9864109a0e726` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:01.073532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e23f32-f083-4e93-8a78-d6e9591b0a9a None admin] RBAC: Authorizing `identity:get_user(user_id=b4834a3500ae4e84a6e9864109a0e726)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:01.074974 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e23f32-f083-4e93-8a78-d6e9591b0a9a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:01.076837 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 78/158] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:00 2022] GET /identity/v3/users/b4834a3500ae4e84a6e9864109a0e726 => generated 247 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:01.083435 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e23f32-f083-4e93-8a78-d6e9591b0a9a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:01.188946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 81/159] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 893 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:01.195247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc83e53-408d-4fe7-9fe7-ea2c84d6ccf7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:01.254245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e23f32-f083-4e93-8a78-d6e9591b0a9a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:01.318140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8732bf-5c18-4396-9274-a3d81b9be69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:01.319123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8732bf-5c18-4396-9274-a3d81b9be69e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:01.319577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8732bf-5c18-4396-9274-a3d81b9be69e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:01.320033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8732bf-5c18-4396-9274-a3d81b9be69e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:01.404470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:01.407697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:01.440007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8732bf-5c18-4396-9274-a3d81b9be69e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:01.442154 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8732bf-5c18-4396-9274-a3d81b9be69e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:01.538291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc83e53-408d-4fe7-9fe7-ea2c84d6ccf7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:01.653436 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 79/160] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:01.660459 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8732bf-5c18-4396-9274-a3d81b9be69e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:01.686508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cdf00-dd1b-45e6-af43-762cff6bad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:01.687667 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cdf00-dd1b-45e6-af43-762cff6bad6c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:01.688207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cdf00-dd1b-45e6-af43-762cff6bad6c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:01.688838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cdf00-dd1b-45e6-af43-762cff6bad6c None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:01.694506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cdf00-dd1b-45e6-af43-762cff6bad6c None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:01.697315 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cdf00-dd1b-45e6-af43-762cff6bad6c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:01.700403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 82/161] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:01 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 506 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:01.706979 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cdf00-dd1b-45e6-af43-762cff6bad6c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:01.847417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:01.876012 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8732bf-5c18-4396-9274-a3d81b9be69e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:01.934420 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a992685-5dfc-476a-b291-c0e8a17e1996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:01.935157 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a992685-5dfc-476a-b291-c0e8a17e1996 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:01.935443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a992685-5dfc-476a-b291-c0e8a17e1996 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:01.935714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a992685-5dfc-476a-b291-c0e8a17e1996 None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:01.936992 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a992685-5dfc-476a-b291-c0e8a17e1996 None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:01.939378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a992685-5dfc-476a-b291-c0e8a17e1996 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:01.942712 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 80/162] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:01 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:01.949305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a992685-5dfc-476a-b291-c0e8a17e1996 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:02.016582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cdf00-dd1b-45e6-af43-762cff6bad6c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:02.117682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a010f3-4cfa-4844-9175-808b62fb4f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:02.118545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a010f3-4cfa-4844-9175-808b62fb4f70 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:02.118960 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a010f3-4cfa-4844-9175-808b62fb4f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:02.119367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a010f3-4cfa-4844-9175-808b62fb4f70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:02.120262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a010f3-4cfa-4844-9175-808b62fb4f70 None admin] RBAC: Adding query filter params (role.id=2ae4df0c2db34d5092a5a05f3e512fdc, scope.project.id=ae8e0eac9762422d8ac3147d4f823f90, user.id=1646a508a727421c8e569118d78f0ee3) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:02.120719 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a010f3-4cfa-4844-9175-808b62fb4f70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:02.122354 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a010f3-4cfa-4844-9175-808b62fb4f70 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:02.139631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 83/163] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:17:01 2022] GET /identity/v3/role_assignments?user.id=1646a508a727421c8e569118d78f0ee3&scope.project.id=ae8e0eac9762422d8ac3147d4f823f90&role.id=2ae4df0c2db34d5092a5a05f3e512fdc => generated 608 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:02.139975 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a992685-5dfc-476a-b291-c0e8a17e1996 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:02.221240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7581c52-5ffd-44a3-9cce-5758b97a6763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:02.221925 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7581c52-5ffd-44a3-9cce-5758b97a6763 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:02.222211 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7581c52-5ffd-44a3-9cce-5758b97a6763 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:02.222700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7581c52-5ffd-44a3-9cce-5758b97a6763 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:02.223653 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7581c52-5ffd-44a3-9cce-5758b97a6763 None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=ae8e0eac9762422d8ac3147d4f823f90, user.id=b4834a3500ae4e84a6e9864109a0e726) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:02.223966 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7581c52-5ffd-44a3-9cce-5758b97a6763 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:02.225482 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7581c52-5ffd-44a3-9cce-5758b97a6763 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:02.240097 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 81/164] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:17:01 2022] GET /identity/v3/role_assignments?user.id=b4834a3500ae4e84a6e9864109a0e726&scope.project.id=ae8e0eac9762422d8ac3147d4f823f90&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:02.752487 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e99f6-fa9b-4fb3-8b9e-6d0ef2816df6 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:02.753771 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e99f6-fa9b-4fb3-8b9e-6d0ef2816df6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:02.755183 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e99f6-fa9b-4fb3-8b9e-6d0ef2816df6 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:02.758317 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af5f0c-2bca-405d-b13f-d3504977a196 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:02.760018 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af5f0c-2bca-405d-b13f-d3504977a196 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:02.760296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af5f0c-2bca-405d-b13f-d3504977a196 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:02.762020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 82/165] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:17:02.762928 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 84/166] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:02 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:02.768457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6793e4-b37c-4365-8a36-fa09132a087b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:02.768745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6793e4-b37c-4365-8a36-fa09132a087b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:02.769010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6793e4-b37c-4365-8a36-fa09132a087b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:02.784384 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea3cdd-59b6-424d-9d76-fdf5aeff2f93 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:02.784880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea3cdd-59b6-424d-9d76-fdf5aeff2f93 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:02.785350 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea3cdd-59b6-424d-9d76-fdf5aeff2f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:02.801236 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-9d6793e4-b37c-4365-8a36-fa09132a087b None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:02.802498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9d6793e4-b37c-4365-8a36-fa09132a087b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:02.816434 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:02.823550 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:02.831364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e3ea3cdd-59b6-424d-9d76-fdf5aeff2f93 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:02.833521 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e3ea3cdd-59b6-424d-9d76-fdf5aeff2f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:02.983669 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 83/167] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:17:02.985450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6cb24-69ba-4d27-a9a6-a0ea4c64f1f4 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:02.985953 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6cb24-69ba-4d27-a9a6-a0ea4c64f1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:02.987423 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6cb24-69ba-4d27-a9a6-a0ea4c64f1f4 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:02.991798 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 84/168] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:02.999242 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b047bf-02ba-414d-984a-b7a57a876cbd None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:02.999516 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b047bf-02ba-414d-984a-b7a57a876cbd None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:02.999780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b047bf-02ba-414d-984a-b7a57a876cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:03.004316 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 85/169] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:03.027844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-38b047bf-02ba-414d-984a-b7a57a876cbd None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:03.029054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-38b047bf-02ba-414d-984a-b7a57a876cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:03.170956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 85/170] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:03.398435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea3cdd-59b6-424d-9d76-fdf5aeff2f93 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:03.586728 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9781178-a640-4fba-bede-7d6613ed574e None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:03.587707 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9781178-a640-4fba-bede-7d6613ed574e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:03.588539 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9781178-a640-4fba-bede-7d6613ed574e None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:03.591830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 86/171] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:03.597403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea3cdd-59b6-424d-9d76-fdf5aeff2f93 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:03.600211 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739645e7-901e-4835-8e5f-6144ff816eaf None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:03.601056 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739645e7-901e-4835-8e5f-6144ff816eaf None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:03.601838 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739645e7-901e-4835-8e5f-6144ff816eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:03.651326 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-739645e7-901e-4835-8e5f-6144ff816eaf None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:03.657819 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-739645e7-901e-4835-8e5f-6144ff816eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:03.695294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99345a-5a1a-445b-820f-25d2d6f2dec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:03.696325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99345a-5a1a-445b-820f-25d2d6f2dec4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:03.696791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99345a-5a1a-445b-820f-25d2d6f2dec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:03.697253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99345a-5a1a-445b-820f-25d2d6f2dec4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:03.711816 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:03.730634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99345a-5a1a-445b-820f-25d2d6f2dec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:03.738917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-9c99345a-5a1a-445b-820f-25d2d6f2dec4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:03.738917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:03.738917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:03.738917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:03.738917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:03.738917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:03.738917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:03.738917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:03.738917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:03.738917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:03.738917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:03.738917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:03.738917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:03.738917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:03.738917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:03.738917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:03.740626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:03.740626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:03.740626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:03.740626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:03.740626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:03.740626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:03.740626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:03.740626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:03.740626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:03.740626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:03.740626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:03.740626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:03.740626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:03.740626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:03.740626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:03.740626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:03.742146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:03.742146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:03.742146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:03.742146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:03.742146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:03.742146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:03.742146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:03.742146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:03.742146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:03.742146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:03.742146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:03.742146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:03.742146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 86/172] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:03.742146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85119a9-21ae-4906-b2fd-18346e55dd85 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:03.743485 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85119a9-21ae-4906-b2fd-18346e55dd85 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:03.743485 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85119a9-21ae-4906-b2fd-18346e55dd85 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:03.745251 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 87/173] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:03.746532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85119a9-21ae-4906-b2fd-18346e55dd85 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:03.799767 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 87/174] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:03.801313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50772f48-c24d-432a-adfa-d3d34a95d660 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:03.802082 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50772f48-c24d-432a-adfa-d3d34a95d660 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:03.802358 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50772f48-c24d-432a-adfa-d3d34a95d660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:03.813517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:03.834492 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-50772f48-c24d-432a-adfa-d3d34a95d660 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:03.836019 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-50772f48-c24d-432a-adfa-d3d34a95d660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:03.938631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85119a9-21ae-4906-b2fd-18346e55dd85 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:03.951543 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 88/175] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:03.951730 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50772f48-c24d-432a-adfa-d3d34a95d660 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:04.000572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5700c5-f743-4c27-b989-8a826162b3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:04.001279 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5700c5-f743-4c27-b989-8a826162b3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:04.001620 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5700c5-f743-4c27-b989-8a826162b3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:04.001887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5700c5-f743-4c27-b989-8a826162b3f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:04.018709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5700c5-f743-4c27-b989-8a826162b3f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:04.026345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-9e5700c5-f743-4c27-b989-8a826162b3f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:04.026345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:04.026345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:04.026345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:04.026345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:04.026345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:04.026345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:04.026345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:04.026345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:04.026345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:04.026345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:04.026345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:04.026345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:04.026345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:04.026345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:04.026345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:04.027255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:04.027255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:04.027255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:04.027255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:04.027255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:04.027255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:04.027255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:04.027255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:04.027255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:04.027255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:04.027255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:04.027255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:04.027255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:04.027255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:04.027255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:04.027255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:04.028031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:04.028031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:04.028031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:04.028031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:04.028031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:04.028031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:04.028031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:04.028031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:04.028031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:04.028031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:04.028031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:04.028031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:04.033460 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 88/176] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:04.034842 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2cb54-548f-4541-bae1-33f03a236c9e None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:04.035125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2cb54-548f-4541-bae1-33f03a236c9e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:04.035393 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2cb54-548f-4541-bae1-33f03a236c9e None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:04.036867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 89/177] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:04.037421 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2cb54-548f-4541-bae1-33f03a236c9e None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:04.136481 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50772f48-c24d-432a-adfa-d3d34a95d660 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:04.138730 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:04.193674 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06dc33-621f-4a12-b64c-5a099fd7f96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:04.194494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06dc33-621f-4a12-b64c-5a099fd7f96e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:04.195006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06dc33-621f-4a12-b64c-5a099fd7f96e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:04.195654 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06dc33-621f-4a12-b64c-5a099fd7f96e None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:04.196848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06dc33-621f-4a12-b64c-5a099fd7f96e None admin] RBAC: Adding query filter params (name=member) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:04.197431 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06dc33-621f-4a12-b64c-5a099fd7f96e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:04.199605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06dc33-621f-4a12-b64c-5a099fd7f96e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:04.201348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:04.214430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 89/178] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:04.214430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06dc33-621f-4a12-b64c-5a099fd7f96e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:04.224282 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2cb54-548f-4541-bae1-33f03a236c9e None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:04.273043 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb70f48-b7b0-4265-99c8-abcbad7deddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:04.273872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb70f48-b7b0-4265-99c8-abcbad7deddd None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:04.274317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb70f48-b7b0-4265-99c8-abcbad7deddd None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:04.274753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb70f48-b7b0-4265-99c8-abcbad7deddd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:04.290813 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb70f48-b7b0-4265-99c8-abcbad7deddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:04.299574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-1eb70f48-b7b0-4265-99c8-abcbad7deddd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:17:04.299574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:04.299574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:04.299574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:04.299574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:04.299574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:04.299574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:04.299574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:04.299574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:04.299574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:04.299574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:04.299574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:04.299574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:04.299574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:04.299574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:04.299574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:04.300516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:04.300516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:04.300516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:04.300516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:04.300516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:04.300516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:04.300516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:04.300516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:04.300516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:04.300516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:04.300516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:04.300516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:04.300516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:04.300516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:04.300516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:04.300516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:04.301308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:04.301308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:04.301308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:04.301308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:04.301308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:04.301308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:04.301308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:04.301308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:04.301308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:04.301308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:04.301308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:17:04.301308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:04.301308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 90/179] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:17:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:04.303153 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372e8d8-3a0a-4853-8210-2016365a3876 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:04.303631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372e8d8-3a0a-4853-8210-2016365a3876 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:04.304085 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372e8d8-3a0a-4853-8210-2016365a3876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:04.326469 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-0372e8d8-3a0a-4853-8210-2016365a3876 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:04.327350 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0372e8d8-3a0a-4853-8210-2016365a3876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:04.346225 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06dc33-621f-4a12-b64c-5a099fd7f96e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:04.401637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9aeb2-2404-475a-b8dd-81a3da7e69e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:04.401637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9aeb2-2404-475a-b8dd-81a3da7e69e4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:04.401637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9aeb2-2404-475a-b8dd-81a3da7e69e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:04.401637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9aeb2-2404-475a-b8dd-81a3da7e69e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:04.402094 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9aeb2-2404-475a-b8dd-81a3da7e69e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:04.402094 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9aeb2-2404-475a-b8dd-81a3da7e69e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:04.402758 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9aeb2-2404-475a-b8dd-81a3da7e69e4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:04.412045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 90/180] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:04.414053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9aeb2-2404-475a-b8dd-81a3da7e69e4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:04.424230 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 91/181] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:04.428748 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372e8d8-3a0a-4853-8210-2016365a3876 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:04.499608 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:04.505454 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:04.581748 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372e8d8-3a0a-4853-8210-2016365a3876 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:04.582007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9aeb2-2404-475a-b8dd-81a3da7e69e4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:04.624908 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394aa12-3b8e-4aea-a5ac-3fbec22acc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:04.625115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111171a-07a1-42f6-afc4-9c763b51c50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:04.625611 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394aa12-3b8e-4aea-a5ac-3fbec22acc2a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:04.625772 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111171a-07a1-42f6-afc4-9c763b51c50f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:04.625939 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394aa12-3b8e-4aea-a5ac-3fbec22acc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:04.626047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111171a-07a1-42f6-afc4-9c763b51c50f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:04.626211 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394aa12-3b8e-4aea-a5ac-3fbec22acc2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:04.626313 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111171a-07a1-42f6-afc4-9c763b51c50f None admin] PATH_INFO: `/v3/users/1646a508a727421c8e569118d78f0ee3` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:04.627330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394aa12-3b8e-4aea-a5ac-3fbec22acc2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:04.627494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111171a-07a1-42f6-afc4-9c763b51c50f None admin] RBAC: Authorizing `identity:get_user(user_id=1646a508a727421c8e569118d78f0ee3)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:04.628809 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394aa12-3b8e-4aea-a5ac-3fbec22acc2a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:04.628917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111171a-07a1-42f6-afc4-9c763b51c50f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:04.636246 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 91/182] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:04.636406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 92/183] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:04 2022] GET /identity/v3/users/1646a508a727421c8e569118d78f0ee3 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:04.636406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111171a-07a1-42f6-afc4-9c763b51c50f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:04.636536 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394aa12-3b8e-4aea-a5ac-3fbec22acc2a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:04.773257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394aa12-3b8e-4aea-a5ac-3fbec22acc2a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:04.775928 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111171a-07a1-42f6-afc4-9c763b51c50f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:04.795615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:04.804601 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:04.814808 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f5e26-bebe-4bb8-9391-098f10692114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:04.815446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5e26-bebe-4bb8-9391-098f10692114 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:04.815725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5e26-bebe-4bb8-9391-098f10692114 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:04.815994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5e26-bebe-4bb8-9391-098f10692114 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:04.822162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceab713-3231-412a-8c90-3f8df3aba38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:04.822784 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceab713-3231-412a-8c90-3f8df3aba38d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:04.823056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceab713-3231-412a-8c90-3f8df3aba38d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:04.823327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceab713-3231-412a-8c90-3f8df3aba38d None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:04.823999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceab713-3231-412a-8c90-3f8df3aba38d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:04.824296 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceab713-3231-412a-8c90-3f8df3aba38d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:04.825723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceab713-3231-412a-8c90-3f8df3aba38d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:04.828522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f5e26-bebe-4bb8-9391-098f10692114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:04.835111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-2f7f5e26-bebe-4bb8-9391-098f10692114 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:17:04.835111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:04.835111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:04.835111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:04.835111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:04.835111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:04.835111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:04.835111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:04.835111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:04.835111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:04.835111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:04.835111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:04.835111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:04.835111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:04.835111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:04.835111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:04.836169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:04.836169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:04.836169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:04.836169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:04.836169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:04.836169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:04.836169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:04.836169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:04.836169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:04.836169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:04.836169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:04.836169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:04.836169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:04.836169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:04.836169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:04.836169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:04.837298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:04.837298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:04.837298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:04.837298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:04.837298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:04.837298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:04.837298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:04.837298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:04.837298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:04.837298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:04.837298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:17:04.837298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:04.837947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 93/184] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:04.837947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceab713-3231-412a-8c90-3f8df3aba38d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:04.838571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 92/185] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:04.838571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f5e26-bebe-4bb8-9391-098f10692114 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:04.960201 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceab713-3231-412a-8c90-3f8df3aba38d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:04.970953 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f5e26-bebe-4bb8-9391-098f10692114 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:05.007911 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394b3fd-3bdb-4380-a8dc-fef8a51b2e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:05.008134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95d614-04d7-465f-b173-45819226a614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:05.008547 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394b3fd-3bdb-4380-a8dc-fef8a51b2e48 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:05.008759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95d614-04d7-465f-b173-45819226a614 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:05.008851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394b3fd-3bdb-4380-a8dc-fef8a51b2e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:05.009040 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95d614-04d7-465f-b173-45819226a614 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:05.009156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394b3fd-3bdb-4380-a8dc-fef8a51b2e48 None admin] PATH_INFO: `/v3/users/1646a508a727421c8e569118d78f0ee3` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:05.009314 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95d614-04d7-465f-b173-45819226a614 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:05.010252 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394b3fd-3bdb-4380-a8dc-fef8a51b2e48 None admin] RBAC: Authorizing `identity:get_user(user_id=1646a508a727421c8e569118d78f0ee3)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:05.011732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394b3fd-3bdb-4380-a8dc-fef8a51b2e48 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:05.013338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 94/186] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:04 2022] GET /identity/v3/users/1646a508a727421c8e569118d78f0ee3 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:05.018269 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394b3fd-3bdb-4380-a8dc-fef8a51b2e48 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:05.071719 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:05.075004 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:05.088954 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95d614-04d7-465f-b173-45819226a614 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:05.091056 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95d614-04d7-465f-b173-45819226a614 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:05.157524 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394b3fd-3bdb-4380-a8dc-fef8a51b2e48 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:05.215902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7092b-228d-4f27-b871-e22edd90f818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:05.216514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7092b-228d-4f27-b871-e22edd90f818 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:05.216857 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7092b-228d-4f27-b871-e22edd90f818 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:05.217129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7092b-228d-4f27-b871-e22edd90f818 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:05.217880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7092b-228d-4f27-b871-e22edd90f818 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:05.219540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7092b-228d-4f27-b871-e22edd90f818 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:05.228596 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 93/187] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:05.229731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95d614-04d7-465f-b173-45819226a614 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:05.252548 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 95/188] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:17:05 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:17:05.252548 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7092b-228d-4f27-b871-e22edd90f818 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:05.374479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:05.391239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:05.394775 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7092b-228d-4f27-b871-e22edd90f818 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:05.404289 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95d614-04d7-465f-b173-45819226a614 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:05.448636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf9bc7-6a7f-4997-baa2-e5ca3cd4455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:05.449855 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf9bc7-6a7f-4997-baa2-e5ca3cd4455d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:05.450385 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf9bc7-6a7f-4997-baa2-e5ca3cd4455d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:05.450701 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf9bc7-6a7f-4997-baa2-e5ca3cd4455d None admin] PATH_INFO: `/v3/users/ee8608f0a8c64e878e9b846c62d8bbd4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:05.456508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adea82-446e-4842-a29c-d0ec6e962523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:05.457699 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adea82-446e-4842-a29c-d0ec6e962523 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:05.457816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adea82-446e-4842-a29c-d0ec6e962523 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:05.458054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adea82-446e-4842-a29c-d0ec6e962523 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:05.474726 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adea82-446e-4842-a29c-d0ec6e962523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:05.478836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf9bc7-6a7f-4997-baa2-e5ca3cd4455d None admin] RBAC: Authorizing `identity:get_user(user_id=ee8608f0a8c64e878e9b846c62d8bbd4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:05.481424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf9bc7-6a7f-4997-baa2-e5ca3cd4455d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:05.482168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-e2adea82-446e-4842-a29c-d0ec6e962523 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:05.482168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:05.482168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:05.482168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:05.482168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:05.482168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:05.482168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:05.482168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:05.482168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:05.482168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:05.482168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:05.482168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:05.482168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:05.482168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:05.482168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:05.482168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:05.493156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:05.493156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:05.493156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:05.493156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:05.493156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:05.493156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:05.493156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:05.493156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:05.493156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:05.493156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:05.493156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:05.493156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:05.493156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:05.493156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:05.493156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:05.493156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:05.494164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:05.494164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:05.494164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:05.494164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:05.494164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:05.494164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:05.494164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:05.494164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:05.494164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:05.494164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:05.494164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:05.494164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:05.494762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 96/189] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:05 2022] GET /identity/v3/users/ee8608f0a8c64e878e9b846c62d8bbd4 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:05.494833 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 94/190] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:17:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:05.494833 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adea82-446e-4842-a29c-d0ec6e962523 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:05.494962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf9bc7-6a7f-4997-baa2-e5ca3cd4455d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:05.652152 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adea82-446e-4842-a29c-d0ec6e962523 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:05.687577 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf9bc7-6a7f-4997-baa2-e5ca3cd4455d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:05.733030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e7fae-3f19-4915-b4fd-9b27dcb4b132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:05.733945 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e7fae-3f19-4915-b4fd-9b27dcb4b132 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:05.734426 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e7fae-3f19-4915-b4fd-9b27dcb4b132 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:05.734722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193df012-f575-4979-b0e7-b844023501ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:05.734897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e7fae-3f19-4915-b4fd-9b27dcb4b132 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:05.735832 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e7fae-3f19-4915-b4fd-9b27dcb4b132 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:05.736230 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e7fae-3f19-4915-b4fd-9b27dcb4b132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:05.736719 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193df012-f575-4979-b0e7-b844023501ee None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:05.737410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193df012-f575-4979-b0e7-b844023501ee None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:05.737941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e7fae-3f19-4915-b4fd-9b27dcb4b132 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:05.738293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193df012-f575-4979-b0e7-b844023501ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:05.752980 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 97/191] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:05.754099 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e7fae-3f19-4915-b4fd-9b27dcb4b132 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:05.782206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:05.797856 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:05.862964 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193df012-f575-4979-b0e7-b844023501ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:05.866775 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193df012-f575-4979-b0e7-b844023501ee None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:05.887304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e7fae-3f19-4915-b4fd-9b27dcb4b132 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:05.934419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c873a76-417c-4e70-888e-01447d8c926c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:05.935146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c873a76-417c-4e70-888e-01447d8c926c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:05.935515 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c873a76-417c-4e70-888e-01447d8c926c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:05.935896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c873a76-417c-4e70-888e-01447d8c926c None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:05.937629 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c873a76-417c-4e70-888e-01447d8c926c None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:05.939482 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c873a76-417c-4e70-888e-01447d8c926c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:05.941877 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 98/192] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:05 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:05.942652 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c873a76-417c-4e70-888e-01447d8c926c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:06.043798 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 95/193] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:06.046022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193df012-f575-4979-b0e7-b844023501ee None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:06.053104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:06.069204 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c873a76-417c-4e70-888e-01447d8c926c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:06.113791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cceaa-9adf-4e2d-ad01-8be4885ed601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:06.114430 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cceaa-9adf-4e2d-ad01-8be4885ed601 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:06.114704 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cceaa-9adf-4e2d-ad01-8be4885ed601 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:06.114974 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cceaa-9adf-4e2d-ad01-8be4885ed601 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:06.115634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cceaa-9adf-4e2d-ad01-8be4885ed601 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:06.115929 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cceaa-9adf-4e2d-ad01-8be4885ed601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:06.117327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cceaa-9adf-4e2d-ad01-8be4885ed601 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:06.128529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 99/194] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:17:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:06.129425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cceaa-9adf-4e2d-ad01-8be4885ed601 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:06.135389 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:06.236675 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193df012-f575-4979-b0e7-b844023501ee None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:06.288052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cceaa-9adf-4e2d-ad01-8be4885ed601 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:06.299348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c851c-c3a1-42eb-a287-439cc5070fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:06.300358 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c851c-c3a1-42eb-a287-439cc5070fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:06.300840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c851c-c3a1-42eb-a287-439cc5070fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:06.301321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c851c-c3a1-42eb-a287-439cc5070fe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:06.330649 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7da5d-fd9e-4972-8ee8-47d2e6b76993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:06.331833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7da5d-fd9e-4972-8ee8-47d2e6b76993 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:06.332306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7da5d-fd9e-4972-8ee8-47d2e6b76993 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:06.333144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7da5d-fd9e-4972-8ee8-47d2e6b76993 None admin] PATH_INFO: `/v3/users/7bc4de0b9b494ccfa342c7d3b9b053d0` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:06.335122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7da5d-fd9e-4972-8ee8-47d2e6b76993 None admin] RBAC: Authorizing `identity:get_user(user_id=7bc4de0b9b494ccfa342c7d3b9b053d0)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:06.336968 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7da5d-fd9e-4972-8ee8-47d2e6b76993 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:06.339353 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 100/195] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:06 2022] GET /identity/v3/users/7bc4de0b9b494ccfa342c7d3b9b053d0 => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:06.340137 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7da5d-fd9e-4972-8ee8-47d2e6b76993 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:06.380320 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:06.419177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c851c-c3a1-42eb-a287-439cc5070fe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:06.421897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c851c-c3a1-42eb-a287-439cc5070fe0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:06.496283 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:06.528402 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7da5d-fd9e-4972-8ee8-47d2e6b76993 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:06.578158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 96/196] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:06.579216 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c851c-c3a1-42eb-a287-439cc5070fe0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:06.598616 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3f701-eacb-4124-82e5-ab8f163b3486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:06.599331 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3f701-eacb-4124-82e5-ab8f163b3486 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:06.599561 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3f701-eacb-4124-82e5-ab8f163b3486 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:06.599831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3f701-eacb-4124-82e5-ab8f163b3486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:06.600593 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3f701-eacb-4124-82e5-ab8f163b3486 None admin] RBAC: Adding query filter params (role.id=73f8d83949b241d2bcd58d267657768a, scope.project.id=ae8e0eac9762422d8ac3147d4f823f90, user.id=1646a508a727421c8e569118d78f0ee3) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:06.600871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3f701-eacb-4124-82e5-ab8f163b3486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:06.602420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3f701-eacb-4124-82e5-ab8f163b3486 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:06.618313 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 101/197] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:17:06 2022] GET /identity/v3/role_assignments?user.id=1646a508a727421c8e569118d78f0ee3&scope.project.id=ae8e0eac9762422d8ac3147d4f823f90&role.id=73f8d83949b241d2bcd58d267657768a => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:06.619431 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3f701-eacb-4124-82e5-ab8f163b3486 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:06.756367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:06.760830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c851c-c3a1-42eb-a287-439cc5070fe0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:06.801435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3f701-eacb-4124-82e5-ab8f163b3486 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:06.810682 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c8f37-9587-4376-a406-a6bb1d32d15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:06.811701 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c8f37-9587-4376-a406-a6bb1d32d15a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:06.812175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c8f37-9587-4376-a406-a6bb1d32d15a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:06.812775 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c8f37-9587-4376-a406-a6bb1d32d15a None admin] PATH_INFO: `/v3/projects/7770c2c2d95a424881d6c6de8b848b5c` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:06.815568 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c8f37-9587-4376-a406-a6bb1d32d15a None admin] RBAC: Authorizing `identity:get_project(project_id=7770c2c2d95a424881d6c6de8b848b5c)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:06.817442 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c8f37-9587-4376-a406-a6bb1d32d15a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:06.819857 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 97/198] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:06 2022] GET /identity/v3/projects/7770c2c2d95a424881d6c6de8b848b5c => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:06.820988 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c8f37-9587-4376-a406-a6bb1d32d15a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:06.839779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:06.934780 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e3197-d39e-40f9-a064-07f394e5bae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:06.935817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e3197-d39e-40f9-a064-07f394e5bae3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:06.936291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e3197-d39e-40f9-a064-07f394e5bae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:06.938573 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e3197-d39e-40f9-a064-07f394e5bae3 None admin] PATH_INFO: `/v3/users/ee8608f0a8c64e878e9b846c62d8bbd4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:06.940039 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e3197-d39e-40f9-a064-07f394e5bae3 None admin] RBAC: Authorizing `identity:get_user(user_id=ee8608f0a8c64e878e9b846c62d8bbd4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:06.942618 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e3197-d39e-40f9-a064-07f394e5bae3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:06.944260 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 102/199] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:06 2022] GET /identity/v3/users/ee8608f0a8c64e878e9b846c62d8bbd4 => generated 283 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:06.945061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e3197-d39e-40f9-a064-07f394e5bae3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:06.974601 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c8f37-9587-4376-a406-a6bb1d32d15a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:07.027399 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95be36-41a8-4b18-92cb-446e5b47db1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:07.028099 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95be36-41a8-4b18-92cb-446e5b47db1e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:07.029047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95be36-41a8-4b18-92cb-446e5b47db1e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:07.029442 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95be36-41a8-4b18-92cb-446e5b47db1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:07.111659 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e3197-d39e-40f9-a064-07f394e5bae3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:07.120834 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95be36-41a8-4b18-92cb-446e5b47db1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:07.123017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95be36-41a8-4b18-92cb-446e5b47db1e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:07.147763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:07.164553 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547972b9-7524-4955-98bc-5a62a010b8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:07.165704 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547972b9-7524-4955-98bc-5a62a010b8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:07.166500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547972b9-7524-4955-98bc-5a62a010b8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:07.166905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547972b9-7524-4955-98bc-5a62a010b8a4 None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:07.168869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547972b9-7524-4955-98bc-5a62a010b8a4 None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:07.170688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547972b9-7524-4955-98bc-5a62a010b8a4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:07.173258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 103/200] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:06 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:07.174300 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547972b9-7524-4955-98bc-5a62a010b8a4 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:07.200499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:07.274310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 98/201] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:07.275445 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95be36-41a8-4b18-92cb-446e5b47db1e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:07.326609 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547972b9-7524-4955-98bc-5a62a010b8a4 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:07.374221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832cf08-695e-4b82-8c8a-3c18488e3456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:07.374997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832cf08-695e-4b82-8c8a-3c18488e3456 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:07.375969 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832cf08-695e-4b82-8c8a-3c18488e3456 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:07.376351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832cf08-695e-4b82-8c8a-3c18488e3456 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:07.377223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832cf08-695e-4b82-8c8a-3c18488e3456 None admin] RBAC: Adding query filter params (role.id=73f8d83949b241d2bcd58d267657768a, scope.project.id=7770c2c2d95a424881d6c6de8b848b5c, user.id=1646a508a727421c8e569118d78f0ee3) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:07.377890 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832cf08-695e-4b82-8c8a-3c18488e3456 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:07.379795 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832cf08-695e-4b82-8c8a-3c18488e3456 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:07.389555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95be36-41a8-4b18-92cb-446e5b47db1e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:07.389881 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 104/202] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:17:07 2022] GET /identity/v3/role_assignments?user.id=1646a508a727421c8e569118d78f0ee3&scope.project.id=7770c2c2d95a424881d6c6de8b848b5c&role.id=73f8d83949b241d2bcd58d267657768a => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:07.390893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832cf08-695e-4b82-8c8a-3c18488e3456 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:07.425447 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:07.478319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d57b5-60f9-4045-94c1-0457ff6795d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:07.479293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d57b5-60f9-4045-94c1-0457ff6795d5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:07.479944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d57b5-60f9-4045-94c1-0457ff6795d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:07.480973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d57b5-60f9-4045-94c1-0457ff6795d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:07.572322 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:07.598686 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d57b5-60f9-4045-94c1-0457ff6795d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:07.599347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832cf08-695e-4b82-8c8a-3c18488e3456 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:07.600689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d57b5-60f9-4045-94c1-0457ff6795d5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:07.639691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7698e5-f6f7-43e8-95bd-29adbe553b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:07.640323 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7698e5-f6f7-43e8-95bd-29adbe553b29 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:07.640604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7698e5-f6f7-43e8-95bd-29adbe553b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:07.640875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7698e5-f6f7-43e8-95bd-29adbe553b29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:07.642721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7698e5-f6f7-43e8-95bd-29adbe553b29 None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4, user.id=ee8608f0a8c64e878e9b846c62d8bbd4) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:07.642721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7698e5-f6f7-43e8-95bd-29adbe553b29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:07.643508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7698e5-f6f7-43e8-95bd-29adbe553b29 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:07.651774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 105/203] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:17:07 2022] GET /identity/v3/role_assignments?user.id=ee8608f0a8c64e878e9b846c62d8bbd4&scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:07.653006 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7698e5-f6f7-43e8-95bd-29adbe553b29 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:07.773313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 99/204] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:07.775365 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b91f48-dc67-40a9-a6ed-b5e699712a44 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:07.775667 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b91f48-dc67-40a9-a6ed-b5e699712a44 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:07.775944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b91f48-dc67-40a9-a6ed-b5e699712a44 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:07.777936 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 100/205] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:07.779645 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94ab62-7bde-48e0-8cc7-a9bdd3d1fcb5 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:07.779933 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94ab62-7bde-48e0-8cc7-a9bdd3d1fcb5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:07.780205 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94ab62-7bde-48e0-8cc7-a9bdd3d1fcb5 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:07.786471 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 101/206] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:07.787821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94ab62-7bde-48e0-8cc7-a9bdd3d1fcb5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:07.809345 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:07.841151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7698e5-f6f7-43e8-95bd-29adbe553b29 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:07.877230 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a01c5-0b0e-4e46-8ff8-bbfb5845c260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:07.877821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a01c5-0b0e-4e46-8ff8-bbfb5845c260 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:07.878103 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a01c5-0b0e-4e46-8ff8-bbfb5845c260 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:07.878377 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a01c5-0b0e-4e46-8ff8-bbfb5845c260 None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:07.879523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a01c5-0b0e-4e46-8ff8-bbfb5845c260 None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:07.881004 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a01c5-0b0e-4e46-8ff8-bbfb5845c260 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:07.882677 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 106/207] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:07 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:07.883804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f90d70-6981-497c-851b-c5b998c4baef None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:07.884085 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f90d70-6981-497c-851b-c5b998c4baef None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:07.884356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f90d70-6981-497c-851b-c5b998c4baef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:07.913781 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-08f90d70-6981-497c-851b-c5b998c4baef None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:07.915009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-08f90d70-6981-497c-851b-c5b998c4baef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:07.920350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94ab62-7bde-48e0-8cc7-a9bdd3d1fcb5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:07.927857 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:07.959654 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf70fe0-6aae-4a38-9d1b-69750ff0caa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:07.960298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf70fe0-6aae-4a38-9d1b-69750ff0caa2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:07.960582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf70fe0-6aae-4a38-9d1b-69750ff0caa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:07.960854 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf70fe0-6aae-4a38-9d1b-69750ff0caa2 None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:07.963518 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf70fe0-6aae-4a38-9d1b-69750ff0caa2 None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:07.966073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf70fe0-6aae-4a38-9d1b-69750ff0caa2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:07.967862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 102/208] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:07 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:07.969246 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff708bc-1b4d-47d4-9384-adb845e649c9 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:07.969612 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff708bc-1b4d-47d4-9384-adb845e649c9 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:07.970281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff708bc-1b4d-47d4-9384-adb845e649c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:07.991561 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-dff708bc-1b4d-47d4-9384-adb845e649c9 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:07.992857 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-dff708bc-1b4d-47d4-9384-adb845e649c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:08.009397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 107/209] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:08.010064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f90d70-6981-497c-851b-c5b998c4baef None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:08.086731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 103/210] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:08.087697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff708bc-1b4d-47d4-9384-adb845e649c9 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:08.122845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:08.153080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f90d70-6981-497c-851b-c5b998c4baef None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:08.196977 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba569ddc-aa11-4986-93db-25f6d03fe7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:08.197923 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba569ddc-aa11-4986-93db-25f6d03fe7ea None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:08.198871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba569ddc-aa11-4986-93db-25f6d03fe7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:08.199321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba569ddc-aa11-4986-93db-25f6d03fe7ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:08.200427 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba569ddc-aa11-4986-93db-25f6d03fe7ea None admin] RBAC: Adding query filter params (role.id=50f15caac85247d9a4b34ea4e25850a1, scope.project.id=ae8e0eac9762422d8ac3147d4f823f90, user.id=7bc4de0b9b494ccfa342c7d3b9b053d0) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:08.201034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba569ddc-aa11-4986-93db-25f6d03fe7ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:08.202887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba569ddc-aa11-4986-93db-25f6d03fe7ea None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:08.210256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 108/211] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:17:08 2022] GET /identity/v3/role_assignments?user.id=7bc4de0b9b494ccfa342c7d3b9b053d0&scope.project.id=ae8e0eac9762422d8ac3147d4f823f90&role.id=50f15caac85247d9a4b34ea4e25850a1 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:08.311715 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff708bc-1b4d-47d4-9384-adb845e649c9 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:08.314518 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba569ddc-aa11-4986-93db-25f6d03fe7ea None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:08.337791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:08.397076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee8e2c-a954-42ee-9fb6-790bb9e59b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:08.398803 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee8e2c-a954-42ee-9fb6-790bb9e59b8d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:08.398803 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee8e2c-a954-42ee-9fb6-790bb9e59b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:08.398803 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee8e2c-a954-42ee-9fb6-790bb9e59b8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:08.399226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee8e2c-a954-42ee-9fb6-790bb9e59b8d None admin] RBAC: Adding query filter params (role.id=2ae4df0c2db34d5092a5a05f3e512fdc, scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4, user.id=ee8608f0a8c64e878e9b846c62d8bbd4) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:08.401627 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee8e2c-a954-42ee-9fb6-790bb9e59b8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:08.404116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee8e2c-a954-42ee-9fb6-790bb9e59b8d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:08.411760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 104/212] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:17:08 2022] GET /identity/v3/role_assignments?user.id=ee8608f0a8c64e878e9b846c62d8bbd4&scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4&role.id=2ae4df0c2db34d5092a5a05f3e512fdc => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:08.412647 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee8e2c-a954-42ee-9fb6-790bb9e59b8d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:08.487176 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba569ddc-aa11-4986-93db-25f6d03fe7ea None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:08.534628 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:08.539036 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17789132-6d56-470c-a4ce-c23229b54e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:08.540802 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17789132-6d56-470c-a4ce-c23229b54e04 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:08.542195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17789132-6d56-470c-a4ce-c23229b54e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:08.542952 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17789132-6d56-470c-a4ce-c23229b54e04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:08.545957 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17789132-6d56-470c-a4ce-c23229b54e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:08.550655 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17789132-6d56-470c-a4ce-c23229b54e04 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:08.555822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 109/213] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:08.562079 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17789132-6d56-470c-a4ce-c23229b54e04 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:08.571632 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee8e2c-a954-42ee-9fb6-790bb9e59b8d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:08.629473 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3f412-851d-4d52-86ca-0b24f8398815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:08.630175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3f412-851d-4d52-86ca-0b24f8398815 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:08.630456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3f412-851d-4d52-86ca-0b24f8398815 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:08.630734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3f412-851d-4d52-86ca-0b24f8398815 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:08.646046 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3f412-851d-4d52-86ca-0b24f8398815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:08.652450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-dfd3f412-851d-4d52-86ca-0b24f8398815 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:08.652450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:08.652450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:08.652450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:08.652450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:08.652450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:08.652450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:08.652450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:08.652450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:08.652450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:08.652450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:08.652450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:08.652450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:08.652450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:08.652450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:08.652450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:08.653343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:08.653343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:08.653343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:08.653343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:08.653343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:08.653343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:08.653343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:08.653343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:08.653343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:08.653343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:08.653343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:08.653343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:08.653343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:08.653343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:08.653343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:08.653343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:08.654206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:08.654206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:08.654206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:08.654206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:08.654206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:08.654206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:08.654206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:08.654206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:08.654206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:08.654206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:08.654206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:08.654206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:08.654206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 105/214] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:08.661073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3f412-851d-4d52-86ca-0b24f8398815 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:08.683468 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:08.721927 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17789132-6d56-470c-a4ce-c23229b54e04 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:08.759640 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3b854-c8e2-4b66-90d3-28bb4e7f9b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:08.760258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3b854-c8e2-4b66-90d3-28bb4e7f9b4d None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:08.760543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3b854-c8e2-4b66-90d3-28bb4e7f9b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:08.760815 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3b854-c8e2-4b66-90d3-28bb4e7f9b4d None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:08.761590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3b854-c8e2-4b66-90d3-28bb4e7f9b4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:08.763183 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3b854-c8e2-4b66-90d3-28bb4e7f9b4d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:08.791097 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 110/215] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:17:08 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:17:08.799660 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3f412-851d-4d52-86ca-0b24f8398815 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:08.843271 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202958-4f87-4bec-bcc3-6af79d5a2f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:08.843917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202958-4f87-4bec-bcc3-6af79d5a2f8a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:08.844237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202958-4f87-4bec-bcc3-6af79d5a2f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:08.844585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202958-4f87-4bec-bcc3-6af79d5a2f8a None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:08.845549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98202958-4f87-4bec-bcc3-6af79d5a2f8a None admin] RBAC: Adding query filter params (name=member) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:08.845860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98202958-4f87-4bec-bcc3-6af79d5a2f8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:08.847342 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98202958-4f87-4bec-bcc3-6af79d5a2f8a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:08.854152 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:08.858634 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 106/216] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:08.864748 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3b854-c8e2-4b66-90d3-28bb4e7f9b4d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:08.999871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3b854-c8e2-4b66-90d3-28bb4e7f9b4d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:09.042382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:09.048724 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69cd85-8c6d-4ba9-8e98-60b7ad681f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:09.049351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69cd85-8c6d-4ba9-8e98-60b7ad681f53 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:09.050514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69cd85-8c6d-4ba9-8e98-60b7ad681f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:09.050790 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69cd85-8c6d-4ba9-8e98-60b7ad681f53 None admin] PATH_INFO: `/v3/users/e3b0ba98f47f4f1cb4370f5a7dc2a07f` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:09.072460 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69cd85-8c6d-4ba9-8e98-60b7ad681f53 None admin] RBAC: Authorizing `identity:get_user(user_id=e3b0ba98f47f4f1cb4370f5a7dc2a07f)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:09.074000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69cd85-8c6d-4ba9-8e98-60b7ad681f53 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:09.080836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 111/217] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:08 2022] GET /identity/v3/users/e3b0ba98f47f4f1cb4370f5a7dc2a07f => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:09.082386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202958-4f87-4bec-bcc3-6af79d5a2f8a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:09.223892 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202958-4f87-4bec-bcc3-6af79d5a2f8a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:09.274002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42538820-e0c3-42c1-9791-ba44edc03b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:09.274986 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42538820-e0c3-42c1-9791-ba44edc03b15 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:09.275464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42538820-e0c3-42c1-9791-ba44edc03b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:09.276032 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42538820-e0c3-42c1-9791-ba44edc03b15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:09.384074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:09.391750 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42538820-e0c3-42c1-9791-ba44edc03b15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:09.393267 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42538820-e0c3-42c1-9791-ba44edc03b15 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:09.523567 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 107/218] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:09.525416 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69cd85-8c6d-4ba9-8e98-60b7ad681f53 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:09.656830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69cd85-8c6d-4ba9-8e98-60b7ad681f53 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:09.706882 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e37233-655f-4583-a5c6-83c01a958b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:09.707947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e37233-655f-4583-a5c6-83c01a958b5e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:09.708433 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e37233-655f-4583-a5c6-83c01a958b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:09.708897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e37233-655f-4583-a5c6-83c01a958b5e None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:09.710357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e37233-655f-4583-a5c6-83c01a958b5e None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:09.712167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e37233-655f-4583-a5c6-83c01a958b5e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:09.714094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 112/219] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:09 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:09.720564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42538820-e0c3-42c1-9791-ba44edc03b15 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:09.832667 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:09.837074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42538820-e0c3-42c1-9791-ba44edc03b15 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:09.875141 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba73050-6864-4ee1-8da2-c816bfa204a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:09.876218 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba73050-6864-4ee1-8da2-c816bfa204a0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:09.876692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba73050-6864-4ee1-8da2-c816bfa204a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:09.877154 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba73050-6864-4ee1-8da2-c816bfa204a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:09.878139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba73050-6864-4ee1-8da2-c816bfa204a0 None admin] RBAC: Adding query filter params (role.id=73f8d83949b241d2bcd58d267657768a, scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4, user.id=e3b0ba98f47f4f1cb4370f5a7dc2a07f) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:09.878661 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba73050-6864-4ee1-8da2-c816bfa204a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:09.880620 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba73050-6864-4ee1-8da2-c816bfa204a0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:09.887551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 108/220] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:17:09 2022] GET /identity/v3/role_assignments?user.id=e3b0ba98f47f4f1cb4370f5a7dc2a07f&scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4&role.id=73f8d83949b241d2bcd58d267657768a => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:09.979617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7afc0c-de3d-445f-8951-dacad7e7ead7 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:09.980251 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7afc0c-de3d-445f-8951-dacad7e7ead7 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:09.980718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7afc0c-de3d-445f-8951-dacad7e7ead7 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:09.982379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 113/221] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:10.003049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f06417-f911-4363-81db-cb6126e28ab1 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:10.003662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f06417-f911-4363-81db-cb6126e28ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:10.004151 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f06417-f911-4363-81db-cb6126e28ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:10.029970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f9f06417-f911-4363-81db-cb6126e28ab1 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:10.031618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f9f06417-f911-4363-81db-cb6126e28ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:10.140898 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 109/222] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:10.609491 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7afc0c-de3d-445f-8951-dacad7e7ead7 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:10.704365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:10.787773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7afc0c-de3d-445f-8951-dacad7e7ead7 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:10.844843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16838af4-e709-491e-9ed3-5869ca9e840e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:10.845689 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16838af4-e709-491e-9ed3-5869ca9e840e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:10.846028 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16838af4-e709-491e-9ed3-5869ca9e840e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:10.846369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16838af4-e709-491e-9ed3-5869ca9e840e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:10.860521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34bd0e-cbd3-4d79-aedb-cebacf491e8c None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:10.861182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34bd0e-cbd3-4d79-aedb-cebacf491e8c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:10.861705 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34bd0e-cbd3-4d79-aedb-cebacf491e8c None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:10.863459 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 110/223] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:17:10.868793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16838af4-e709-491e-9ed3-5869ca9e840e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:10.875195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-16838af4-e709-491e-9ed3-5869ca9e840e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:17:10.875195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:10.875195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:10.875195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:10.875195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:10.875195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:10.875195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:10.875195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:10.875195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:10.875195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:10.875195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:10.875195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:10.875195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:10.875195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:10.875195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:10.875195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:10.876364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:10.876364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:10.876364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:10.876364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:10.876364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:10.876364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:10.876364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:10.876364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:10.876364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:10.876364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:10.876364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:10.876364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:10.876364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:10.876364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:10.876364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:10.876364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:10.877286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:10.877286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:10.877286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:10.877286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:10.877286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:10.877286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:10.877286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:10.877286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:10.877286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:10.877286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:10.877286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:17:10.877286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:10.878090 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 114/224] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:17:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:10.879561 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717ce4c-1c32-46e8-a314-b41b3b536470 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:10.879843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717ce4c-1c32-46e8-a314-b41b3b536470 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:10.880117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717ce4c-1c32-46e8-a314-b41b3b536470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:10.884238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16838af4-e709-491e-9ed3-5869ca9e840e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:10.910428 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d717ce4c-1c32-46e8-a314-b41b3b536470 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:10.912864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d717ce4c-1c32-46e8-a314-b41b3b536470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:11.112771 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 111/225] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:17:11.131406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16838af4-e709-491e-9ed3-5869ca9e840e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:11.166512 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:11.191015 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b234ef8-bb0a-4969-88b8-9325560884c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:11.191688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b234ef8-bb0a-4969-88b8-9325560884c5 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:11.191972 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b234ef8-bb0a-4969-88b8-9325560884c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:11.192237 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b234ef8-bb0a-4969-88b8-9325560884c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:11.192919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b234ef8-bb0a-4969-88b8-9325560884c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:11.193217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b234ef8-bb0a-4969-88b8-9325560884c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:11.194678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b234ef8-bb0a-4969-88b8-9325560884c5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:11.210888 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 115/226] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:11.216077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717ce4c-1c32-46e8-a314-b41b3b536470 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:11.250664 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:11.349710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717ce4c-1c32-46e8-a314-b41b3b536470 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:11.390450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae5a19-bc0f-4657-ab16-0c769265b5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:11.391128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae5a19-bc0f-4657-ab16-0c769265b5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:11.391410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae5a19-bc0f-4657-ab16-0c769265b5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:11.391677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae5a19-bc0f-4657-ab16-0c769265b5d8 None admin] PATH_INFO: `/v3/users/ee8608f0a8c64e878e9b846c62d8bbd4` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:11.392905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae5a19-bc0f-4657-ab16-0c769265b5d8 None admin] RBAC: Authorizing `identity:get_user(user_id=ee8608f0a8c64e878e9b846c62d8bbd4)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:11.394411 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae5a19-bc0f-4657-ab16-0c769265b5d8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:11.396375 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 112/227] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:11 2022] GET /identity/v3/users/ee8608f0a8c64e878e9b846c62d8bbd4 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:11.402046 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b234ef8-bb0a-4969-88b8-9325560884c5 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:11.639848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae5a19-bc0f-4657-ab16-0c769265b5d8 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:11.666873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b234ef8-bb0a-4969-88b8-9325560884c5 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:11.739951 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f6a11-86e4-4b5e-9d68-4d73a78fb2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:11.741037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6a11-86e4-4b5e-9d68-4d73a78fb2c1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:11.741554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6a11-86e4-4b5e-9d68-4d73a78fb2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:11.742044 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6a11-86e4-4b5e-9d68-4d73a78fb2c1 None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:11.743537 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f6a11-86e4-4b5e-9d68-4d73a78fb2c1 None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:11.745352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f6a11-86e4-4b5e-9d68-4d73a78fb2c1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:11.747562 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 116/228] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:11 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:11.749080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab3b3a-68a5-4dc3-b066-860c38ab1ff5 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:11.749599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab3b3a-68a5-4dc3-b066-860c38ab1ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:11.750093 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab3b3a-68a5-4dc3-b066-860c38ab1ff5 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:11.751719 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 117/229] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:11.756934 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab3b3a-68a5-4dc3-b066-860c38ab1ff5 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:11.818849 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:11.849229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:11.864177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae5a19-bc0f-4657-ab16-0c769265b5d8 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:11.883434 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab3b3a-68a5-4dc3-b066-860c38ab1ff5 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:11.916588 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355e26d-0ed5-41f7-84c0-f7bf5fc988d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:11.917867 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e26d-0ed5-41f7-84c0-f7bf5fc988d3 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:11.918432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e26d-0ed5-41f7-84c0-f7bf5fc988d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:11.918816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e26d-0ed5-41f7-84c0-f7bf5fc988d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:11.933351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355e26d-0ed5-41f7-84c0-f7bf5fc988d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:11.935217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fac2a8-282b-48b8-8efc-0c5edc37e82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:11.935892 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fac2a8-282b-48b8-8efc-0c5edc37e82e None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:11.936167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fac2a8-282b-48b8-8efc-0c5edc37e82e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:11.936440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fac2a8-282b-48b8-8efc-0c5edc37e82e None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4/users/ee8608f0a8c64e878e9b846c62d8bbd4/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:11.938373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-2355e26d-0ed5-41f7-84c0-f7bf5fc988d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:11.938373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:11.938373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:11.938373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:11.938373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:11.938373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:11.938373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:11.938373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:11.938373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:11.938373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:11.938373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:11.938373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:11.938373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:11.938373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:11.938373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:11.938373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:11.939333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:11.939333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:11.939333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:11.939333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:11.939333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:11.939333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:11.939333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:11.939333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:11.939333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:11.939333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:11.939333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:11.939333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:11.939333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:11.939333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:11.939333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:11.939333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:11.940124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:11.940124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:11.940124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:11.940124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:11.940124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:11.940124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:11.940124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:11.940124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:11.940124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:11.940124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:11.940124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:11.940124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:11.940970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fac2a8-282b-48b8-8efc-0c5edc37e82e None admin] RBAC: Authorizing `identity:create_grant(project_id=48fa3e38610a4b67b7e535ae4148e9d4, user_id=ee8608f0a8c64e878e9b846c62d8bbd4, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:11.941041 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 113/230] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:17:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:17:11.941114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fac2a8-282b-48b8-8efc-0c5edc37e82e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:11.941179 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7983d-2b3c-4b33-91fd-22bc6ee7e1de None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:11.942012 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7983d-2b3c-4b33-91fd-22bc6ee7e1de None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:11.942012 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7983d-2b3c-4b33-91fd-22bc6ee7e1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:11.958968 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 118/231] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:17:11 2022] PUT /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4/users/ee8608f0a8c64e878e9b846c62d8bbd4/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:17:11.961575 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522859b-2686-46fa-a1af-bb07f89572bf None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:11.962069 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522859b-2686-46fa-a1af-bb07f89572bf None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:11.962547 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522859b-2686-46fa-a1af-bb07f89572bf None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:11.962861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-dae7983d-2b3c-4b33-91fd-22bc6ee7e1de None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:11.964141 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-dae7983d-2b3c-4b33-91fd-22bc6ee7e1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:11.965227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 119/232] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:11.966564 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522859b-2686-46fa-a1af-bb07f89572bf None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:12.083257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 114/233] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:12.086397 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4acb6-863a-4ae9-993e-3a6c666c636c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:12.087079 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4acb6-863a-4ae9-993e-3a6c666c636c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:12.087455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4acb6-863a-4ae9-993e-3a6c666c636c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:12.119001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e5b4acb6-863a-4ae9-993e-3a6c666c636c None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:12.121223 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e5b4acb6-863a-4ae9-993e-3a6c666c636c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:12.123569 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522859b-2686-46fa-a1af-bb07f89572bf None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:12.141141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:12.184203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ba7df-79b3-4681-b0e4-d33bb40d187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:12.185328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ba7df-79b3-4681-b0e4-d33bb40d187d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:12.185795 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ba7df-79b3-4681-b0e4-d33bb40d187d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:12.186589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ba7df-79b3-4681-b0e4-d33bb40d187d None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:12.187305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ba7df-79b3-4681-b0e4-d33bb40d187d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:12.187614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ba7df-79b3-4681-b0e4-d33bb40d187d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:12.189432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ba7df-79b3-4681-b0e4-d33bb40d187d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:12.204487 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 120/234] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:17:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:12.210262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ba7df-79b3-4681-b0e4-d33bb40d187d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:12.310697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 115/235] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:12.416364 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4acb6-863a-4ae9-993e-3a6c666c636c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:12.452436 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:12.458897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ba7df-79b3-4681-b0e4-d33bb40d187d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:12.546850 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ff99f-680c-4769-8f54-6652c71f8b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:12.547614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ff99f-680c-4769-8f54-6652c71f8b12 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:12.547928 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ff99f-680c-4769-8f54-6652c71f8b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:12.548260 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ff99f-680c-4769-8f54-6652c71f8b12 None admin] PATH_INFO: `/v3/users/ee8608f0a8c64e878e9b846c62d8bbd4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:12.554272 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ff99f-680c-4769-8f54-6652c71f8b12 None admin] RBAC: Authorizing `identity:get_user(user_id=ee8608f0a8c64e878e9b846c62d8bbd4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:12.555809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ff99f-680c-4769-8f54-6652c71f8b12 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:12.557915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 121/236] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:12 2022] GET /identity/v3/users/ee8608f0a8c64e878e9b846c62d8bbd4 => generated 283 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:12.563628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ff99f-680c-4769-8f54-6652c71f8b12 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:12.646876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4acb6-863a-4ae9-993e-3a6c666c636c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:12.647666 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:12.713423 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce1880-9b22-49c0-bbdb-d6e18ba44cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:12.716015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce1880-9b22-49c0-bbdb-d6e18ba44cef None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:12.716531 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce1880-9b22-49c0-bbdb-d6e18ba44cef None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:12.716955 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce1880-9b22-49c0-bbdb-d6e18ba44cef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:12.739093 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce1880-9b22-49c0-bbdb-d6e18ba44cef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:12.745414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-04ce1880-9b22-49c0-bbdb-d6e18ba44cef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:17:12.745414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:12.745414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:12.745414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:12.745414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:12.745414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:12.745414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:12.745414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:12.745414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:12.745414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:12.745414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:12.745414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:12.745414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:12.745414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:12.745414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:12.745414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:12.746372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:12.746372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:12.746372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:12.746372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:12.746372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:12.746372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:12.746372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:12.746372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:12.746372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:12.746372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:12.746372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:12.746372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:12.746372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:12.746372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:12.746372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:12.746372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:12.747158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:12.747158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:12.747158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:12.747158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:12.747158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:12.747158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:12.747158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:12.747158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:12.747158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:12.747158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:12.747158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:17:12.747158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:12.747158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 116/237] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:12.748754 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce1880-9b22-49c0-bbdb-d6e18ba44cef None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:12.775410 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ff99f-680c-4769-8f54-6652c71f8b12 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:12.843218 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cee4cf-35e6-499d-9fa9-bc919ba020d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:12.845128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cee4cf-35e6-499d-9fa9-bc919ba020d2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:12.845907 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cee4cf-35e6-499d-9fa9-bc919ba020d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:12.846978 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cee4cf-35e6-499d-9fa9-bc919ba020d2 None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:12.849591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cee4cf-35e6-499d-9fa9-bc919ba020d2 None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:12.853846 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cee4cf-35e6-499d-9fa9-bc919ba020d2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:12.854743 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:12.864315 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 122/238] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:12 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:12.866082 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cee4cf-35e6-499d-9fa9-bc919ba020d2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:12.908815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce1880-9b22-49c0-bbdb-d6e18ba44cef None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:12.975242 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bac09-759d-4340-b217-e09d8096df90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:12.976119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bac09-759d-4340-b217-e09d8096df90 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:12.976599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bac09-759d-4340-b217-e09d8096df90 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:12.977067 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bac09-759d-4340-b217-e09d8096df90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:12.979275 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bac09-759d-4340-b217-e09d8096df90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:12.982043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bac09-759d-4340-b217-e09d8096df90 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:12.985105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 117/239] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:12.986457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bac09-759d-4340-b217-e09d8096df90 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:13.026016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cee4cf-35e6-499d-9fa9-bc919ba020d2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:13.035045 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:13.094318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10e6b5-1e33-49bb-a28a-dc0d27fcbfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:13.095994 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10e6b5-1e33-49bb-a28a-dc0d27fcbfc3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:13.096476 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10e6b5-1e33-49bb-a28a-dc0d27fcbfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:13.097023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10e6b5-1e33-49bb-a28a-dc0d27fcbfc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:13.098522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10e6b5-1e33-49bb-a28a-dc0d27fcbfc3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:13.100365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10e6b5-1e33-49bb-a28a-dc0d27fcbfc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:13.102958 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10e6b5-1e33-49bb-a28a-dc0d27fcbfc3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:13.119696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 123/240] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:13.121691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbda56-75d5-4d36-b424-d0f9ee4f3bb5 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:13.122174 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbda56-75d5-4d36-b424-d0f9ee4f3bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:13.122615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbda56-75d5-4d36-b424-d0f9ee4f3bb5 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:13.130859 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 124/241] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:13 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:13.135313 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbda56-75d5-4d36-b424-d0f9ee4f3bb5 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:13.148957 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bac09-759d-4340-b217-e09d8096df90 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:13.196904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84e10a-908b-482b-a7eb-579a783a3010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:13.197809 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84e10a-908b-482b-a7eb-579a783a3010 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:13.198107 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84e10a-908b-482b-a7eb-579a783a3010 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:13.198475 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84e10a-908b-482b-a7eb-579a783a3010 None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4/users/ee8608f0a8c64e878e9b846c62d8bbd4/roles/2ae4df0c2db34d5092a5a05f3e512fdc` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:13.200969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84e10a-908b-482b-a7eb-579a783a3010 None admin] RBAC: Authorizing `identity:create_grant(project_id=48fa3e38610a4b67b7e535ae4148e9d4, user_id=ee8608f0a8c64e878e9b846c62d8bbd4, role_id=2ae4df0c2db34d5092a5a05f3e512fdc)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:13.202701 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84e10a-908b-482b-a7eb-579a783a3010 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:13.218412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:13.227532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 118/242] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:17:12 2022] PUT /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4/users/ee8608f0a8c64e878e9b846c62d8bbd4/roles/2ae4df0c2db34d5092a5a05f3e512fdc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:17:13.229466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84e10a-908b-482b-a7eb-579a783a3010 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:13.282172 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbda56-75d5-4d36-b424-d0f9ee4f3bb5 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:13.332346 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdf036-0337-491d-b236-8d89970b32f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:13.333289 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdf036-0337-491d-b236-8d89970b32f0 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:13.333648 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdf036-0337-491d-b236-8d89970b32f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:13.334013 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdf036-0337-491d-b236-8d89970b32f0 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:13.334865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdf036-0337-491d-b236-8d89970b32f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:13.336499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdf036-0337-491d-b236-8d89970b32f0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:13.373285 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 125/243] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:17:13 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:17:13.374970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47624a-3b00-442e-9102-ffc4be1f60ef None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:13.375526 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47624a-3b00-442e-9102-ffc4be1f60ef None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:13.375988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47624a-3b00-442e-9102-ffc4be1f60ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:13.402383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-9c47624a-3b00-442e-9102-ffc4be1f60ef None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:13.404797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9c47624a-3b00-442e-9102-ffc4be1f60ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:13.412327 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84e10a-908b-482b-a7eb-579a783a3010 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:13.432185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:13.465112 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a4a56-6d22-4448-ad77-3775ac556ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:13.466652 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a4a56-6d22-4448-ad77-3775ac556ced None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:13.467432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a4a56-6d22-4448-ad77-3775ac556ced None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:13.468126 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a4a56-6d22-4448-ad77-3775ac556ced None admin] PATH_INFO: `/v3/users/ae93316e821c422bbcc6cf885022f1b1` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:13.488759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a4a56-6d22-4448-ad77-3775ac556ced None admin] RBAC: Authorizing `identity:get_user(user_id=ae93316e821c422bbcc6cf885022f1b1)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:13.490459 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a4a56-6d22-4448-ad77-3775ac556ced None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:13.492315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 119/244] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:13 2022] GET /identity/v3/users/ae93316e821c422bbcc6cf885022f1b1 => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:13.507978 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a4a56-6d22-4448-ad77-3775ac556ced None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:13.526926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 126/245] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:13.591190 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:13.671163 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a4a56-6d22-4448-ad77-3775ac556ced None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:13.737126 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358ef70-0927-4cd8-91c2-7fd3c0994396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:13.738155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358ef70-0927-4cd8-91c2-7fd3c0994396 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:13.738582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358ef70-0927-4cd8-91c2-7fd3c0994396 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:13.739067 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358ef70-0927-4cd8-91c2-7fd3c0994396 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:13.842311 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358ef70-0927-4cd8-91c2-7fd3c0994396 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:13.843867 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358ef70-0927-4cd8-91c2-7fd3c0994396 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:13.855394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47624a-3b00-442e-9102-ffc4be1f60ef None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:13.926116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:13.993643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 120/246] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:14.003039 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358ef70-0927-4cd8-91c2-7fd3c0994396 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:14.038220 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47624a-3b00-442e-9102-ffc4be1f60ef None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:14.090581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f4b03-7dbc-4545-a5d9-cfeb66ebacb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:14.091255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f4b03-7dbc-4545-a5d9-cfeb66ebacb4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:14.091529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f4b03-7dbc-4545-a5d9-cfeb66ebacb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:14.091796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f4b03-7dbc-4545-a5d9-cfeb66ebacb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:14.108064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f4b03-7dbc-4545-a5d9-cfeb66ebacb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:14.113415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-c86f4b03-7dbc-4545-a5d9-cfeb66ebacb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:14.113415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:14.113415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:14.113415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:14.113415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:14.113415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:14.113415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:14.113415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:14.113415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:14.113415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:14.113415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:14.113415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:14.113415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:14.113415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:14.113415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:14.113415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:14.114480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:14.114480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:14.114480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:14.114480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:14.114480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:14.114480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:14.114480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:14.114480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:14.114480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:14.114480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:14.114480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:14.114480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:14.114480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:14.114480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:14.114480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:14.114480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:14.115314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:14.115314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:14.115314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:14.115314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:14.115314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:14.115314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:14.115314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:14.115314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:14.115314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:14.115314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:14.115314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:14.115314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:14.115314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 127/247] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:14.123093 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f4b03-7dbc-4545-a5d9-cfeb66ebacb4 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:14.134275 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358ef70-0927-4cd8-91c2-7fd3c0994396 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:14.146104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:14.194787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3362740-9d68-43cd-adc6-110cf02fc049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:14.195764 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3362740-9d68-43cd-adc6-110cf02fc049 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:14.196224 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3362740-9d68-43cd-adc6-110cf02fc049 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:14.196692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3362740-9d68-43cd-adc6-110cf02fc049 None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:14.198836 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3362740-9d68-43cd-adc6-110cf02fc049 None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:14.200406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3362740-9d68-43cd-adc6-110cf02fc049 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:14.204077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 121/248] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:14 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:14.210927 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3362740-9d68-43cd-adc6-110cf02fc049 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:14.261419 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:14.270382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f4b03-7dbc-4545-a5d9-cfeb66ebacb4 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:14.316512 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba509e-ac17-434e-b816-9c83fd203af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:14.317465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba509e-ac17-434e-b816-9c83fd203af9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:14.317752 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba509e-ac17-434e-b816-9c83fd203af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:14.318020 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba509e-ac17-434e-b816-9c83fd203af9 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:14.318899 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba509e-ac17-434e-b816-9c83fd203af9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:14.319221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba509e-ac17-434e-b816-9c83fd203af9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:14.321227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba509e-ac17-434e-b816-9c83fd203af9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:14.333444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 128/249] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:14.350330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba509e-ac17-434e-b816-9c83fd203af9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:14.404332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3362740-9d68-43cd-adc6-110cf02fc049 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:14.477977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f34383-e00f-40a7-b9e7-d95c4389a6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:14.478829 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f34383-e00f-40a7-b9e7-d95c4389a6fa None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:14.478922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f34383-e00f-40a7-b9e7-d95c4389a6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:14.479252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f34383-e00f-40a7-b9e7-d95c4389a6fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:14.479887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f34383-e00f-40a7-b9e7-d95c4389a6fa None admin] RBAC: Adding query filter params (role.id=50f15caac85247d9a4b34ea4e25850a1, scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4, user.id=ae93316e821c422bbcc6cf885022f1b1) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:14.480194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f34383-e00f-40a7-b9e7-d95c4389a6fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:14.481947 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f34383-e00f-40a7-b9e7-d95c4389a6fa None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:14.489399 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 122/250] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:17:14 2022] GET /identity/v3/role_assignments?user.id=ae93316e821c422bbcc6cf885022f1b1&scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4&role.id=50f15caac85247d9a4b34ea4e25850a1 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:14.548503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:14.597535 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba509e-ac17-434e-b816-9c83fd203af9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:14.649443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0eacf3-ec3a-453e-a7a2-75e481a4fd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:14.650102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eacf3-ec3a-453e-a7a2-75e481a4fd2b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:14.650382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eacf3-ec3a-453e-a7a2-75e481a4fd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:14.650691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eacf3-ec3a-453e-a7a2-75e481a4fd2b None admin] PATH_INFO: `/v3/users/e3b0ba98f47f4f1cb4370f5a7dc2a07f` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:14.656017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0eacf3-ec3a-453e-a7a2-75e481a4fd2b None admin] RBAC: Authorizing `identity:get_user(user_id=e3b0ba98f47f4f1cb4370f5a7dc2a07f)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:14.657614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0eacf3-ec3a-453e-a7a2-75e481a4fd2b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:14.659664 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 129/251] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:14 2022] GET /identity/v3/users/e3b0ba98f47f4f1cb4370f5a7dc2a07f => generated 297 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:14.665651 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f34383-e00f-40a7-b9e7-d95c4389a6fa None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:14.798798 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab7f25-e196-4e7e-ac5b-5f626e2ec6a0 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:14.798990 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab7f25-e196-4e7e-ac5b-5f626e2ec6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:14.799250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab7f25-e196-4e7e-ac5b-5f626e2ec6a0 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:14.800904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 130/252] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:14.811622 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66de45-f7e1-48c0-ae6a-648288ccad20 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:14.812491 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66de45-f7e1-48c0-ae6a-648288ccad20 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:14.813204 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66de45-f7e1-48c0-ae6a-648288ccad20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:14.858500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:14.867185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ec66de45-f7e1-48c0-ae6a-648288ccad20 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:14.870543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ec66de45-f7e1-48c0-ae6a-648288ccad20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:14.890574 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f34383-e00f-40a7-b9e7-d95c4389a6fa None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:15.004695 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676b420-4b82-46db-86bd-e7ae43c2cbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:15.005841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676b420-4b82-46db-86bd-e7ae43c2cbea None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:15.006340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676b420-4b82-46db-86bd-e7ae43c2cbea None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:15.006974 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676b420-4b82-46db-86bd-e7ae43c2cbea None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:15.010167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676b420-4b82-46db-86bd-e7ae43c2cbea None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:15.012528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676b420-4b82-46db-86bd-e7ae43c2cbea None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:15.016347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 123/253] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:14 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:15.024882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676b420-4b82-46db-86bd-e7ae43c2cbea None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:15.081039 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 131/254] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:17:15.243823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676b420-4b82-46db-86bd-e7ae43c2cbea None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:15.293281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76747e0a-c063-4e3a-8eaf-c675b483559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:15.294550 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76747e0a-c063-4e3a-8eaf-c675b483559b None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:15.295059 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76747e0a-c063-4e3a-8eaf-c675b483559b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:15.295785 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76747e0a-c063-4e3a-8eaf-c675b483559b None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4/users/e3b0ba98f47f4f1cb4370f5a7dc2a07f/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:15.298677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76747e0a-c063-4e3a-8eaf-c675b483559b None admin] RBAC: Authorizing `identity:create_grant(project_id=48fa3e38610a4b67b7e535ae4148e9d4, user_id=e3b0ba98f47f4f1cb4370f5a7dc2a07f, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:15.301008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76747e0a-c063-4e3a-8eaf-c675b483559b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:15.323730 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 124/255] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:17:15 2022] PUT /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4/users/e3b0ba98f47f4f1cb4370f5a7dc2a07f/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:17:15.534142 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66de45-f7e1-48c0-ae6a-648288ccad20 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:15.665015 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:15.723035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66de45-f7e1-48c0-ae6a-648288ccad20 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:15.797188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6e445-e150-4e2e-9634-c354aeca6222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:15.798278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6e445-e150-4e2e-9634-c354aeca6222 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:15.798773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6e445-e150-4e2e-9634-c354aeca6222 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:15.799251 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6e445-e150-4e2e-9634-c354aeca6222 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:15.819210 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6e445-e150-4e2e-9634-c354aeca6222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:15.827675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-4fb6e445-e150-4e2e-9634-c354aeca6222 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:17:15.827675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:15.827675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:15.827675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:15.827675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:15.827675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:15.827675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:15.827675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:15.827675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:15.827675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:15.827675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:15.827675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:15.827675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:15.827675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:15.827675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:15.827675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:15.829543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:15.829543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:15.829543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:15.829543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:15.829543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:15.829543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:15.829543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:15.829543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:15.829543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:15.829543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:15.829543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:15.829543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:15.829543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:15.829543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:15.829543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:15.829543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:15.830567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:15.830567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:15.830567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:15.830567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:15.830567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:15.830567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:15.830567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:15.830567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:15.830567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:15.830567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:15.830567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:17:15.830567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:15.830567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 132/256] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:17:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:15.839915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76747e0a-c063-4e3a-8eaf-c675b483559b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:15.881899 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:16.024403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56177fe5-334a-456b-b3ba-ef03e61c4f26 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:16.024403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56177fe5-334a-456b-b3ba-ef03e61c4f26 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:16.024403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56177fe5-334a-456b-b3ba-ef03e61c4f26 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:16.025694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 133/257] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:17:16.037513 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76747e0a-c063-4e3a-8eaf-c675b483559b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:16.046923 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f838617-b5ca-4288-a95f-6c62b10a2751 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:16.047398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f838617-b5ca-4288-a95f-6c62b10a2751 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:16.048166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f838617-b5ca-4288-a95f-6c62b10a2751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:16.101685 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4f838617-b5ca-4288-a95f-6c62b10a2751 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:16.103563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4f838617-b5ca-4288-a95f-6c62b10a2751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:16.105083 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a71aa-0c2e-43d0-aac4-261a76f070a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:16.105891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a71aa-0c2e-43d0-aac4-261a76f070a0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:16.106509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a71aa-0c2e-43d0-aac4-261a76f070a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:16.106790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a71aa-0c2e-43d0-aac4-261a76f070a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:16.107485 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a71aa-0c2e-43d0-aac4-261a76f070a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:16.107791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a71aa-0c2e-43d0-aac4-261a76f070a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:16.109438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a71aa-0c2e-43d0-aac4-261a76f070a0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:16.130740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 125/258] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:16.139890 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a71aa-0c2e-43d0-aac4-261a76f070a0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:16.263300 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 134/259] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:16.340316 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:16.372759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a71aa-0c2e-43d0-aac4-261a76f070a0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:16.422861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d87e4c-6756-41b0-80dc-f8469c29afd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:16.423521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d87e4c-6756-41b0-80dc-f8469c29afd0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:16.423799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d87e4c-6756-41b0-80dc-f8469c29afd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:16.424074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d87e4c-6756-41b0-80dc-f8469c29afd0 None admin] PATH_INFO: `/v3/users/ee8608f0a8c64e878e9b846c62d8bbd4` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:16.424074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d87e4c-6756-41b0-80dc-f8469c29afd0 None admin] RBAC: Authorizing `identity:get_user(user_id=ee8608f0a8c64e878e9b846c62d8bbd4)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:16.428974 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d87e4c-6756-41b0-80dc-f8469c29afd0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:16.432909 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 126/260] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:16 2022] GET /identity/v3/users/ee8608f0a8c64e878e9b846c62d8bbd4 => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:16.437147 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f838617-b5ca-4288-a95f-6c62b10a2751 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:16.547499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:16.611335 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f838617-b5ca-4288-a95f-6c62b10a2751 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:16.680807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591602bf-27c9-443e-9bdf-fe2b203c92ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:16.681879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591602bf-27c9-443e-9bdf-fe2b203c92ef None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:16.682360 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591602bf-27c9-443e-9bdf-fe2b203c92ef None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:16.682830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591602bf-27c9-443e-9bdf-fe2b203c92ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:16.829018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591602bf-27c9-443e-9bdf-fe2b203c92ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:16.833703 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591602bf-27c9-443e-9bdf-fe2b203c92ef None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:16.950762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:17.000056 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d87e4c-6756-41b0-80dc-f8469c29afd0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:17.022706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 135/261] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:17.033967 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591602bf-27c9-443e-9bdf-fe2b203c92ef None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:17.275971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d87e4c-6756-41b0-80dc-f8469c29afd0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:17.290788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591602bf-27c9-443e-9bdf-fe2b203c92ef None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:17.357868 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61446c93-2096-4046-b436-22285c6081d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:17.358628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61446c93-2096-4046-b436-22285c6081d1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:17.358907 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61446c93-2096-4046-b436-22285c6081d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:17.359197 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61446c93-2096-4046-b436-22285c6081d1 None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:17.360661 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61446c93-2096-4046-b436-22285c6081d1 None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:17.362526 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61446c93-2096-4046-b436-22285c6081d1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:17.371052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 136/262] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:17 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:17.371726 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a62b28-b957-4dbb-b226-8379ce1dba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:17.372648 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a62b28-b957-4dbb-b226-8379ce1dba0e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:17.372975 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a62b28-b957-4dbb-b226-8379ce1dba0e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:17.373340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a62b28-b957-4dbb-b226-8379ce1dba0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:17.384885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61446c93-2096-4046-b436-22285c6081d1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:17.425109 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a62b28-b957-4dbb-b226-8379ce1dba0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:17.441338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-d4a62b28-b957-4dbb-b226-8379ce1dba0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:17.441338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:17.441338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:17.441338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:17.441338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:17.441338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:17.441338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:17.441338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:17.441338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:17.441338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:17.441338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:17.441338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:17.441338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:17.441338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:17.441338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:17.441338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:17.442372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:17.442372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:17.442372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:17.442372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:17.442372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:17.442372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:17.442372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:17.442372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:17.442372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:17.442372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:17.442372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:17.442372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:17.442372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:17.442372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:17.442372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:17.442372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:17.443194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:17.443194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:17.443194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:17.443194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:17.443194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:17.443194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:17.443194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:17.443194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:17.443194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:17.443194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:17.443194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:17.443194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:17.445102 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 127/263] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:17:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:17.450917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a62b28-b957-4dbb-b226-8379ce1dba0e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:17.474884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:17.505754 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:17.710318 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a62b28-b957-4dbb-b226-8379ce1dba0e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:17.711929 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61446c93-2096-4046-b436-22285c6081d1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:17.783589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e59d61-aa2e-46af-a23f-cf5dfd3c6de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:17.784630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e59d61-aa2e-46af-a23f-cf5dfd3c6de4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:17.785105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e59d61-aa2e-46af-a23f-cf5dfd3c6de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:17.785704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e59d61-aa2e-46af-a23f-cf5dfd3c6de4 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:17.786948 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e59d61-aa2e-46af-a23f-cf5dfd3c6de4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:17.787472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e59d61-aa2e-46af-a23f-cf5dfd3c6de4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:17.790220 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e59d61-aa2e-46af-a23f-cf5dfd3c6de4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:17.806265 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 128/264] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:17:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:17.811566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fc391-8eb9-4ce4-8d04-ece144ec522b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:17.811725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bb29b-5a74-471e-a012-15c79fb0ab43 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:17.812182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bb29b-5a74-471e-a012-15c79fb0ab43 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:17.812351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fc391-8eb9-4ce4-8d04-ece144ec522b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:17.812683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bb29b-5a74-471e-a012-15c79fb0ab43 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:17.812807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fc391-8eb9-4ce4-8d04-ece144ec522b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:17.813097 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fc391-8eb9-4ce4-8d04-ece144ec522b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:17.814073 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9fc391-8eb9-4ce4-8d04-ece144ec522b None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4, user.id=ee8608f0a8c64e878e9b846c62d8bbd4) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:17.814560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9fc391-8eb9-4ce4-8d04-ece144ec522b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:17.815519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 129/265] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:17.816441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9fc391-8eb9-4ce4-8d04-ece144ec522b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:17.821813 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bb29b-5a74-471e-a012-15c79fb0ab43 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:17.831404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 137/266] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:17:17 2022] GET /identity/v3/role_assignments?user.id=ee8608f0a8c64e878e9b846c62d8bbd4&scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 608 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:17.833196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f3a79-9ee3-4368-900f-16e201cf0ee2 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:17.833733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f3a79-9ee3-4368-900f-16e201cf0ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:17.834309 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f3a79-9ee3-4368-900f-16e201cf0ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:17.909735 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-155f3a79-9ee3-4368-900f-16e201cf0ee2 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:17.911865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-155f3a79-9ee3-4368-900f-16e201cf0ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:18.042734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:18.097774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 138/267] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:18.132383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c00ffe-d592-42cc-8b4a-bc90b7cfcd9e None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:18.133253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c00ffe-d592-42cc-8b4a-bc90b7cfcd9e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:18.134118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c00ffe-d592-42cc-8b4a-bc90b7cfcd9e None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:18.137035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 139/268] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:17:18.142930 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bb29b-5a74-471e-a012-15c79fb0ab43 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:18.145508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7762d-db5c-45a7-b972-f5a13341e392 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:18.146301 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7762d-db5c-45a7-b972-f5a13341e392 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:18.146970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7762d-db5c-45a7-b972-f5a13341e392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:18.189159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-22d7762d-db5c-45a7-b972-f5a13341e392 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:18.191565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-22d7762d-db5c-45a7-b972-f5a13341e392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:18.243646 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f977f-46e7-445b-afa4-c8053e5f2013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:18.244377 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:18.244726 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f977f-46e7-445b-afa4-c8053e5f2013 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:18.245209 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f977f-46e7-445b-afa4-c8053e5f2013 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:18.246034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f977f-46e7-445b-afa4-c8053e5f2013 None admin] PATH_INFO: `/v3/users/ee8608f0a8c64e878e9b846c62d8bbd4` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:18.248388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f977f-46e7-445b-afa4-c8053e5f2013 None admin] RBAC: Authorizing `identity:get_user(user_id=ee8608f0a8c64e878e9b846c62d8bbd4)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:18.251231 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f977f-46e7-445b-afa4-c8053e5f2013 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:18.254821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 130/269] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:17 2022] GET /identity/v3/users/ee8608f0a8c64e878e9b846c62d8bbd4 => generated 283 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:18.257012 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331640b1-29cf-4fbe-adc4-a2144c0b5427 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:18.257526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331640b1-29cf-4fbe-adc4-a2144c0b5427 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:18.258006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331640b1-29cf-4fbe-adc4-a2144c0b5427 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:18.260482 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 131/270] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:18.267756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331640b1-29cf-4fbe-adc4-a2144c0b5427 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:18.328998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 140/271] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:18.330844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9de1e4-a523-41a4-af76-09543c202480 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:18.331183 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9de1e4-a523-41a4-af76-09543c202480 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:18.331467 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9de1e4-a523-41a4-af76-09543c202480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:18.363549 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1d9de1e4-a523-41a4-af76-09543c202480 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:18.365030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1d9de1e4-a523-41a4-af76-09543c202480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:18.449373 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 141/272] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:18.476348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331640b1-29cf-4fbe-adc4-a2144c0b5427 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:18.540177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852a144-7dd6-448b-81a0-a738db081185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:18.541216 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852a144-7dd6-448b-81a0-a738db081185 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:18.541710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852a144-7dd6-448b-81a0-a738db081185 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:18.542193 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852a144-7dd6-448b-81a0-a738db081185 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:18.549064 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:18.676954 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852a144-7dd6-448b-81a0-a738db081185 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:18.679570 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852a144-7dd6-448b-81a0-a738db081185 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:18.761611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9de1e4-a523-41a4-af76-09543c202480 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:18.859759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 132/273] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:18.861032 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852a144-7dd6-448b-81a0-a738db081185 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:18.868253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:18.886614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9de1e4-a523-41a4-af76-09543c202480 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:18.918440 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:18.926776 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298a0de-a153-4b81-9e4f-72c5d6cbd642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:18.927786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298a0de-a153-4b81-9e4f-72c5d6cbd642 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:18.928256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298a0de-a153-4b81-9e4f-72c5d6cbd642 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:18.928712 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298a0de-a153-4b81-9e4f-72c5d6cbd642 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:18.942001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298a0de-a153-4b81-9e4f-72c5d6cbd642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:18.948327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-b298a0de-a153-4b81-9e4f-72c5d6cbd642 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:18.948327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:18.948327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:18.948327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:18.948327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:18.948327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:18.948327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:18.948327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:18.948327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:18.948327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:18.948327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:18.948327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:18.948327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:18.948327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:18.948327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:18.948327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:18.949198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:18.949198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:18.949198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:18.949198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:18.949198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:18.949198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:18.949198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:18.949198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:18.949198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:18.949198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:18.949198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:18.949198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:18.949198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:18.949198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:18.949198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:18.949198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:18.950023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:18.950023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:18.950023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:18.950023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:18.950023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:18.950023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:18.950023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:18.950023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:18.950023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:18.950023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:18.950023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:18.950023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:18.957616 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 142/274] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:17:18.958537 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298a0de-a153-4b81-9e4f-72c5d6cbd642 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:19.010893 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852a144-7dd6-448b-81a0-a738db081185 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:19.055800 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0c0ad-851d-461c-86fd-1d9fd4d3a50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:19.056811 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0c0ad-851d-461c-86fd-1d9fd4d3a50d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:19.057282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0c0ad-851d-461c-86fd-1d9fd4d3a50d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:19.057897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0c0ad-851d-461c-86fd-1d9fd4d3a50d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:19.059652 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0c0ad-851d-461c-86fd-1d9fd4d3a50d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:19.062107 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0c0ad-851d-461c-86fd-1d9fd4d3a50d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:19.065107 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 133/275] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:19.066164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0c0ad-851d-461c-86fd-1d9fd4d3a50d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:19.098246 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298a0de-a153-4b81-9e4f-72c5d6cbd642 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:19.138995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380493e8-286d-4cd3-928a-46ba2416477a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:19.139762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380493e8-286d-4cd3-928a-46ba2416477a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:19.140129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380493e8-286d-4cd3-928a-46ba2416477a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:19.140303 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380493e8-286d-4cd3-928a-46ba2416477a None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:19.142102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380493e8-286d-4cd3-928a-46ba2416477a None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:19.143750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380493e8-286d-4cd3-928a-46ba2416477a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:19.145922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 143/276] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:18 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:19.146849 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380493e8-286d-4cd3-928a-46ba2416477a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:19.168831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:19.226117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0c0ad-851d-461c-86fd-1d9fd4d3a50d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:19.229279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:19.265899 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380493e8-286d-4cd3-928a-46ba2416477a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:19.266764 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a09de-4681-4039-afb3-d3580bc6e466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:19.267384 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a09de-4681-4039-afb3-d3580bc6e466 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:19.267658 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a09de-4681-4039-afb3-d3580bc6e466 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:19.267918 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a09de-4681-4039-afb3-d3580bc6e466 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:19.268581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a09de-4681-4039-afb3-d3580bc6e466 None admin] RBAC: Adding query filter params (name=member) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:19.268880 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a09de-4681-4039-afb3-d3580bc6e466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:19.270305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a09de-4681-4039-afb3-d3580bc6e466 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:19.279430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 134/277] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:19.280266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a09de-4681-4039-afb3-d3580bc6e466 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:19.307379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30aab5-24cc-40e3-9126-8bcd87d8051a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:19.308022 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30aab5-24cc-40e3-9126-8bcd87d8051a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:19.308299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30aab5-24cc-40e3-9126-8bcd87d8051a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:19.308569 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30aab5-24cc-40e3-9126-8bcd87d8051a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:19.319263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30aab5-24cc-40e3-9126-8bcd87d8051a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:19.324130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-ef30aab5-24cc-40e3-9126-8bcd87d8051a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:17:19.324130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:19.324130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:19.324130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:19.324130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:19.324130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:19.324130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:19.324130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:19.324130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:19.324130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:19.324130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:19.324130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:19.324130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:19.324130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:19.324130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:19.324130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:19.325168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:19.325168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:19.325168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:19.325168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:19.325168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:19.325168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:19.325168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:19.325168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:19.325168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:19.325168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:19.325168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:19.325168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:19.325168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:19.325168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:19.325168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:19.325168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:19.326169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:19.326169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:19.326169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:19.326169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:19.326169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:19.326169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:19.326169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:19.326169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:19.326169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:19.326169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:19.326169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:17:19.326169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:19.329570 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 144/278] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:19.330617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30aab5-24cc-40e3-9126-8bcd87d8051a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:19.403145 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a09de-4681-4039-afb3-d3580bc6e466 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:19.424211 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:19.442808 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d413db3-c8e7-4061-833f-27cb7d6c0cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:19.446929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d413db3-c8e7-4061-833f-27cb7d6c0cb1 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:19.446929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d413db3-c8e7-4061-833f-27cb7d6c0cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:19.446929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d413db3-c8e7-4061-833f-27cb7d6c0cb1 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:19.446929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d413db3-c8e7-4061-833f-27cb7d6c0cb1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:19.446929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d413db3-c8e7-4061-833f-27cb7d6c0cb1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:19.455224 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30aab5-24cc-40e3-9126-8bcd87d8051a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:19.470843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 135/279] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:17:19 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:17:19.472144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0a11c-299e-44c2-95b9-61c69f9e13c3 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:19.472430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0a11c-299e-44c2-95b9-61c69f9e13c3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:19.472707 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0a11c-299e-44c2-95b9-61c69f9e13c3 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:19.477503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 136/280] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:19.477503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0a11c-299e-44c2-95b9-61c69f9e13c3 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:19.500470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c71bc1-fd9b-49b6-969c-3b66808c9c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:19.501205 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c71bc1-fd9b-49b6-969c-3b66808c9c8f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:19.501522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c71bc1-fd9b-49b6-969c-3b66808c9c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:19.501792 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c71bc1-fd9b-49b6-969c-3b66808c9c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:19.502555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c71bc1-fd9b-49b6-969c-3b66808c9c8f None admin] RBAC: Adding query filter params (role.id=2ae4df0c2db34d5092a5a05f3e512fdc, scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4, user.id=ee8608f0a8c64e878e9b846c62d8bbd4) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:19.502868 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c71bc1-fd9b-49b6-969c-3b66808c9c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:19.504395 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c71bc1-fd9b-49b6-969c-3b66808c9c8f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:19.511280 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 145/281] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:17:19 2022] GET /identity/v3/role_assignments?user.id=ee8608f0a8c64e878e9b846c62d8bbd4&scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4&role.id=2ae4df0c2db34d5092a5a05f3e512fdc => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:19.512429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c71bc1-fd9b-49b6-969c-3b66808c9c8f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:19.523710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:19.631551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0a11c-299e-44c2-95b9-61c69f9e13c3 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:19.651733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c71bc1-fd9b-49b6-969c-3b66808c9c8f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:19.676339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713564d-39a9-440d-b3b5-827db8add259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:19.676994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713564d-39a9-440d-b3b5-827db8add259 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:19.677274 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713564d-39a9-440d-b3b5-827db8add259 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:19.678212 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713564d-39a9-440d-b3b5-827db8add259 None admin] PATH_INFO: `/v3/users/1982bd90daf1403eb2df40c35e9be099` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:19.698479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713564d-39a9-440d-b3b5-827db8add259 None admin] RBAC: Authorizing `identity:get_user(user_id=1982bd90daf1403eb2df40c35e9be099)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:19.701253 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713564d-39a9-440d-b3b5-827db8add259 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:19.701691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6be3ab-b3ed-4b19-ab9c-3d5390d7e79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:19.702534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6be3ab-b3ed-4b19-ab9c-3d5390d7e79d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:19.703009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6be3ab-b3ed-4b19-ab9c-3d5390d7e79d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:19.703523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6be3ab-b3ed-4b19-ab9c-3d5390d7e79d None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:19.704066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 137/282] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:19 2022] GET /identity/v3/users/1982bd90daf1403eb2df40c35e9be099 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:19.704730 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6be3ab-b3ed-4b19-ab9c-3d5390d7e79d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:19.705232 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6be3ab-b3ed-4b19-ab9c-3d5390d7e79d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:19.705488 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06982c24-04a0-4fa1-ae13-87dd3a3cfbcd None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:19.705598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06982c24-04a0-4fa1-ae13-87dd3a3cfbcd None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:19.705853 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06982c24-04a0-4fa1-ae13-87dd3a3cfbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:19.707399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6be3ab-b3ed-4b19-ab9c-3d5390d7e79d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:19.718462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 146/283] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:19.720225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6be3ab-b3ed-4b19-ab9c-3d5390d7e79d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:19.721941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:19.728357 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-06982c24-04a0-4fa1-ae13-87dd3a3cfbcd None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:19.730389 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-06982c24-04a0-4fa1-ae13-87dd3a3cfbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:19.837548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 138/284] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:19.839439 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06982c24-04a0-4fa1-ae13-87dd3a3cfbcd None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:19.854069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:19.863292 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6be3ab-b3ed-4b19-ab9c-3d5390d7e79d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:19.901036 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dd90f-0ab0-49e8-8002-104473f0792f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:19.901680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dd90f-0ab0-49e8-8002-104473f0792f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:19.901961 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dd90f-0ab0-49e8-8002-104473f0792f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:19.902323 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dd90f-0ab0-49e8-8002-104473f0792f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:19.903152 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dd90f-0ab0-49e8-8002-104473f0792f None admin] RBAC: Adding query filter params (role.id=73f8d83949b241d2bcd58d267657768a, user.id=1982bd90daf1403eb2df40c35e9be099, scope.system=all) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:19.903462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dd90f-0ab0-49e8-8002-104473f0792f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:19.905023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dd90f-0ab0-49e8-8002-104473f0792f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:19.912054 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 147/285] 10.222.0.52 () {56 vars in 1308 bytes} [Mon Aug 29 20:17:19 2022] GET /identity/v3/role_assignments?user.id=1982bd90daf1403eb2df40c35e9be099&scope.system=all&role.id=73f8d83949b241d2bcd58d267657768a => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:19.978934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06982c24-04a0-4fa1-ae13-87dd3a3cfbcd None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:20.018643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0869911-1da7-4857-b1f9-6108f9ec8b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:20.019374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0869911-1da7-4857-b1f9-6108f9ec8b54 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:20.019656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0869911-1da7-4857-b1f9-6108f9ec8b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:20.019976 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0869911-1da7-4857-b1f9-6108f9ec8b54 None admin] PATH_INFO: `/v3/users/ae93316e821c422bbcc6cf885022f1b1` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:20.021270 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0869911-1da7-4857-b1f9-6108f9ec8b54 None admin] RBAC: Authorizing `identity:get_user(user_id=ae93316e821c422bbcc6cf885022f1b1)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:20.022811 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0869911-1da7-4857-b1f9-6108f9ec8b54 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:20.025004 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 139/286] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:19 2022] GET /identity/v3/users/ae93316e821c422bbcc6cf885022f1b1 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:20.030274 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dd90f-0ab0-49e8-8002-104473f0792f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:20.110156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:20.141644 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0869911-1da7-4857-b1f9-6108f9ec8b54 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:20.154651 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dd90f-0ab0-49e8-8002-104473f0792f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:20.200565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ff4a3-87cd-4b67-ab69-0595ee5ba969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:20.201414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ff4a3-87cd-4b67-ab69-0595ee5ba969 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:20.201814 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ff4a3-87cd-4b67-ab69-0595ee5ba969 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:20.202122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ff4a3-87cd-4b67-ab69-0595ee5ba969 None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:20.204425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ff4a3-87cd-4b67-ab69-0595ee5ba969 None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:20.206444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ff4a3-87cd-4b67-ab69-0595ee5ba969 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:20.209253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 148/287] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:20 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:20.214974 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ff4a3-87cd-4b67-ab69-0595ee5ba969 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:20.294439 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:20.337217 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0869911-1da7-4857-b1f9-6108f9ec8b54 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:20.398976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ff4a3-87cd-4b67-ab69-0595ee5ba969 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:20.403902 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901e36-4053-4abb-bc1c-f5160bd06aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:20.404549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901e36-4053-4abb-bc1c-f5160bd06aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:20.404825 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901e36-4053-4abb-bc1c-f5160bd06aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:20.405093 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901e36-4053-4abb-bc1c-f5160bd06aa5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:20.433540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69901e36-4053-4abb-bc1c-f5160bd06aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:20.439831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-69901e36-4053-4abb-bc1c-f5160bd06aa5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:20.439831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:20.439831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:20.439831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:20.439831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:20.439831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:20.439831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:20.439831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:20.439831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:20.439831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:20.439831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:20.439831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:20.439831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:20.439831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:20.439831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:20.439831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:20.440744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:20.440744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:20.440744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:20.440744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:20.440744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:20.440744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:20.440744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:20.440744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:20.440744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:20.440744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:20.440744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:20.440744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:20.440744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:20.440744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:20.440744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:20.440744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:20.441565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:20.441565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:20.441565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:20.441565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:20.441565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:20.441565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:20.441565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:20.441565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:20.441565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:20.441565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:20.441565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:20.441565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:20.442693 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 140/288] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:20.448221 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901e36-4053-4abb-bc1c-f5160bd06aa5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:20.456604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:20.474838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150676ef-62f3-40cf-ac4c-07cefc4dc76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:20.475529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150676ef-62f3-40cf-ac4c-07cefc4dc76d None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:20.475808 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150676ef-62f3-40cf-ac4c-07cefc4dc76d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:20.476087 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150676ef-62f3-40cf-ac4c-07cefc4dc76d None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4/users/ae93316e821c422bbcc6cf885022f1b1/roles/50f15caac85247d9a4b34ea4e25850a1` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:20.478297 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150676ef-62f3-40cf-ac4c-07cefc4dc76d None admin] RBAC: Authorizing `identity:create_grant(project_id=48fa3e38610a4b67b7e535ae4148e9d4, user_id=ae93316e821c422bbcc6cf885022f1b1, role_id=50f15caac85247d9a4b34ea4e25850a1)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:20.479778 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150676ef-62f3-40cf-ac4c-07cefc4dc76d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:20.504315 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 149/289] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:17:20 2022] PUT /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4/users/ae93316e821c422bbcc6cf885022f1b1/roles/50f15caac85247d9a4b34ea4e25850a1 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:17:20.579526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901e36-4053-4abb-bc1c-f5160bd06aa5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:20.645070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0968e-9777-421d-993c-4f33658d2138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:20.645773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0968e-9777-421d-993c-4f33658d2138 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:20.646055 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0968e-9777-421d-993c-4f33658d2138 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:20.646322 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0968e-9777-421d-993c-4f33658d2138 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:20.647003 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0968e-9777-421d-993c-4f33658d2138 None admin] RBAC: Adding query filter params (name=member) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:20.647305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0968e-9777-421d-993c-4f33658d2138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:20.648716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0968e-9777-421d-993c-4f33658d2138 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:20.654985 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:20.658546 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 141/290] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:20.664752 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150676ef-62f3-40cf-ac4c-07cefc4dc76d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:20.801259 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150676ef-62f3-40cf-ac4c-07cefc4dc76d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:20.845794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127cbeb-acb3-4263-97a7-3fc871e1227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:20.846781 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127cbeb-acb3-4263-97a7-3fc871e1227a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:20.847266 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127cbeb-acb3-4263-97a7-3fc871e1227a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:20.847733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127cbeb-acb3-4263-97a7-3fc871e1227a None admin] PATH_INFO: `/v3/users/e3b0ba98f47f4f1cb4370f5a7dc2a07f` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:20.849109 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127cbeb-acb3-4263-97a7-3fc871e1227a None admin] RBAC: Authorizing `identity:get_user(user_id=e3b0ba98f47f4f1cb4370f5a7dc2a07f)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:20.850831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127cbeb-acb3-4263-97a7-3fc871e1227a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:20.853012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 150/291] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:20 2022] GET /identity/v3/users/e3b0ba98f47f4f1cb4370f5a7dc2a07f => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:20.858388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0968e-9777-421d-993c-4f33658d2138 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:21.013075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0968e-9777-421d-993c-4f33658d2138 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:21.074296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aff36-b9e8-49f7-a66f-3f684b58d479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:21.075075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aff36-b9e8-49f7-a66f-3f684b58d479 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:21.075455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aff36-b9e8-49f7-a66f-3f684b58d479 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:21.075818 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aff36-b9e8-49f7-a66f-3f684b58d479 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:21.166677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:21.169582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aff36-b9e8-49f7-a66f-3f684b58d479 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:21.171063 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aff36-b9e8-49f7-a66f-3f684b58d479 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:21.328426 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 142/292] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:21.334434 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127cbeb-acb3-4263-97a7-3fc871e1227a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:21.417049 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:21.460699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127cbeb-acb3-4263-97a7-3fc871e1227a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:21.497190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f65256-1a7b-4d5c-9a02-4762b8e77ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:21.497858 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f65256-1a7b-4d5c-9a02-4762b8e77ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:21.498138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f65256-1a7b-4d5c-9a02-4762b8e77ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:21.498415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f65256-1a7b-4d5c-9a02-4762b8e77ee0 None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:21.499561 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f65256-1a7b-4d5c-9a02-4762b8e77ee0 None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:21.501095 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f65256-1a7b-4d5c-9a02-4762b8e77ee0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:21.502887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 151/293] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:21 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:21.509837 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aff36-b9e8-49f7-a66f-3f684b58d479 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:21.654549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:21.658652 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aff36-b9e8-49f7-a66f-3f684b58d479 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:21.707434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10fac5-22d5-43bc-8b4e-e7b59eb02d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:21.708055 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10fac5-22d5-43bc-8b4e-e7b59eb02d75 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:21.708332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10fac5-22d5-43bc-8b4e-e7b59eb02d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:21.708601 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10fac5-22d5-43bc-8b4e-e7b59eb02d75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:21.709333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10fac5-22d5-43bc-8b4e-e7b59eb02d75 None admin] RBAC: Adding query filter params (role.id=73f8d83949b241d2bcd58d267657768a, scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4, user.id=e3b0ba98f47f4f1cb4370f5a7dc2a07f) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:21.709666 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10fac5-22d5-43bc-8b4e-e7b59eb02d75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:21.711112 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10fac5-22d5-43bc-8b4e-e7b59eb02d75 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:21.719824 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 143/294] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:17:21 2022] GET /identity/v3/role_assignments?user.id=e3b0ba98f47f4f1cb4370f5a7dc2a07f&scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4&role.id=73f8d83949b241d2bcd58d267657768a => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:21.936134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeb744-ea25-4720-8abc-1f2cbe4dab48 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:21.936134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeb744-ea25-4720-8abc-1f2cbe4dab48 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:21.936134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeb744-ea25-4720-8abc-1f2cbe4dab48 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:21.936779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 152/295] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:21.943832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba87b0-53c8-4b69-9644-20de9fe6ca9b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:21.944339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba87b0-53c8-4b69-9644-20de9fe6ca9b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:21.944817 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba87b0-53c8-4b69-9644-20de9fe6ca9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:21.975576 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-52ba87b0-53c8-4b69-9644-20de9fe6ca9b None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:21.976698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-52ba87b0-53c8-4b69-9644-20de9fe6ca9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:22.065768 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 144/296] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:22.255772 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078973c-222a-44e7-842e-776ee6255746 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:22.256114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078973c-222a-44e7-842e-776ee6255746 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:22.256228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078973c-222a-44e7-842e-776ee6255746 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:22.257901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 153/297] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:22.262804 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da049a-2c09-4fa9-b292-68a2a44acfea None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:22.263658 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da049a-2c09-4fa9-b292-68a2a44acfea None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:22.264166 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da049a-2c09-4fa9-b292-68a2a44acfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:22.285454 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-46da049a-2c09-4fa9-b292-68a2a44acfea None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:22.287047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-46da049a-2c09-4fa9-b292-68a2a44acfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:22.289386 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e9db5-ac9c-4c13-9516-d48971bb817a None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:22.289386 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e9db5-ac9c-4c13-9516-d48971bb817a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:22.289386 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e9db5-ac9c-4c13-9516-d48971bb817a None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:22.290130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 154/298] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:22.296785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71519d6c-f65d-4db2-9f12-36de7b4d4ccb None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:22.297479 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71519d6c-f65d-4db2-9f12-36de7b4d4ccb None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:22.297973 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71519d6c-f65d-4db2-9f12-36de7b4d4ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:22.331069 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-71519d6c-f65d-4db2-9f12-36de7b4d4ccb None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:22.335740 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-71519d6c-f65d-4db2-9f12-36de7b4d4ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:22.393499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 145/299] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:22.393499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da049a-2c09-4fa9-b292-68a2a44acfea None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:22.417635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:22.445290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 155/300] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:17:22.501759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da049a-2c09-4fa9-b292-68a2a44acfea None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:22.538740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3d54d-23a5-40ec-90d0-f5c43615ea67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:22.539388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3d54d-23a5-40ec-90d0-f5c43615ea67 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:22.539660 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3d54d-23a5-40ec-90d0-f5c43615ea67 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:22.539927 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3d54d-23a5-40ec-90d0-f5c43615ea67 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:22.550991 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3d54d-23a5-40ec-90d0-f5c43615ea67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:22.555793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-10a3d54d-23a5-40ec-90d0-f5c43615ea67 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:17:22.555793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:22.555793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:22.555793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:22.555793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:22.555793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:22.555793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:22.555793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:22.555793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:22.555793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:22.555793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:22.555793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:22.555793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:22.555793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:22.555793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:22.555793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:22.556812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:22.556812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:22.556812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:22.556812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:22.556812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:22.556812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:22.556812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:22.556812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:22.556812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:22.556812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:22.556812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:22.556812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:22.556812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:22.556812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:22.556812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:22.556812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:22.557736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:22.557736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:22.557736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:22.557736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:22.557736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:22.557736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:22.557736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:22.557736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:22.557736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:22.557736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:22.557736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:17:22.557736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:22.557736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 146/301] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:22.566545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71519d6c-f65d-4db2-9f12-36de7b4d4ccb None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:22.628352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:22.676710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71519d6c-f65d-4db2-9f12-36de7b4d4ccb None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:22.682631 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3d54d-23a5-40ec-90d0-f5c43615ea67 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:22.712424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8258b7d-c7e1-4ff8-a1c4-634c3d9c8592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:22.713047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8258b7d-c7e1-4ff8-a1c4-634c3d9c8592 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:22.713332 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8258b7d-c7e1-4ff8-a1c4-634c3d9c8592 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:22.713633 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8258b7d-c7e1-4ff8-a1c4-634c3d9c8592 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:22.714309 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8258b7d-c7e1-4ff8-a1c4-634c3d9c8592 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:22.714608 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8258b7d-c7e1-4ff8-a1c4-634c3d9c8592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:22.715996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8258b7d-c7e1-4ff8-a1c4-634c3d9c8592 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:22.725244 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 156/302] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:22.730446 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8258b7d-c7e1-4ff8-a1c4-634c3d9c8592 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:22.778619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:22.798200 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3d54d-23a5-40ec-90d0-f5c43615ea67 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:22.839904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a325617-984f-4a09-82c7-8862c738f0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:22.840653 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a325617-984f-4a09-82c7-8862c738f0bf None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:22.840934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a325617-984f-4a09-82c7-8862c738f0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:22.841201 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a325617-984f-4a09-82c7-8862c738f0bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:22.849832 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8258b7d-c7e1-4ff8-a1c4-634c3d9c8592 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:22.853551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a325617-984f-4a09-82c7-8862c738f0bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:22.858354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-2a325617-984f-4a09-82c7-8862c738f0bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:22.858354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:22.858354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:22.858354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:22.858354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:22.858354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:22.858354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:22.858354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:22.858354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:22.858354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:22.858354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:22.858354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:22.858354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:22.858354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:22.858354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:22.858354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:22.859309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:22.859309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:22.859309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:22.859309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:22.859309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:22.859309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:22.859309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:22.859309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:22.859309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:22.859309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:22.859309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:22.859309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:22.859309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:22.859309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:22.859309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:22.859309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:22.865123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:22.865123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:22.865123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:22.865123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:22.865123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:22.865123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:22.865123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:22.865123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:22.865123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:22.865123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:22.865123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:22.865123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:22.865123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 147/303] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:17:22.865123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a325617-984f-4a09-82c7-8862c738f0bf None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:22.883738 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:22.899511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd71aa-3627-4458-a111-0f76773a9c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:22.900147 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd71aa-3627-4458-a111-0f76773a9c3e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:22.900414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd71aa-3627-4458-a111-0f76773a9c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:22.900691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd71aa-3627-4458-a111-0f76773a9c3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:22.901853 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd71aa-3627-4458-a111-0f76773a9c3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:22.903309 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd71aa-3627-4458-a111-0f76773a9c3e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:22.904888 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 157/304] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:22.905675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd71aa-3627-4458-a111-0f76773a9c3e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:22.989803 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a325617-984f-4a09-82c7-8862c738f0bf None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:23.028491 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd71aa-3627-4458-a111-0f76773a9c3e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:23.032780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b356a6c-6bd2-4fac-a6c7-7e1df1b89c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:23.033725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b356a6c-6bd2-4fac-a6c7-7e1df1b89c4d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:23.034186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b356a6c-6bd2-4fac-a6c7-7e1df1b89c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:23.034618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b356a6c-6bd2-4fac-a6c7-7e1df1b89c4d None admin] PATH_INFO: `/v3/users/11570187b57246b08efecafedd549e56` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:23.050422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b356a6c-6bd2-4fac-a6c7-7e1df1b89c4d None admin] RBAC: Authorizing `identity:get_user(user_id=11570187b57246b08efecafedd549e56)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:23.052220 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b356a6c-6bd2-4fac-a6c7-7e1df1b89c4d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:23.059348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 148/305] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:22 2022] GET /identity/v3/users/11570187b57246b08efecafedd549e56 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:23.060525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b356a6c-6bd2-4fac-a6c7-7e1df1b89c4d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:23.064765 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:23.073530 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b5706-7544-40da-9370-9f49f7d8d42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:23.074235 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b5706-7544-40da-9370-9f49f7d8d42b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:23.074513 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b5706-7544-40da-9370-9f49f7d8d42b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:23.074786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b5706-7544-40da-9370-9f49f7d8d42b None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:23.075457 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b5706-7544-40da-9370-9f49f7d8d42b None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:23.075757 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b5706-7544-40da-9370-9f49f7d8d42b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:23.077186 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b5706-7544-40da-9370-9f49f7d8d42b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:23.087851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 158/306] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:23.088663 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b5706-7544-40da-9370-9f49f7d8d42b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:23.144801 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:23.178484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b356a6c-6bd2-4fac-a6c7-7e1df1b89c4d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:23.195991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b5706-7544-40da-9370-9f49f7d8d42b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:23.213030 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714ae8c-1bc5-461c-8377-46c181f61329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:23.213683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714ae8c-1bc5-461c-8377-46c181f61329 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:23.213962 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714ae8c-1bc5-461c-8377-46c181f61329 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:23.214230 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714ae8c-1bc5-461c-8377-46c181f61329 None admin] PATH_INFO: `/v3/groups` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:23.214861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714ae8c-1bc5-461c-8377-46c181f61329 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:23.216312 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714ae8c-1bc5-461c-8377-46c181f61329 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:23.229819 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d757b7-82b1-456e-a0d6-594cd8a15605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:23.230492 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d757b7-82b1-456e-a0d6-594cd8a15605 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:23.230770 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d757b7-82b1-456e-a0d6-594cd8a15605 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:23.231040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d757b7-82b1-456e-a0d6-594cd8a15605 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:23.231765 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d757b7-82b1-456e-a0d6-594cd8a15605 None admin] RBAC: Adding query filter params (role.id=50f15caac85247d9a4b34ea4e25850a1, user.id=11570187b57246b08efecafedd549e56, scope.system=all) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:23.232071 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d757b7-82b1-456e-a0d6-594cd8a15605 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:23.233544 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d757b7-82b1-456e-a0d6-594cd8a15605 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:23.233710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 149/307] 10.222.0.52 () {60 vars in 1134 bytes} [Mon Aug 29 20:17:23 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:17:23.234568 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714ae8c-1bc5-461c-8377-46c181f61329 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:23.239253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 159/308] 10.222.0.52 () {56 vars in 1308 bytes} [Mon Aug 29 20:17:23 2022] GET /identity/v3/role_assignments?user.id=11570187b57246b08efecafedd549e56&scope.system=all&role.id=50f15caac85247d9a4b34ea4e25850a1 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:23.240620 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7def5-d662-4d06-91ad-d88ecb3912c7 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:23.240912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7def5-d662-4d06-91ad-d88ecb3912c7 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:23.241186 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7def5-d662-4d06-91ad-d88ecb3912c7 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:23.242803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 160/309] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:23.249008 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e8947-49d1-4834-b1fc-0511c1093f55 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:23.249317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e8947-49d1-4834-b1fc-0511c1093f55 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:23.249605 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e8947-49d1-4834-b1fc-0511c1093f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:23.270706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-313e8947-49d1-4834-b1fc-0511c1093f55 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:23.271965 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-313e8947-49d1-4834-b1fc-0511c1093f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:23.358651 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:23.372702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 161/310] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:23.402084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714ae8c-1bc5-461c-8377-46c181f61329 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:23.441820 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c36242-274a-4483-980f-828723408883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:23.442466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c36242-274a-4483-980f-828723408883 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:23.442744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c36242-274a-4483-980f-828723408883 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:23.443011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c36242-274a-4483-980f-828723408883 None admin] PATH_INFO: `/v3/users/1982bd90daf1403eb2df40c35e9be099` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:23.444151 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c36242-274a-4483-980f-828723408883 None admin] RBAC: Authorizing `identity:get_user(user_id=1982bd90daf1403eb2df40c35e9be099)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:23.445663 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c36242-274a-4483-980f-828723408883 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:23.447417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 150/311] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:23 2022] GET /identity/v3/users/1982bd90daf1403eb2df40c35e9be099 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:23.452926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e8947-49d1-4834-b1fc-0511c1093f55 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:23.507189 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:23.564213 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e8947-49d1-4834-b1fc-0511c1093f55 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:23.601039 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f26c60-f45b-4f54-bbfb-a456554ec570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:23.602020 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f26c60-f45b-4f54-bbfb-a456554ec570 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:23.602474 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f26c60-f45b-4f54-bbfb-a456554ec570 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:23.602944 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f26c60-f45b-4f54-bbfb-a456554ec570 None admin] PATH_INFO: `/v3/system/users/1982bd90daf1403eb2df40c35e9be099/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:23.604655 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f26c60-f45b-4f54-bbfb-a456554ec570 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1982bd90daf1403eb2df40c35e9be099, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:23.606301 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f26c60-f45b-4f54-bbfb-a456554ec570 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:23.616551 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 162/312] 10.222.0.52 () {58 vars in 1334 bytes} [Mon Aug 29 20:17:23 2022] PUT /identity/v3/system/users/1982bd90daf1403eb2df40c35e9be099/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:17:23.669647 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c36242-274a-4483-980f-828723408883 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:23.788680 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c36242-274a-4483-980f-828723408883 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:23.820353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:23.826984 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b758b8-90e0-43e4-8e8c-f38263735616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:23.827636 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b758b8-90e0-43e4-8e8c-f38263735616 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:23.827917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b758b8-90e0-43e4-8e8c-f38263735616 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:23.828247 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b758b8-90e0-43e4-8e8c-f38263735616 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:23.839488 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b758b8-90e0-43e4-8e8c-f38263735616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:23.845153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-55b758b8-90e0-43e4-8e8c-f38263735616 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:17:23.845153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:23.845153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:23.845153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:23.845153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:23.845153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:23.845153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:23.845153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:23.845153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:23.845153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:23.845153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:23.845153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:23.845153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:23.845153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:23.845153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:23.845153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:23.846057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:23.846057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:23.846057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:23.846057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:23.846057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:23.846057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:23.846057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:23.846057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:23.846057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:23.846057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:23.846057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:23.846057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:23.846057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:23.846057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:23.846057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:23.846057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:23.846841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:23.846841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:23.846841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:23.846841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:23.846841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:23.846841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:23.846841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:23.846841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:23.846841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:23.846841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:23.846841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:17:23.846841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:23.846841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 151/313] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:23.853964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f26c60-f45b-4f54-bbfb-a456554ec570 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:23.959836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f26c60-f45b-4f54-bbfb-a456554ec570 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:23.970279 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:23.997821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5122dbb-75dd-4518-9847-9376942b5873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:23.998494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5122dbb-75dd-4518-9847-9376942b5873 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:23.998810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5122dbb-75dd-4518-9847-9376942b5873 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:23.999087 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5122dbb-75dd-4518-9847-9376942b5873 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:24.000230 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5122dbb-75dd-4518-9847-9376942b5873 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:24.000544 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5122dbb-75dd-4518-9847-9376942b5873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:24.001971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5122dbb-75dd-4518-9847-9376942b5873 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:24.011216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 163/314] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:24.016976 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b758b8-90e0-43e4-8e8c-f38263735616 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:24.135080 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b758b8-90e0-43e4-8e8c-f38263735616 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:24.171075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c2f99-10a9-40cf-88d9-9ba4169bf8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:24.172053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c2f99-10a9-40cf-88d9-9ba4169bf8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:24.172532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c2f99-10a9-40cf-88d9-9ba4169bf8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:24.172980 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c2f99-10a9-40cf-88d9-9ba4169bf8a6 None admin] PATH_INFO: `/v3/users/ae93316e821c422bbcc6cf885022f1b1` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:24.174357 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c2f99-10a9-40cf-88d9-9ba4169bf8a6 None admin] RBAC: Authorizing `identity:get_user(user_id=ae93316e821c422bbcc6cf885022f1b1)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:24.176020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c2f99-10a9-40cf-88d9-9ba4169bf8a6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:24.178170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 152/315] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:24 2022] GET /identity/v3/users/ae93316e821c422bbcc6cf885022f1b1 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:24.184250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5122dbb-75dd-4518-9847-9376942b5873 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:24.295245 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5122dbb-75dd-4518-9847-9376942b5873 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:24.331863 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a093b6-8a8d-4732-be3a-fda72413fe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:24.332485 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a093b6-8a8d-4732-be3a-fda72413fe6a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:24.332764 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a093b6-8a8d-4732-be3a-fda72413fe6a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:24.333034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a093b6-8a8d-4732-be3a-fda72413fe6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:24.378255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:24.417735 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a093b6-8a8d-4732-be3a-fda72413fe6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:24.419404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a093b6-8a8d-4732-be3a-fda72413fe6a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:24.529424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 164/316] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:24.538876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c2f99-10a9-40cf-88d9-9ba4169bf8a6 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:24.604078 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:24.648981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c2f99-10a9-40cf-88d9-9ba4169bf8a6 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:24.684401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88217a2-9784-4ed3-bd96-f9eb02c4a194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:24.685414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88217a2-9784-4ed3-bd96-f9eb02c4a194 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:24.685980 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88217a2-9784-4ed3-bd96-f9eb02c4a194 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:24.686444 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88217a2-9784-4ed3-bd96-f9eb02c4a194 None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:24.687831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88217a2-9784-4ed3-bd96-f9eb02c4a194 None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:24.689584 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88217a2-9784-4ed3-bd96-f9eb02c4a194 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:24.691697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 153/317] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:24 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:24.701399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a093b6-8a8d-4732-be3a-fda72413fe6a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:24.771616 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:24.807021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a093b6-8a8d-4732-be3a-fda72413fe6a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:24.850912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04503576-e65a-48bd-8a57-a7247c47fc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:24.851524 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04503576-e65a-48bd-8a57-a7247c47fc9d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:24.851808 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04503576-e65a-48bd-8a57-a7247c47fc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:24.852081 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04503576-e65a-48bd-8a57-a7247c47fc9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:24.852813 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04503576-e65a-48bd-8a57-a7247c47fc9d None admin] RBAC: Adding query filter params (role.id=50f15caac85247d9a4b34ea4e25850a1, scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4, user.id=ae93316e821c422bbcc6cf885022f1b1) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:24.853123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04503576-e65a-48bd-8a57-a7247c47fc9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:24.854674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04503576-e65a-48bd-8a57-a7247c47fc9d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:24.861085 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 165/318] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:17:24 2022] GET /identity/v3/role_assignments?user.id=ae93316e821c422bbcc6cf885022f1b1&scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4&role.id=50f15caac85247d9a4b34ea4e25850a1 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:25.282738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa259eb5-5a48-4c78-ae98-7fc870092c8b None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.283164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa259eb5-5a48-4c78-ae98-7fc870092c8b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.283432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa259eb5-5a48-4c78-ae98-7fc870092c8b None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.285021 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 154/319] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:25.290500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d82b8d-2d7f-4145-9baa-dd8d568d0e5c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.290825 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d82b8d-2d7f-4145-9baa-dd8d568d0e5c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.291047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d82b8d-2d7f-4145-9baa-dd8d568d0e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.313533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c5d82b8d-2d7f-4145-9baa-dd8d568d0e5c None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:25.314746 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c5d82b8d-2d7f-4145-9baa-dd8d568d0e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:25.392265 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5cf3d-395d-443e-ad9c-e88604397cb7 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.392588 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5cf3d-395d-443e-ad9c-e88604397cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.392951 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5cf3d-395d-443e-ad9c-e88604397cb7 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.394189 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 155/320] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:25.399838 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe02061-5617-4343-8ac2-590cd4e4b5d4 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.400115 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe02061-5617-4343-8ac2-590cd4e4b5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.400462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 166/321] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:17:25.400891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe02061-5617-4343-8ac2-590cd4e4b5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.422835 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7fe02061-5617-4343-8ac2-590cd4e4b5d4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:25.424122 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7fe02061-5617-4343-8ac2-590cd4e4b5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:25.525594 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 156/322] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:17:25.674387 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca41ea-d501-451e-88b0-6c847afba161 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.674564 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca41ea-d501-451e-88b0-6c847afba161 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.674829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca41ea-d501-451e-88b0-6c847afba161 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.676200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 167/323] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:25.682419 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c554db5-275e-46da-88c1-33c17088c46d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.682974 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c554db5-275e-46da-88c1-33c17088c46d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.682974 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c554db5-275e-46da-88c1-33c17088c46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.702622 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3c554db5-275e-46da-88c1-33c17088c46d None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:25.703823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3c554db5-275e-46da-88c1-33c17088c46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:25.762433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:25.781005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 157/324] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:25.788417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca41ea-d501-451e-88b0-6c847afba161 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:25.795175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c554db5-275e-46da-88c1-33c17088c46d None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:25.868306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:25.909747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca41ea-d501-451e-88b0-6c847afba161 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:25.917922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c554db5-275e-46da-88c1-33c17088c46d None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:25.950705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105ea76-75d0-449f-a632-f8056711a765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:25.951533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105ea76-75d0-449f-a632-f8056711a765 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.951812 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105ea76-75d0-449f-a632-f8056711a765 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.952155 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105ea76-75d0-449f-a632-f8056711a765 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.959229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df36d78-abf3-4208-8a26-277b2bc507a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:25.960115 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36d78-abf3-4208-8a26-277b2bc507a9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.960529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36d78-abf3-4208-8a26-277b2bc507a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.960945 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36d78-abf3-4208-8a26-277b2bc507a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.962134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df36d78-abf3-4208-8a26-277b2bc507a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:25.963608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df36d78-abf3-4208-8a26-277b2bc507a9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:25.965222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105ea76-75d0-449f-a632-f8056711a765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:25.965556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 158/325] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:25.971265 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df36d78-abf3-4208-8a26-277b2bc507a9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:25.974555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-c105ea76-75d0-449f-a632-f8056711a765 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:17:25.974555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:25.974555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:25.974555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:25.974555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:25.974555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:25.974555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:25.974555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:25.974555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:25.974555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:25.974555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:25.974555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:25.974555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:25.974555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:25.974555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:25.974555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:25.975477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:25.975477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:25.975477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:25.975477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:25.975477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:25.975477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:25.975477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:25.975477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:25.975477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:25.975477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:25.975477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:25.975477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:25.975477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:25.975477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:25.975477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:25.975477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:25.976267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:25.976267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:25.976267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:25.976267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:25.976267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:25.976267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:25.976267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:25.976267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:25.976267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:25.976267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:25.976267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:17:25.976267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:25.976267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 168/326] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:25.981546 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105ea76-75d0-449f-a632-f8056711a765 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:26.039347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:26.087057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df36d78-abf3-4208-8a26-277b2bc507a9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:26.087308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105ea76-75d0-449f-a632-f8056711a765 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:26.112167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:26.123352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7c967-39c7-4d9b-9e9b-27db9b1c67e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:26.123581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e280355-7c7c-48e2-9a1e-f3bdf1c147d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:26.123935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7c967-39c7-4d9b-9e9b-27db9b1c67e2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:26.124186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e280355-7c7c-48e2-9a1e-f3bdf1c147d7 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:26.124307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7c967-39c7-4d9b-9e9b-27db9b1c67e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:26.124460 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e280355-7c7c-48e2-9a1e-f3bdf1c147d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:26.124546 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7c967-39c7-4d9b-9e9b-27db9b1c67e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:26.124820 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e280355-7c7c-48e2-9a1e-f3bdf1c147d7 None admin] PATH_INFO: `/v3/groups` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:26.125561 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7c967-39c7-4d9b-9e9b-27db9b1c67e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:26.125677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e280355-7c7c-48e2-9a1e-f3bdf1c147d7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:26.125749 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7c967-39c7-4d9b-9e9b-27db9b1c67e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:26.126816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e280355-7c7c-48e2-9a1e-f3bdf1c147d7 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:26.126962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7c967-39c7-4d9b-9e9b-27db9b1c67e2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:26.136110 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 169/327] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:26.137013 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7c967-39c7-4d9b-9e9b-27db9b1c67e2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:26.147852 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 159/328] 10.222.0.52 () {60 vars in 1134 bytes} [Mon Aug 29 20:17:25 2022] POST /identity/v3/groups => generated 226 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:17:26.148673 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e280355-7c7c-48e2-9a1e-f3bdf1c147d7 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:26.255216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7c967-39c7-4d9b-9e9b-27db9b1c67e2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:26.273013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e280355-7c7c-48e2-9a1e-f3bdf1c147d7 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:26.289090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:26.301684 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0c7d9-8720-4671-8baf-cc7bd9acb73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:26.302596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0c7d9-8720-4671-8baf-cc7bd9acb73a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:26.302596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0c7d9-8720-4671-8baf-cc7bd9acb73a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:26.302834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0c7d9-8720-4671-8baf-cc7bd9acb73a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:26.315733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e653e1f-cf8b-4781-b52d-1533431a26ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:26.316416 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e653e1f-cf8b-4781-b52d-1533431a26ac None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:26.316707 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e653e1f-cf8b-4781-b52d-1533431a26ac None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:26.316963 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e653e1f-cf8b-4781-b52d-1533431a26ac None admin] PATH_INFO: `/v3/users/11570187b57246b08efecafedd549e56` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:26.318238 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e653e1f-cf8b-4781-b52d-1533431a26ac None admin] RBAC: Authorizing `identity:get_user(user_id=11570187b57246b08efecafedd549e56)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:26.318351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0c7d9-8720-4671-8baf-cc7bd9acb73a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:26.319792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e653e1f-cf8b-4781-b52d-1533431a26ac None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:26.321650 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 160/329] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:26 2022] GET /identity/v3/users/11570187b57246b08efecafedd549e56 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:26.323880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-bba0c7d9-8720-4671-8baf-cc7bd9acb73a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:26.323880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:26.323880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:26.323880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:26.323880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:26.323880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:26.323880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:26.323880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:26.323880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:26.323880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:26.323880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:26.323880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:26.323880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:26.323880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:26.323880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:26.323880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:26.324897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:26.324897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:26.324897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:26.324897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:26.324897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:26.324897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:26.324897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:26.324897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:26.324897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:26.324897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:26.324897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:26.324897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:26.324897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:26.324897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:26.324897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:26.324897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:26.325725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:26.325725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:26.325725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:26.325725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:26.325725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:26.325725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:26.325725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:26.325725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:26.325725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:26.325725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:26.325725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:26.325725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:26.327629 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e653e1f-cf8b-4781-b52d-1533431a26ac None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:26.330830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 170/330] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:26.331321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0c7d9-8720-4671-8baf-cc7bd9acb73a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:26.387419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:26.448629 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e653e1f-cf8b-4781-b52d-1533431a26ac None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:26.461522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0c7d9-8720-4671-8baf-cc7bd9acb73a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:26.488847 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcdc9e-1db7-43bb-9873-2f5fd8e21a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:26.489581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcdc9e-1db7-43bb-9873-2f5fd8e21a84 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:26.489857 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcdc9e-1db7-43bb-9873-2f5fd8e21a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:26.490127 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcdc9e-1db7-43bb-9873-2f5fd8e21a84 None admin] PATH_INFO: `/v3/system/users/11570187b57246b08efecafedd549e56/roles/50f15caac85247d9a4b34ea4e25850a1` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:26.491628 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcdc9e-1db7-43bb-9873-2f5fd8e21a84 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=11570187b57246b08efecafedd549e56, role_id=50f15caac85247d9a4b34ea4e25850a1)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:26.494463 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcdc9e-1db7-43bb-9873-2f5fd8e21a84 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:26.503793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1143e-aee6-4bd8-8b46-1c3d25d3865a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:26.504465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1143e-aee6-4bd8-8b46-1c3d25d3865a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:26.504737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1143e-aee6-4bd8-8b46-1c3d25d3865a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:26.504998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1143e-aee6-4bd8-8b46-1c3d25d3865a None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:26.505742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1143e-aee6-4bd8-8b46-1c3d25d3865a None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:26.506018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1143e-aee6-4bd8-8b46-1c3d25d3865a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:26.507560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1143e-aee6-4bd8-8b46-1c3d25d3865a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:26.509576 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 161/331] 10.222.0.52 () {58 vars in 1334 bytes} [Mon Aug 29 20:17:26 2022] PUT /identity/v3/system/users/11570187b57246b08efecafedd549e56/roles/50f15caac85247d9a4b34ea4e25850a1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:17:26.523506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 171/332] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:26.525212 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcdc9e-1db7-43bb-9873-2f5fd8e21a84 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:26.593271 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:26.661247 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcdc9e-1db7-43bb-9873-2f5fd8e21a84 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:26.705270 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d85382-84a4-44b2-83ec-8a68a2c3915f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:26.705975 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d85382-84a4-44b2-83ec-8a68a2c3915f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:26.706214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d85382-84a4-44b2-83ec-8a68a2c3915f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:26.706471 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d85382-84a4-44b2-83ec-8a68a2c3915f None admin] PATH_INFO: `/v3/users/1982bd90daf1403eb2df40c35e9be099` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:26.707636 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d85382-84a4-44b2-83ec-8a68a2c3915f None admin] RBAC: Authorizing `identity:get_user(user_id=1982bd90daf1403eb2df40c35e9be099)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:26.709151 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d85382-84a4-44b2-83ec-8a68a2c3915f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:26.711240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 162/333] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:26 2022] GET /identity/v3/users/1982bd90daf1403eb2df40c35e9be099 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:26.717672 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1143e-aee6-4bd8-8b46-1c3d25d3865a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:26.869016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1143e-aee6-4bd8-8b46-1c3d25d3865a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:26.880791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:26.917239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f50204-a8d7-4bed-99fa-1a7ff9faa209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:26.918411 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f50204-a8d7-4bed-99fa-1a7ff9faa209 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:26.918914 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f50204-a8d7-4bed-99fa-1a7ff9faa209 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:26.919394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f50204-a8d7-4bed-99fa-1a7ff9faa209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:26.920813 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f50204-a8d7-4bed-99fa-1a7ff9faa209 None admin] RBAC: Adding query filter params (role.id=73f8d83949b241d2bcd58d267657768a, user.id=1982bd90daf1403eb2df40c35e9be099, scope.system=all) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:26.921391 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f50204-a8d7-4bed-99fa-1a7ff9faa209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:26.924327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f50204-a8d7-4bed-99fa-1a7ff9faa209 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:26.951725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 172/334] 10.222.0.52 () {56 vars in 1308 bytes} [Mon Aug 29 20:17:26 2022] GET /identity/v3/role_assignments?user.id=1982bd90daf1403eb2df40c35e9be099&scope.system=all&role.id=73f8d83949b241d2bcd58d267657768a => generated 510 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:28.539764 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde25e2-0eab-4a0a-b44f-5e2ae2315751 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:28.540559 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde25e2-0eab-4a0a-b44f-5e2ae2315751 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:28.540559 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde25e2-0eab-4a0a-b44f-5e2ae2315751 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:28.542012 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 163/335] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:28.550923 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdadff-4529-4bdf-9033-6feb204c7fd4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:28.552344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdadff-4529-4bdf-9033-6feb204c7fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:28.553110 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdadff-4529-4bdf-9033-6feb204c7fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:28.580990 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-92fdadff-4529-4bdf-9033-6feb204c7fd4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:28.582268 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-92fdadff-4529-4bdf-9033-6feb204c7fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:28.672406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 173/336] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:29.021187 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e39ef2-1e9c-49dd-8187-b1e88004f378 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:29.021607 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e39ef2-1e9c-49dd-8187-b1e88004f378 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:29.021799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e39ef2-1e9c-49dd-8187-b1e88004f378 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:29.023362 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 164/337] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:29.031318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282f94b-177f-4ca5-8435-534419bad7c4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:29.031634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282f94b-177f-4ca5-8435-534419bad7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:29.031870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282f94b-177f-4ca5-8435-534419bad7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:29.059833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1282f94b-177f-4ca5-8435-534419bad7c4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:29.061096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1282f94b-177f-4ca5-8435-534419bad7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:29.159731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 174/338] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:29.282558 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e39ef2-1e9c-49dd-8187-b1e88004f378 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:29.434941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d95fe6-c2b9-4780-9f9b-b81834ce030b None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:29.435294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d95fe6-c2b9-4780-9f9b-b81834ce030b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:29.435490 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d95fe6-c2b9-4780-9f9b-b81834ce030b None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:29.437453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 175/339] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:29.438114 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e39ef2-1e9c-49dd-8187-b1e88004f378 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:29.446714 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0620db-cfaa-4909-bb3e-faa3e36ea0b8 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:29.447200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0620db-cfaa-4909-bb3e-faa3e36ea0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:29.447675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0620db-cfaa-4909-bb3e-faa3e36ea0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:29.455305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:29.483218 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3f0620db-cfaa-4909-bb3e-faa3e36ea0b8 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:29.484560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3f0620db-cfaa-4909-bb3e-faa3e36ea0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:29.487261 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa380c-84cf-44a2-87c9-95dd4fac5720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:29.487925 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa380c-84cf-44a2-87c9-95dd4fac5720 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:29.488301 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa380c-84cf-44a2-87c9-95dd4fac5720 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:29.488721 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa380c-84cf-44a2-87c9-95dd4fac5720 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:29.503040 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa380c-84cf-44a2-87c9-95dd4fac5720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:29.508524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-bfaa380c-84cf-44a2-87c9-95dd4fac5720 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:29.508524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:29.508524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:29.508524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:29.508524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:29.508524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:29.508524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:29.508524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:29.508524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:29.508524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:29.508524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:29.508524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:29.508524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:29.508524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:29.508524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:29.508524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:29.509573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:29.509573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:29.509573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:29.509573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:29.509573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:29.509573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:29.509573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:29.509573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:29.509573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:29.509573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:29.509573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:29.509573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:29.509573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:29.509573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:29.509573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:29.509573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:29.510791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:29.510791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:29.510791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:29.510791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:29.510791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:29.510791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:29.510791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:29.510791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:29.510791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:29.510791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:29.510791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:29.510791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:29.510791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 165/340] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:29.518099 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa380c-84cf-44a2-87c9-95dd4fac5720 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:29.527544 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:29.632362 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 176/341] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:29.633165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0620db-cfaa-4909-bb3e-faa3e36ea0b8 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:29.727655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa380c-84cf-44a2-87c9-95dd4fac5720 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:29.777389 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5af8f-8222-45b4-92b2-1ea43ee3d0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:29.778035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5af8f-8222-45b4-92b2-1ea43ee3d0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:29.778320 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5af8f-8222-45b4-92b2-1ea43ee3d0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:29.778595 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5af8f-8222-45b4-92b2-1ea43ee3d0f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:29.779272 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5af8f-8222-45b4-92b2-1ea43ee3d0f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:29.779574 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5af8f-8222-45b4-92b2-1ea43ee3d0f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:29.781033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5af8f-8222-45b4-92b2-1ea43ee3d0f9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:29.797103 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 166/342] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:29.799033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fff3fe-fd17-4bfe-baae-272f7f87a7ff None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:29.799386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fff3fe-fd17-4bfe-baae-272f7f87a7ff None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:29.799670 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fff3fe-fd17-4bfe-baae-272f7f87a7ff None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:29.801331 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 167/343] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:29.803802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fff3fe-fd17-4bfe-baae-272f7f87a7ff None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:29.875671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0620db-cfaa-4909-bb3e-faa3e36ea0b8 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:29.886467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:29.976372 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38481724-11d8-4188-bccf-6f867a011901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:29.977120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38481724-11d8-4188-bccf-6f867a011901 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:29.977471 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38481724-11d8-4188-bccf-6f867a011901 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:29.977744 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38481724-11d8-4188-bccf-6f867a011901 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:29.978665 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fff3fe-fd17-4bfe-baae-272f7f87a7ff None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:30.004293 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38481724-11d8-4188-bccf-6f867a011901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:30.009466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-38481724-11d8-4188-bccf-6f867a011901 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:30.009466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:30.009466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:30.009466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:30.009466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:30.009466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:30.009466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:30.009466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:30.009466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:30.009466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:30.009466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:30.009466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:30.009466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:30.009466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:30.009466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:30.009466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:30.011810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:30.011810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:30.011810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:30.011810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:30.011810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:30.011810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:30.011810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:30.011810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:30.011810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:30.011810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:30.011810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:30.011810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:30.011810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:30.011810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:30.011810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:30.011810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:30.013852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:30.013852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:30.013852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:30.013852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:30.013852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:30.013852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:30.013852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:30.013852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:30.013852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:30.013852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:30.013852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:30.013852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:30.013852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 177/344] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:17:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:30.020265 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e437f3-fbbc-4539-8d66-26d8939ccded None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:30.020265 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e437f3-fbbc-4539-8d66-26d8939ccded None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:30.020265 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e437f3-fbbc-4539-8d66-26d8939ccded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:30.028245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6383cf3-440d-44ee-b9b0-f39279901f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:30.028852 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6383cf3-440d-44ee-b9b0-f39279901f63 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:30.029129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6383cf3-440d-44ee-b9b0-f39279901f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:30.029424 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6383cf3-440d-44ee-b9b0-f39279901f63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:30.048672 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b9e437f3-fbbc-4539-8d66-26d8939ccded None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:30.050903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b9e437f3-fbbc-4539-8d66-26d8939ccded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:30.070073 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:30.113681 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6383cf3-440d-44ee-b9b0-f39279901f63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:30.115216 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6383cf3-440d-44ee-b9b0-f39279901f63 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:30.148734 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 178/345] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:30.150113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e437f3-fbbc-4539-8d66-26d8939ccded None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:30.160484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:30.231920 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 168/346] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:30.232617 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6383cf3-440d-44ee-b9b0-f39279901f63 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:30.343467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6383cf3-440d-44ee-b9b0-f39279901f63 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:30.351741 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e437f3-fbbc-4539-8d66-26d8939ccded None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:30.391036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be206c-0838-4de6-bbe0-ea63eb07df5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:30.391708 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be206c-0838-4de6-bbe0-ea63eb07df5f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:30.391988 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be206c-0838-4de6-bbe0-ea63eb07df5f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:30.392262 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be206c-0838-4de6-bbe0-ea63eb07df5f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:30.397772 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:30.420091 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be206c-0838-4de6-bbe0-ea63eb07df5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:30.428939 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71688bc5-a955-443c-87bf-279c06b771da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:30.429603 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71688bc5-a955-443c-87bf-279c06b771da None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:30.429938 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71688bc5-a955-443c-87bf-279c06b771da None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:30.430215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71688bc5-a955-443c-87bf-279c06b771da None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:30.430964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71688bc5-a955-443c-87bf-279c06b771da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:30.431269 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71688bc5-a955-443c-87bf-279c06b771da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:30.434507 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71688bc5-a955-443c-87bf-279c06b771da None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:30.436167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-90be206c-0838-4de6-bbe0-ea63eb07df5f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:17:30.436167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:30.436167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:30.436167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:30.436167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:30.436167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:30.436167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:30.436167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:30.436167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:30.436167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:30.436167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:30.436167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:30.436167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:30.436167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:30.436167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:30.436167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:30.437075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:30.437075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:30.437075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:30.437075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:30.437075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:30.437075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:30.437075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:30.437075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:30.437075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:30.437075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:30.437075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:30.437075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:30.437075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:30.437075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:30.437075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:30.437075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:30.437967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:30.437967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:30.437967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:30.437967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:30.437967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:30.437967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:30.437967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:30.437967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:30.437967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:30.437967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:30.437967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:17:30.437967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:30.437967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 169/347] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:30.440073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be206c-0838-4de6-bbe0-ea63eb07df5f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:30.455962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 179/348] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:17:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:30.456699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71688bc5-a955-443c-87bf-279c06b771da None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:30.480804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:30.617132 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be206c-0838-4de6-bbe0-ea63eb07df5f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:30.627299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71688bc5-a955-443c-87bf-279c06b771da None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:30.659551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192046f-bff6-4296-97a7-193d7be329d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:30.660602 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192046f-bff6-4296-97a7-193d7be329d0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:30.661132 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192046f-bff6-4296-97a7-193d7be329d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:30.661655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192046f-bff6-4296-97a7-193d7be329d0 None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:30.663124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192046f-bff6-4296-97a7-193d7be329d0 None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:30.664618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192046f-bff6-4296-97a7-193d7be329d0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:30.667618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 170/349] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:30 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:30.667618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192046f-bff6-4296-97a7-193d7be329d0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:30.674677 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d0e74-2c20-46f1-a375-ec5a0f7728c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:30.675303 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d0e74-2c20-46f1-a375-ec5a0f7728c4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:30.675499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d0e74-2c20-46f1-a375-ec5a0f7728c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:30.676188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d0e74-2c20-46f1-a375-ec5a0f7728c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:30.676936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d0e74-2c20-46f1-a375-ec5a0f7728c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:30.677240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d0e74-2c20-46f1-a375-ec5a0f7728c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:30.678822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d0e74-2c20-46f1-a375-ec5a0f7728c4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:30.689654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 180/350] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:30.690889 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097b186-c87b-479c-bb88-c32adb57655b None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:30.691172 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097b186-c87b-479c-bb88-c32adb57655b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:30.691438 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097b186-c87b-479c-bb88-c32adb57655b None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:30.696325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 181/351] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:30.697284 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097b186-c87b-479c-bb88-c32adb57655b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:30.758702 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:30.809640 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:30.811630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192046f-bff6-4296-97a7-193d7be329d0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:30.852417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097b186-c87b-479c-bb88-c32adb57655b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:30.863152 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedc8da-e06b-4bf7-a6f9-4b5d0de15f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:30.863152 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedc8da-e06b-4bf7-a6f9-4b5d0de15f63 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:30.863152 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedc8da-e06b-4bf7-a6f9-4b5d0de15f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:30.863585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedc8da-e06b-4bf7-a6f9-4b5d0de15f63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:30.893069 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37131c-b4a6-44ce-9eb5-ab8278638970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:30.893762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37131c-b4a6-44ce-9eb5-ab8278638970 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:30.894736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37131c-b4a6-44ce-9eb5-ab8278638970 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:30.895570 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37131c-b4a6-44ce-9eb5-ab8278638970 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:30.920176 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37131c-b4a6-44ce-9eb5-ab8278638970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:30.926898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-1f37131c-b4a6-44ce-9eb5-ab8278638970 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:30.926898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:30.926898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:30.926898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:30.926898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:30.926898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:30.926898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:30.926898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:30.926898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:30.926898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:30.926898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:30.926898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:30.926898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:30.926898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:30.926898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:30.926898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:30.927810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:30.927810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:30.927810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:30.927810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:30.927810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:30.927810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:30.927810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:30.927810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:30.927810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:30.927810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:30.927810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:30.927810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:30.927810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:30.927810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:30.927810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:30.927810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:30.928599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:30.928599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:30.928599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:30.928599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:30.928599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:30.928599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:30.928599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:30.928599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:30.928599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:30.928599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:30.928599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:30.928599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:30.933126 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 182/352] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:30.934385 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37131c-b4a6-44ce-9eb5-ab8278638970 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:30.969760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedc8da-e06b-4bf7-a6f9-4b5d0de15f63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:30.969760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedc8da-e06b-4bf7-a6f9-4b5d0de15f63 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:31.052956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:31.077752 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37131c-b4a6-44ce-9eb5-ab8278638970 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:31.112908 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 171/353] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:31.113635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedc8da-e06b-4bf7-a6f9-4b5d0de15f63 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:31.122795 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:31.134717 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa8b04-5528-4953-82ce-19ea3f6c2a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:31.135329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8b04-5528-4953-82ce-19ea3f6c2a42 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:31.135601 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8b04-5528-4953-82ce-19ea3f6c2a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:31.135857 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8b04-5528-4953-82ce-19ea3f6c2a42 None admin] PATH_INFO: `/v3/groups/966a197cdfa94922ba1af6351d420084` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:31.143134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa8b04-5528-4953-82ce-19ea3f6c2a42 None admin] RBAC: Authorizing `identity:get_group(group_id=966a197cdfa94922ba1af6351d420084)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:31.145567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa8b04-5528-4953-82ce-19ea3f6c2a42 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:31.147735 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 183/354] 10.222.0.52 () {56 vars in 1180 bytes} [Mon Aug 29 20:17:30 2022] GET /identity/v3/groups/966a197cdfa94922ba1af6351d420084 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:31.149616 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb28f5-94a8-4f55-81dd-79b2f5947ea8 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:31.149904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb28f5-94a8-4f55-81dd-79b2f5947ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:31.150179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb28f5-94a8-4f55-81dd-79b2f5947ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:31.169146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-36cb28f5-94a8-4f55-81dd-79b2f5947ea8 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:31.170294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-36cb28f5-94a8-4f55-81dd-79b2f5947ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:31.251904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedc8da-e06b-4bf7-a6f9-4b5d0de15f63 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:31.276361 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 184/355] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:31.278221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb28f5-94a8-4f55-81dd-79b2f5947ea8 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:31.296067 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e794f-3819-4b88-9ff5-5d0b279e37d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:31.296755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e794f-3819-4b88-9ff5-5d0b279e37d7 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:31.297035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e794f-3819-4b88-9ff5-5d0b279e37d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:31.297413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e794f-3819-4b88-9ff5-5d0b279e37d7 None admin] PATH_INFO: `/v3/users/11570187b57246b08efecafedd549e56` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:31.299535 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e794f-3819-4b88-9ff5-5d0b279e37d7 None admin] RBAC: Authorizing `identity:get_user(user_id=11570187b57246b08efecafedd549e56)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:31.300901 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e794f-3819-4b88-9ff5-5d0b279e37d7 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:31.302608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 172/356] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:17:31 2022] GET /identity/v3/users/11570187b57246b08efecafedd549e56 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:31.303810 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693d633-9c96-4b48-8d11-a0434f5df50e None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:31.304156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693d633-9c96-4b48-8d11-a0434f5df50e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:31.304429 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693d633-9c96-4b48-8d11-a0434f5df50e None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:31.305965 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 173/357] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:31.309397 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693d633-9c96-4b48-8d11-a0434f5df50e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:31.360185 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:31.431016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb28f5-94a8-4f55-81dd-79b2f5947ea8 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:31.466850 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693d633-9c96-4b48-8d11-a0434f5df50e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:31.467108 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:31.482694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beae86-b2f2-4f7a-ada2-98ed4972a617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:31.483696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beae86-b2f2-4f7a-ada2-98ed4972a617 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:31.484217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beae86-b2f2-4f7a-ada2-98ed4972a617 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:31.484557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beae86-b2f2-4f7a-ada2-98ed4972a617 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:31.485324 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21beae86-b2f2-4f7a-ada2-98ed4972a617 None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:31.485656 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21beae86-b2f2-4f7a-ada2-98ed4972a617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:31.487853 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21beae86-b2f2-4f7a-ada2-98ed4972a617 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:31.498179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 185/358] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:31.498179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beae86-b2f2-4f7a-ada2-98ed4972a617 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:31.524653 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf4d23-05aa-4503-823e-d3216e14f4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:31.525186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf4d23-05aa-4503-823e-d3216e14f4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:31.525491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf4d23-05aa-4503-823e-d3216e14f4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:31.525758 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf4d23-05aa-4503-823e-d3216e14f4c8 None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:31.527000 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf4d23-05aa-4503-823e-d3216e14f4c8 None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:31.528498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf4d23-05aa-4503-823e-d3216e14f4c8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:31.530549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 174/359] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:31 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:31.533962 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf4d23-05aa-4503-823e-d3216e14f4c8 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:31.640370 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beae86-b2f2-4f7a-ada2-98ed4972a617 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:31.667737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:31.671060 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf4d23-05aa-4503-823e-d3216e14f4c8 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:31.682891 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df763a3-e1eb-4e97-85d6-b226bf7b1e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:31.684076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df763a3-e1eb-4e97-85d6-b226bf7b1e2a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:31.684358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df763a3-e1eb-4e97-85d6-b226bf7b1e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:31.684633 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df763a3-e1eb-4e97-85d6-b226bf7b1e2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:31.686288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df763a3-e1eb-4e97-85d6-b226bf7b1e2a None admin] RBAC: Adding query filter params (group.id=966a197cdfa94922ba1af6351d420084, role.id=73f8d83949b241d2bcd58d267657768a, scope.project.id=ae8e0eac9762422d8ac3147d4f823f90) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:31.686288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df763a3-e1eb-4e97-85d6-b226bf7b1e2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:31.687243 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df763a3-e1eb-4e97-85d6-b226bf7b1e2a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:31.693764 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 186/360] 10.222.0.52 () {56 vars in 1376 bytes} [Mon Aug 29 20:17:31 2022] GET /identity/v3/role_assignments?group.id=966a197cdfa94922ba1af6351d420084&scope.project.id=ae8e0eac9762422d8ac3147d4f823f90&role.id=73f8d83949b241d2bcd58d267657768a => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:31.695101 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cb02a-cec0-4f0c-bf2b-aa43f6527ded None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:31.695447 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cb02a-cec0-4f0c-bf2b-aa43f6527ded None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:31.695727 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cb02a-cec0-4f0c-bf2b-aa43f6527ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:31.719309 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-898cb02a-cec0-4f0c-bf2b-aa43f6527ded None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:31.720889 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-898cb02a-cec0-4f0c-bf2b-aa43f6527ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:31.729675 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f30328-c4e5-4c02-9362-353f54fc2437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:31.730307 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f30328-c4e5-4c02-9362-353f54fc2437 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:31.730583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f30328-c4e5-4c02-9362-353f54fc2437 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:31.730847 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f30328-c4e5-4c02-9362-353f54fc2437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:31.732278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f30328-c4e5-4c02-9362-353f54fc2437 None admin] RBAC: Adding query filter params (role.id=50f15caac85247d9a4b34ea4e25850a1, user.id=11570187b57246b08efecafedd549e56, scope.system=all) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:31.732583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f30328-c4e5-4c02-9362-353f54fc2437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:31.734204 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f30328-c4e5-4c02-9362-353f54fc2437 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:31.753007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 175/361] 10.222.0.52 () {56 vars in 1308 bytes} [Mon Aug 29 20:17:31 2022] GET /identity/v3/role_assignments?user.id=11570187b57246b08efecafedd549e56&scope.system=all&role.id=50f15caac85247d9a4b34ea4e25850a1 => generated 510 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:31.754569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f30328-c4e5-4c02-9362-353f54fc2437 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:31.801866 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:31.830732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 187/362] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:31.833235 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cb02a-cec0-4f0c-bf2b-aa43f6527ded None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:31.907589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f30328-c4e5-4c02-9362-353f54fc2437 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:31.963036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f462fa3-5654-46ca-a8ba-a571402ffbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:31.964514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f462fa3-5654-46ca-a8ba-a571402ffbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:31.965063 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f462fa3-5654-46ca-a8ba-a571402ffbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:31.965595 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f462fa3-5654-46ca-a8ba-a571402ffbc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:31.983230 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cb02a-cec0-4f0c-bf2b-aa43f6527ded None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:32.016871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:32.036741 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226515b9-ccae-474a-9cf3-a7d90433d83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:32.036741 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226515b9-ccae-474a-9cf3-a7d90433d83d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:32.037175 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226515b9-ccae-474a-9cf3-a7d90433d83d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:32.037308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226515b9-ccae-474a-9cf3-a7d90433d83d None admin] PATH_INFO: `/v3/groups/966a197cdfa94922ba1af6351d420084` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:32.038460 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226515b9-ccae-474a-9cf3-a7d90433d83d None admin] RBAC: Authorizing `identity:get_group(group_id=966a197cdfa94922ba1af6351d420084)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:32.039907 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226515b9-ccae-474a-9cf3-a7d90433d83d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:32.041888 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 188/363] 10.222.0.52 () {56 vars in 1180 bytes} [Mon Aug 29 20:17:31 2022] GET /identity/v3/groups/966a197cdfa94922ba1af6351d420084 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:32.042771 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226515b9-ccae-474a-9cf3-a7d90433d83d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:32.105637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:32.110988 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f462fa3-5654-46ca-a8ba-a571402ffbc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:32.114300 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f462fa3-5654-46ca-a8ba-a571402ffbc2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:32.194777 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226515b9-ccae-474a-9cf3-a7d90433d83d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:32.249855 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c7e99-8855-4f3c-9bd3-98eb799130e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:32.250615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c7e99-8855-4f3c-9bd3-98eb799130e2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:32.250914 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c7e99-8855-4f3c-9bd3-98eb799130e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:32.251170 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c7e99-8855-4f3c-9bd3-98eb799130e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:32.262659 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 176/364] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:32.263792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f462fa3-5654-46ca-a8ba-a571402ffbc2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:32.264031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c7e99-8855-4f3c-9bd3-98eb799130e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:32.270552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-1e1c7e99-8855-4f3c-9bd3-98eb799130e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:32.270552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:32.270552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:32.270552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:32.270552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:32.270552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:32.270552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:32.270552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:32.270552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:32.270552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:32.270552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:32.270552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:32.270552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:32.270552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:32.270552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:32.270552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:32.272063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:32.272063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:32.272063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:32.272063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:32.272063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:32.272063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:32.272063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:32.272063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:32.272063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:32.272063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:32.272063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:32.272063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:32.272063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:32.272063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:32.272063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:32.272063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:32.273650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:32.273650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:32.273650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:32.273650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:32.273650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:32.273650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:32.273650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:32.273650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:32.273650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:32.273650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:32.273650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:32.273650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:32.273650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 189/365] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:17:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:32.273650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c7e99-8855-4f3c-9bd3-98eb799130e2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:32.365815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:32.439804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c7e99-8855-4f3c-9bd3-98eb799130e2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:32.450435 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f462fa3-5654-46ca-a8ba-a571402ffbc2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:32.460113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:32.506066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188fa57-6c7c-4796-aba5-1faab3a74e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:32.506703 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188fa57-6c7c-4796-aba5-1faab3a74e28 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:32.506979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188fa57-6c7c-4796-aba5-1faab3a74e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:32.507248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188fa57-6c7c-4796-aba5-1faab3a74e28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:32.508005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188fa57-6c7c-4796-aba5-1faab3a74e28 None admin] RBAC: Adding query filter params (group.id=966a197cdfa94922ba1af6351d420084, role.id=2ae4df0c2db34d5092a5a05f3e512fdc, scope.project.id=ae8e0eac9762422d8ac3147d4f823f90) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:32.508311 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188fa57-6c7c-4796-aba5-1faab3a74e28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:32.510094 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188fa57-6c7c-4796-aba5-1faab3a74e28 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:32.520502 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 177/366] 10.222.0.52 () {56 vars in 1376 bytes} [Mon Aug 29 20:17:32 2022] GET /identity/v3/role_assignments?group.id=966a197cdfa94922ba1af6351d420084&scope.project.id=ae8e0eac9762422d8ac3147d4f823f90&role.id=2ae4df0c2db34d5092a5a05f3e512fdc => generated 260 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:32.520994 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b1675-2839-43f2-afd1-e94de12390d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:32.521821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188fa57-6c7c-4796-aba5-1faab3a74e28 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:32.522815 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b1675-2839-43f2-afd1-e94de12390d7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:32.523567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b1675-2839-43f2-afd1-e94de12390d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:32.524342 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b1675-2839-43f2-afd1-e94de12390d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:32.557802 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b1675-2839-43f2-afd1-e94de12390d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:32.570691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-755b1675-2839-43f2-afd1-e94de12390d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:17:32.570691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:32.570691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:32.570691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:32.570691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:32.570691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:32.570691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:32.570691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:32.570691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:32.570691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:32.570691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:32.570691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:32.570691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:32.570691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:32.570691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:32.570691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:32.572258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:32.572258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:32.572258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:32.572258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:32.572258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:32.572258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:32.572258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:32.572258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:32.572258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:32.572258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:32.572258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:32.572258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:32.572258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:32.572258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:32.572258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:32.572258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:32.573408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:32.573408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:32.573408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:32.573408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:32.573408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:32.573408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:32.573408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:32.573408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:32.573408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:32.573408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:32.573408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:17:32.573408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:32.573408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 190/367] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:17:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:32.575640 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b1675-2839-43f2-afd1-e94de12390d7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:32.743978 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b1675-2839-43f2-afd1-e94de12390d7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:32.745258 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188fa57-6c7c-4796-aba5-1faab3a74e28 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:32.802038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:32.815587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1184873-b4b7-4055-b8bd-7a6aff8405bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:32.816369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1184873-b4b7-4055-b8bd-7a6aff8405bc None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:32.816659 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1184873-b4b7-4055-b8bd-7a6aff8405bc None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:32.816938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1184873-b4b7-4055-b8bd-7a6aff8405bc None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:32.818613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1184873-b4b7-4055-b8bd-7a6aff8405bc None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:32.820342 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1184873-b4b7-4055-b8bd-7a6aff8405bc None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:32.820660 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2b1c8-b9e5-4cee-8a82-00bc526923a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:32.821869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2b1c8-b9e5-4cee-8a82-00bc526923a4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:32.822522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 178/368] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:32 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:32.822943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2b1c8-b9e5-4cee-8a82-00bc526923a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:32.823451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1184873-b4b7-4055-b8bd-7a6aff8405bc None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:32.824037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2b1c8-b9e5-4cee-8a82-00bc526923a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:32.825401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2b1c8-b9e5-4cee-8a82-00bc526923a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:32.826202 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2b1c8-b9e5-4cee-8a82-00bc526923a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:32.830675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2b1c8-b9e5-4cee-8a82-00bc526923a4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:32.850883 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 191/369] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:17:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:32.852505 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2b1c8-b9e5-4cee-8a82-00bc526923a4 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:32.904293 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:32.994491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1184873-b4b7-4055-b8bd-7a6aff8405bc None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:33.022975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2b1c8-b9e5-4cee-8a82-00bc526923a4 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:33.070719 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003ae36-62e9-492d-b42c-94dc13e0910a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:33.071642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003ae36-62e9-492d-b42c-94dc13e0910a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:33.071925 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003ae36-62e9-492d-b42c-94dc13e0910a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:33.072393 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003ae36-62e9-492d-b42c-94dc13e0910a None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:33.074636 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003ae36-62e9-492d-b42c-94dc13e0910a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:33.075156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003ae36-62e9-492d-b42c-94dc13e0910a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:33.077399 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003ae36-62e9-492d-b42c-94dc13e0910a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:33.085964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d669c5-e4f1-45e9-8170-cdae2e9717f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:33.086947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d669c5-e4f1-45e9-8170-cdae2e9717f6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:33.087380 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d669c5-e4f1-45e9-8170-cdae2e9717f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:33.087896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d669c5-e4f1-45e9-8170-cdae2e9717f6 None admin] PATH_INFO: `/v3/groups/966a197cdfa94922ba1af6351d420084` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:33.090394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d669c5-e4f1-45e9-8170-cdae2e9717f6 None admin] RBAC: Authorizing `identity:get_group(group_id=966a197cdfa94922ba1af6351d420084)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:33.092764 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d669c5-e4f1-45e9-8170-cdae2e9717f6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:33.094372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 179/370] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:33.095159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 192/371] 10.222.0.52 () {56 vars in 1180 bytes} [Mon Aug 29 20:17:32 2022] GET /identity/v3/groups/966a197cdfa94922ba1af6351d420084 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:33.097540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003ae36-62e9-492d-b42c-94dc13e0910a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:33.101194 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d669c5-e4f1-45e9-8170-cdae2e9717f6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:33.185437 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:33.255814 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:33.262235 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003ae36-62e9-492d-b42c-94dc13e0910a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:33.266089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d669c5-e4f1-45e9-8170-cdae2e9717f6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:33.313035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277dfcd-76b2-40c7-a436-36502958c374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:33.314038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277dfcd-76b2-40c7-a436-36502958c374 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:33.314566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277dfcd-76b2-40c7-a436-36502958c374 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:33.315194 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277dfcd-76b2-40c7-a436-36502958c374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:33.320101 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e2585-5de7-4bf5-ade6-c7f1621a1fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:33.322589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e2585-5de7-4bf5-ade6-c7f1621a1fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:33.322589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e2585-5de7-4bf5-ade6-c7f1621a1fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:33.322589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e2585-5de7-4bf5-ade6-c7f1621a1fb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:33.427540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277dfcd-76b2-40c7-a436-36502958c374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:33.429556 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277dfcd-76b2-40c7-a436-36502958c374 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:33.438881 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e2585-5de7-4bf5-ade6-c7f1621a1fb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:33.442105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e2585-5de7-4bf5-ade6-c7f1621a1fb8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:33.518072 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:33.562035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:33.569832 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 193/372] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:33.571088 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277dfcd-76b2-40c7-a436-36502958c374 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:33.586969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 180/373] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:33.586969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e2585-5de7-4bf5-ade6-c7f1621a1fb8 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:33.705142 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277dfcd-76b2-40c7-a436-36502958c374 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:33.715900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e2585-5de7-4bf5-ade6-c7f1621a1fb8 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:33.751177 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e9ae9-ccfd-4b58-9bab-becd748ee94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:33.751793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e9ae9-ccfd-4b58-9bab-becd748ee94c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:33.752245 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e9ae9-ccfd-4b58-9bab-becd748ee94c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:33.752679 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e9ae9-ccfd-4b58-9bab-becd748ee94c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:33.753619 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e9ae9-ccfd-4b58-9bab-becd748ee94c None admin] RBAC: Adding query filter params (group.id=966a197cdfa94922ba1af6351d420084, role.id=73f8d83949b241d2bcd58d267657768a, scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:33.754100 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e9ae9-ccfd-4b58-9bab-becd748ee94c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:33.755716 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e9ae9-ccfd-4b58-9bab-becd748ee94c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:33.762383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850da864-a326-4d1d-9fbc-f4e68f251b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:33.762881 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 194/374] 10.222.0.52 () {56 vars in 1376 bytes} [Mon Aug 29 20:17:33 2022] GET /identity/v3/role_assignments?group.id=966a197cdfa94922ba1af6351d420084&scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4&role.id=73f8d83949b241d2bcd58d267657768a => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:33.763752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850da864-a326-4d1d-9fbc-f4e68f251b24 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:33.764113 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850da864-a326-4d1d-9fbc-f4e68f251b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:33.764295 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e9ae9-ccfd-4b58-9bab-becd748ee94c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:33.764501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850da864-a326-4d1d-9fbc-f4e68f251b24 None admin] PATH_INFO: `/v3/projects/e848cede7541492584effd880adbb5d7` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:33.765956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850da864-a326-4d1d-9fbc-f4e68f251b24 None admin] RBAC: Authorizing `identity:get_project(project_id=e848cede7541492584effd880adbb5d7)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:33.767534 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850da864-a326-4d1d-9fbc-f4e68f251b24 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:33.770708 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 181/375] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:33 2022] GET /identity/v3/projects/e848cede7541492584effd880adbb5d7 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:33.777601 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850da864-a326-4d1d-9fbc-f4e68f251b24 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:33.810039 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:33.882083 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:33.957702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e9ae9-ccfd-4b58-9bab-becd748ee94c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:33.977082 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850da864-a326-4d1d-9fbc-f4e68f251b24 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:34.006335 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b643a84-92c0-4bc4-b3b7-759a2aecb6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:34.007248 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b643a84-92c0-4bc4-b3b7-759a2aecb6ed None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:34.007665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b643a84-92c0-4bc4-b3b7-759a2aecb6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:34.008098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b643a84-92c0-4bc4-b3b7-759a2aecb6ed None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:34.010890 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b643a84-92c0-4bc4-b3b7-759a2aecb6ed None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:34.012582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b643a84-92c0-4bc4-b3b7-759a2aecb6ed None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:34.014599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 195/376] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:33 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:34.016056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2556a94-1171-4102-a11c-deae79e00d82 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:34.016565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2556a94-1171-4102-a11c-deae79e00d82 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:34.017027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2556a94-1171-4102-a11c-deae79e00d82 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:34.018912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 196/377] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:34.025284 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2556a94-1171-4102-a11c-deae79e00d82 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:34.037143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b323b-d34e-4f41-9d57-deebf87fb17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:34.038533 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b323b-d34e-4f41-9d57-deebf87fb17a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:34.039054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b323b-d34e-4f41-9d57-deebf87fb17a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:34.039523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b323b-d34e-4f41-9d57-deebf87fb17a None admin] PATH_INFO: `/v3/groups/ecd4c7f0e5e4480cb3256a879ad9b614` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:34.047910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b323b-d34e-4f41-9d57-deebf87fb17a None admin] RBAC: Authorizing `identity:get_group(group_id=ecd4c7f0e5e4480cb3256a879ad9b614)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:34.050272 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b323b-d34e-4f41-9d57-deebf87fb17a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:34.052825 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 182/378] 10.222.0.52 () {56 vars in 1180 bytes} [Mon Aug 29 20:17:33 2022] GET /identity/v3/groups/ecd4c7f0e5e4480cb3256a879ad9b614 => generated 229 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:34.054291 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d192cd7-f1d4-49c8-a413-20c5d884c6b0 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:34.054766 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d192cd7-f1d4-49c8-a413-20c5d884c6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:34.055242 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d192cd7-f1d4-49c8-a413-20c5d884c6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:34.088522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3d192cd7-f1d4-49c8-a413-20c5d884c6b0 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:34.090122 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3d192cd7-f1d4-49c8-a413-20c5d884c6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:34.133754 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2556a94-1171-4102-a11c-deae79e00d82 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:34.164237 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:34.170809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3115b-a5cc-4c88-9172-acb702aa326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:34.171688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3115b-a5cc-4c88-9172-acb702aa326f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:34.172130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3115b-a5cc-4c88-9172-acb702aa326f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:34.172537 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3115b-a5cc-4c88-9172-acb702aa326f None admin] PATH_INFO: `/v3/groups/966a197cdfa94922ba1af6351d420084` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:34.173849 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3115b-a5cc-4c88-9172-acb702aa326f None admin] RBAC: Authorizing `identity:get_group(group_id=966a197cdfa94922ba1af6351d420084)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:34.175441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3115b-a5cc-4c88-9172-acb702aa326f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:34.178607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 197/379] 10.222.0.52 () {56 vars in 1180 bytes} [Mon Aug 29 20:17:34 2022] GET /identity/v3/groups/966a197cdfa94922ba1af6351d420084 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:34.179636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3115b-a5cc-4c88-9172-acb702aa326f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:34.214480 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 183/380] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:34.215583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d192cd7-f1d4-49c8-a413-20c5d884c6b0 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:34.249926 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:34.358013 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3115b-a5cc-4c88-9172-acb702aa326f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:34.397917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d192cd7-f1d4-49c8-a413-20c5d884c6b0 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:34.431330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318569c-e909-4d17-abc5-26000a82fcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:34.432152 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318569c-e909-4d17-abc5-26000a82fcf0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:34.432428 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318569c-e909-4d17-abc5-26000a82fcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:34.432763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318569c-e909-4d17-abc5-26000a82fcf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:34.433598 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318569c-e909-4d17-abc5-26000a82fcf0 None admin] RBAC: Adding query filter params (group.id=ecd4c7f0e5e4480cb3256a879ad9b614, role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=e848cede7541492584effd880adbb5d7) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:34.434214 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318569c-e909-4d17-abc5-26000a82fcf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:34.435917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318569c-e909-4d17-abc5-26000a82fcf0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:34.451750 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726eca0-0b30-451c-b9ee-1f7633682aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:34.452937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726eca0-0b30-451c-b9ee-1f7633682aac None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:34.453556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726eca0-0b30-451c-b9ee-1f7633682aac None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:34.454017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726eca0-0b30-451c-b9ee-1f7633682aac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:34.455091 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726eca0-0b30-451c-b9ee-1f7633682aac None admin] RBAC: Adding query filter params (group.id=966a197cdfa94922ba1af6351d420084, role.id=2ae4df0c2db34d5092a5a05f3e512fdc, scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:34.455590 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726eca0-0b30-451c-b9ee-1f7633682aac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:34.456009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 198/381] 10.222.0.52 () {56 vars in 1376 bytes} [Mon Aug 29 20:17:34 2022] GET /identity/v3/role_assignments?group.id=ecd4c7f0e5e4480cb3256a879ad9b614&scope.project.id=e848cede7541492584effd880adbb5d7&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 260 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:34.457693 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726eca0-0b30-451c-b9ee-1f7633682aac None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:34.471577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 184/382] 10.222.0.52 () {56 vars in 1376 bytes} [Mon Aug 29 20:17:34 2022] GET /identity/v3/role_assignments?group.id=966a197cdfa94922ba1af6351d420084&scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4&role.id=2ae4df0c2db34d5092a5a05f3e512fdc => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:34.613544 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318569c-e909-4d17-abc5-26000a82fcf0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:34.692454 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:34.743758 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318569c-e909-4d17-abc5-26000a82fcf0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:34.783338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32674c3-18bd-4ce2-813e-5b0e1ad1a02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:34.783972 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32674c3-18bd-4ce2-813e-5b0e1ad1a02c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:34.784240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32674c3-18bd-4ce2-813e-5b0e1ad1a02c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:34.784507 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32674c3-18bd-4ce2-813e-5b0e1ad1a02c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:34.797440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32674c3-18bd-4ce2-813e-5b0e1ad1a02c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:34.803480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-c32674c3-18bd-4ce2-813e-5b0e1ad1a02c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:34.803480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:34.803480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:34.803480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:34.803480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:34.803480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:34.803480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:34.803480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:34.803480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:34.803480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:34.803480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:34.803480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:34.803480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:34.803480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:34.803480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:34.803480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:34.804397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:34.804397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:34.804397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:34.804397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:34.804397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:34.804397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:34.804397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:34.804397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:34.804397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:34.804397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:34.804397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:34.804397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:34.804397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:34.804397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:34.804397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:34.804397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:34.805203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:34.805203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:34.805203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:34.805203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:34.805203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:34.805203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:34.805203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:34.805203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:34.805203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:34.805203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:34.805203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:34.805203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:34.805203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 199/383] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:34.810899 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726eca0-0b30-451c-b9ee-1f7633682aac None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:34.954646 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18941ab-aec2-4a39-9b86-80a4fc66ef18 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:34.955783 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18941ab-aec2-4a39-9b86-80a4fc66ef18 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:34.956425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18941ab-aec2-4a39-9b86-80a4fc66ef18 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:34.959591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 200/384] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:34.965395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:34.965563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eaac3-7703-4c11-bdaa-19a0f07469bd None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:34.965563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eaac3-7703-4c11-bdaa-19a0f07469bd None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:34.965563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eaac3-7703-4c11-bdaa-19a0f07469bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:34.985308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4a0eaac3-7703-4c11-bdaa-19a0f07469bd None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:34.986710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4a0eaac3-7703-4c11-bdaa-19a0f07469bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:35.013033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726eca0-0b30-451c-b9ee-1f7633682aac None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:35.088075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9998b6f-c6f9-4d20-8b90-a51b77ed84af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:35.089158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9998b6f-c6f9-4d20-8b90-a51b77ed84af None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:35.089158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9998b6f-c6f9-4d20-8b90-a51b77ed84af None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:35.089451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9998b6f-c6f9-4d20-8b90-a51b77ed84af None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:35.089921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9998b6f-c6f9-4d20-8b90-a51b77ed84af None admin] RBAC: Adding query filter params (name=member) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:35.090225 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9998b6f-c6f9-4d20-8b90-a51b77ed84af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:35.092477 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9998b6f-c6f9-4d20-8b90-a51b77ed84af None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:35.105417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 185/385] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:35.110353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9998b6f-c6f9-4d20-8b90-a51b77ed84af None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:35.117033 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 201/386] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:17:35.268283 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9998b6f-c6f9-4d20-8b90-a51b77ed84af None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:35.309788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913bc1e-9de0-4cb9-9952-16da9aa1503b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:35.310900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913bc1e-9de0-4cb9-9952-16da9aa1503b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:35.311380 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913bc1e-9de0-4cb9-9952-16da9aa1503b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:35.311892 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913bc1e-9de0-4cb9-9952-16da9aa1503b None admin] PATH_INFO: `/v3/groups/966a197cdfa94922ba1af6351d420084` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:35.313972 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913bc1e-9de0-4cb9-9952-16da9aa1503b None admin] RBAC: Authorizing `identity:get_group(group_id=966a197cdfa94922ba1af6351d420084)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:35.317190 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913bc1e-9de0-4cb9-9952-16da9aa1503b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:35.320848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 186/387] 10.222.0.52 () {56 vars in 1180 bytes} [Mon Aug 29 20:17:35 2022] GET /identity/v3/groups/966a197cdfa94922ba1af6351d420084 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:35.328794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eaac3-7703-4c11-bdaa-19a0f07469bd None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:35.415973 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:35.473792 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eaac3-7703-4c11-bdaa-19a0f07469bd None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:35.493200 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913bc1e-9de0-4cb9-9952-16da9aa1503b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:35.511527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26806c3-b84f-4d4f-aa19-1063115bf77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:35.512195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26806c3-b84f-4d4f-aa19-1063115bf77f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:35.512469 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26806c3-b84f-4d4f-aa19-1063115bf77f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:35.512821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26806c3-b84f-4d4f-aa19-1063115bf77f None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:35.514051 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26806c3-b84f-4d4f-aa19-1063115bf77f None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:35.515676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26806c3-b84f-4d4f-aa19-1063115bf77f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:35.518860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:35.519612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 202/388] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:35 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:35.526363 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26806c3-b84f-4d4f-aa19-1063115bf77f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:35.686282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913bc1e-9de0-4cb9-9952-16da9aa1503b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:35.690812 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26806c3-b84f-4d4f-aa19-1063115bf77f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:35.724338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1aa09-b695-4f82-9139-b2f9dcc458b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:35.724991 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1aa09-b695-4f82-9139-b2f9dcc458b5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:35.725275 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1aa09-b695-4f82-9139-b2f9dcc458b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:35.725595 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1aa09-b695-4f82-9139-b2f9dcc458b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:35.738390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1aa09-b695-4f82-9139-b2f9dcc458b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:35.744010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-6ff1aa09-b695-4f82-9139-b2f9dcc458b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:35.744010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:35.744010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:35.744010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:35.744010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:35.744010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:35.744010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:35.744010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:35.744010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:35.744010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:35.744010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:35.744010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:35.744010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:35.744010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:35.744010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:35.744010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:35.744937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:35.744937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:35.744937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:35.744937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:35.744937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:35.744937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:35.744937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:35.744937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:35.744937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:35.744937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:35.744937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:35.744937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:35.744937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:35.744937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:35.744937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:35.744937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:35.745795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:35.745795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:35.745795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:35.745795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:35.745795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:35.745795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:35.745795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:35.745795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:35.745795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:35.745795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:35.745795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:35.745795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:35.745795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 187/389] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:17:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:35.751632 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:35.753015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1aa09-b695-4f82-9139-b2f9dcc458b5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:35.789319 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0dae9-95db-4923-8b0e-da65d5b0ccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:35.789954 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0dae9-95db-4923-8b0e-da65d5b0ccc6 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:35.790477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0dae9-95db-4923-8b0e-da65d5b0ccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:35.790623 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0dae9-95db-4923-8b0e-da65d5b0ccc6 None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90/groups/966a197cdfa94922ba1af6351d420084/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:35.795282 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0dae9-95db-4923-8b0e-da65d5b0ccc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae8e0eac9762422d8ac3147d4f823f90, group_id=966a197cdfa94922ba1af6351d420084, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:35.797051 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0dae9-95db-4923-8b0e-da65d5b0ccc6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:35.822131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 203/390] 10.222.0.52 () {58 vars in 1442 bytes} [Mon Aug 29 20:17:35 2022] PUT /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90/groups/966a197cdfa94922ba1af6351d420084/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:17:35.837890 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:35.878853 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1aa09-b695-4f82-9139-b2f9dcc458b5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:35.923531 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32142c1a-8592-4983-816c-9fd89c26bc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:35.924591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142c1a-8592-4983-816c-9fd89c26bc67 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:35.925082 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142c1a-8592-4983-816c-9fd89c26bc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:35.925646 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142c1a-8592-4983-816c-9fd89c26bc67 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:35.926651 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32142c1a-8592-4983-816c-9fd89c26bc67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:35.927249 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32142c1a-8592-4983-816c-9fd89c26bc67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:35.928948 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32142c1a-8592-4983-816c-9fd89c26bc67 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:35.939759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 188/391] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:17:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:35.946115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0dae9-95db-4923-8b0e-da65d5b0ccc6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:36.094239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0dae9-95db-4923-8b0e-da65d5b0ccc6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:36.141788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00409a04-0616-418e-affa-b3a97a66a2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:36.143153 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00409a04-0616-418e-affa-b3a97a66a2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:36.143434 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00409a04-0616-418e-affa-b3a97a66a2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:36.143710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00409a04-0616-418e-affa-b3a97a66a2f2 None admin] PATH_INFO: `/v3/groups/966a197cdfa94922ba1af6351d420084` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:36.145817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00409a04-0616-418e-affa-b3a97a66a2f2 None admin] RBAC: Authorizing `identity:get_group(group_id=966a197cdfa94922ba1af6351d420084)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:36.146441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00409a04-0616-418e-affa-b3a97a66a2f2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:36.148464 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 204/392] 10.222.0.52 () {56 vars in 1180 bytes} [Mon Aug 29 20:17:35 2022] GET /identity/v3/groups/966a197cdfa94922ba1af6351d420084 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:36.155254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32142c1a-8592-4983-816c-9fd89c26bc67 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:36.334243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32142c1a-8592-4983-816c-9fd89c26bc67 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:36.388103 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:36.396049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286abeca-a8d2-40d3-92d3-f63da0765375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:36.396708 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286abeca-a8d2-40d3-92d3-f63da0765375 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:36.396987 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286abeca-a8d2-40d3-92d3-f63da0765375 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:36.397256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286abeca-a8d2-40d3-92d3-f63da0765375 None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:36.398470 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286abeca-a8d2-40d3-92d3-f63da0765375 None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:36.399952 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286abeca-a8d2-40d3-92d3-f63da0765375 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:36.401665 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 189/393] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:36 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:36.410371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00409a04-0616-418e-affa-b3a97a66a2f2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:36.430998 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c6ac3-e9d1-4fc0-9321-a342ba28e02b None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:36.431310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c6ac3-e9d1-4fc0-9321-a342ba28e02b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:36.431543 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c6ac3-e9d1-4fc0-9321-a342ba28e02b None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:36.433443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 190/394] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:17:36.439000 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d9de1-bb2d-485f-a6c5-280685766990 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:36.439323 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d9de1-bb2d-485f-a6c5-280685766990 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:36.439543 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d9de1-bb2d-485f-a6c5-280685766990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:36.459357 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-bf8d9de1-bb2d-485f-a6c5-280685766990 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:36.460570 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bf8d9de1-bb2d-485f-a6c5-280685766990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:36.517761 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:36.578800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00409a04-0616-418e-affa-b3a97a66a2f2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:36.599401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 191/395] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:17:36.646840 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a87e35-2707-4ddc-a2f0-cf2864b199fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:36.647429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a87e35-2707-4ddc-a2f0-cf2864b199fa None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:36.647706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a87e35-2707-4ddc-a2f0-cf2864b199fa None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:36.647980 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a87e35-2707-4ddc-a2f0-cf2864b199fa None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90/groups/966a197cdfa94922ba1af6351d420084/roles/2ae4df0c2db34d5092a5a05f3e512fdc` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:36.650278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a87e35-2707-4ddc-a2f0-cf2864b199fa None admin] RBAC: Authorizing `identity:create_grant(project_id=ae8e0eac9762422d8ac3147d4f823f90, group_id=966a197cdfa94922ba1af6351d420084, role_id=2ae4df0c2db34d5092a5a05f3e512fdc)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:36.651759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a87e35-2707-4ddc-a2f0-cf2864b199fa None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:36.666856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 205/396] 10.222.0.52 () {58 vars in 1442 bytes} [Mon Aug 29 20:17:36 2022] PUT /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90/groups/966a197cdfa94922ba1af6351d420084/roles/2ae4df0c2db34d5092a5a05f3e512fdc => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:17:36.955460 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d9de1-bb2d-485f-a6c5-280685766990 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:36.961924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffed07-9910-4659-b2e0-a6abff96b15c None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:36.962870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffed07-9910-4659-b2e0-a6abff96b15c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:36.963365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffed07-9910-4659-b2e0-a6abff96b15c None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:36.964937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 206/397] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:36.973054 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4de1dd-9270-4529-847b-c1720322b4a1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:36.973353 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4de1dd-9270-4529-847b-c1720322b4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:36.973625 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4de1dd-9270-4529-847b-c1720322b4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:37.000372 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5b4de1dd-9270-4529-847b-c1720322b4a1 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:37.001634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5b4de1dd-9270-4529-847b-c1720322b4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:37.081989 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d9de1-bb2d-485f-a6c5-280685766990 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:37.103161 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 207/398] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:17:37.104774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f32f43-6a4b-4e23-9f47-37b65c6ed6cb None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:37.105057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f32f43-6a4b-4e23-9f47-37b65c6ed6cb None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:37.105323 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f32f43-6a4b-4e23-9f47-37b65c6ed6cb None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:37.111504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 208/399] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:37.118870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236054d-f14a-464e-b559-e7dbd5412ed2 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:37.119322 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236054d-f14a-464e-b559-e7dbd5412ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:37.119696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236054d-f14a-464e-b559-e7dbd5412ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:37.130893 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:37.146987 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3236054d-f14a-464e-b559-e7dbd5412ed2 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:37.148223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3236054d-f14a-464e-b559-e7dbd5412ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:37.152586 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb1a70-2208-4e5a-a877-c87b77cf3c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:37.153334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb1a70-2208-4e5a-a877-c87b77cf3c3e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:37.153691 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb1a70-2208-4e5a-a877-c87b77cf3c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:37.153944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb1a70-2208-4e5a-a877-c87b77cf3c3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:37.178864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb1a70-2208-4e5a-a877-c87b77cf3c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:37.185792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-b6cb1a70-2208-4e5a-a877-c87b77cf3c3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:37.185792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:37.185792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:37.185792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:37.185792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:37.185792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:37.185792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:37.185792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:37.185792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:37.185792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:37.185792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:37.185792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:37.185792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:37.185792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:37.185792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:37.185792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:37.186866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:37.186866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:37.186866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:37.186866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:37.186866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:37.186866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:37.186866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:37.186866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:37.186866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:37.186866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:37.186866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:37.186866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:37.186866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:37.186866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:37.186866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:37.186866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:37.187649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:37.187649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:37.187649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:37.187649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:37.187649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:37.187649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:37.187649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:37.187649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:37.187649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:37.187649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:37.187649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:37.187649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:37.188815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 192/400] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:37.196255 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb1a70-2208-4e5a-a877-c87b77cf3c3e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:37.245821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:37.312556 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 209/401] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:37.387697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb1a70-2208-4e5a-a877-c87b77cf3c3e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:37.424459 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cdef3-df76-4eed-a25e-4bfde597305d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:37.425082 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cdef3-df76-4eed-a25e-4bfde597305d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:37.425390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cdef3-df76-4eed-a25e-4bfde597305d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:37.425656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cdef3-df76-4eed-a25e-4bfde597305d None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:37.426677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cdef3-df76-4eed-a25e-4bfde597305d None admin] RBAC: Adding query filter params (name=member) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:37.427006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cdef3-df76-4eed-a25e-4bfde597305d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:37.427627 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236054d-f14a-464e-b559-e7dbd5412ed2 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:37.428401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cdef3-df76-4eed-a25e-4bfde597305d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:37.440334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 193/402] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:37.446305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cdef3-df76-4eed-a25e-4bfde597305d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:37.543032 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:37.603028 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236054d-f14a-464e-b559-e7dbd5412ed2 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:37.636119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cdef3-df76-4eed-a25e-4bfde597305d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:37.650185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d8ea7-e382-4486-b93e-1188f86d5f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:37.650819 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d8ea7-e382-4486-b93e-1188f86d5f05 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:37.651094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d8ea7-e382-4486-b93e-1188f86d5f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:37.651359 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d8ea7-e382-4486-b93e-1188f86d5f05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:37.663334 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d8ea7-e382-4486-b93e-1188f86d5f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:37.669047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-4f9d8ea7-e382-4486-b93e-1188f86d5f05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:17:37.669047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:37.669047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:37.669047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:37.669047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:37.669047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:37.669047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:37.669047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:37.669047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:37.669047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:37.669047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:37.669047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:37.669047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:37.669047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:37.669047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:37.669047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:37.669996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:37.669996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:37.669996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:37.669996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:37.669996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:37.669996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:37.669996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:37.669996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:37.669996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:37.669996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:37.669996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:37.669996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:37.669996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:37.669996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:37.669996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:37.669996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:37.671302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:37.671302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:37.671302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:37.671302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:37.671302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:37.671302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:37.671302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:37.671302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:37.671302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:37.671302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:37.671302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:17:37.671302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:37.671302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 210/403] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:17:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:37.671955 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d8ea7-e382-4486-b93e-1188f86d5f05 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:37.683221 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ccfeb-eb9c-412e-9e9e-1ea8b4fab47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:37.684265 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ccfeb-eb9c-412e-9e9e-1ea8b4fab47c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:37.684732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ccfeb-eb9c-412e-9e9e-1ea8b4fab47c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:37.685183 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ccfeb-eb9c-412e-9e9e-1ea8b4fab47c None admin] PATH_INFO: `/v3/groups/966a197cdfa94922ba1af6351d420084` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:37.686741 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ccfeb-eb9c-412e-9e9e-1ea8b4fab47c None admin] RBAC: Authorizing `identity:get_group(group_id=966a197cdfa94922ba1af6351d420084)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:37.688523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ccfeb-eb9c-412e-9e9e-1ea8b4fab47c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:37.691922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 194/404] 10.222.0.52 () {56 vars in 1180 bytes} [Mon Aug 29 20:17:37 2022] GET /identity/v3/groups/966a197cdfa94922ba1af6351d420084 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:37.693025 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ccfeb-eb9c-412e-9e9e-1ea8b4fab47c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:37.741814 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:37.798560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d8ea7-e382-4486-b93e-1188f86d5f05 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:37.829231 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ccfeb-eb9c-412e-9e9e-1ea8b4fab47c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:37.832936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cc8fc-e935-4879-a684-12a78e942d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:37.833591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cc8fc-e935-4879-a684-12a78e942d23 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:37.833867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cc8fc-e935-4879-a684-12a78e942d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:37.834186 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cc8fc-e935-4879-a684-12a78e942d23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:37.845887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cc8fc-e935-4879-a684-12a78e942d23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:37.851270 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:37.851388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-9e7cc8fc-e935-4879-a684-12a78e942d23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:37.851388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:37.851388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:37.851388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:37.851388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:37.851388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:37.851388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:37.851388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:37.851388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:37.851388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:37.851388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:37.851388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:37.851388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:37.851388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:37.851388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:37.851388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:37.852206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:37.852206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:37.852206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:37.852206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:37.852206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:37.852206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:37.852206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:37.852206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:37.852206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:37.852206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:37.852206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:37.852206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:37.852206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:37.852206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:37.852206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:37.852206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:37.858131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:37.858131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:37.858131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:37.858131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:37.858131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:37.858131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:37.858131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:37.858131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:37.858131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:37.858131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:37.858131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:37.858131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:37.858131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 211/405] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:17:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:37.858131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cc8fc-e935-4879-a684-12a78e942d23 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:37.885413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ef876-052d-4f1d-8ba7-1e8d5c87015a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:37.886516 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ef876-052d-4f1d-8ba7-1e8d5c87015a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:37.886950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ef876-052d-4f1d-8ba7-1e8d5c87015a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:37.887746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ef876-052d-4f1d-8ba7-1e8d5c87015a None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:37.888816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ef876-052d-4f1d-8ba7-1e8d5c87015a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:37.889280 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ef876-052d-4f1d-8ba7-1e8d5c87015a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:37.891884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ef876-052d-4f1d-8ba7-1e8d5c87015a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:37.904871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 195/406] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:37.906433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ef876-052d-4f1d-8ba7-1e8d5c87015a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:37.962851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:37.983055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cc8fc-e935-4879-a684-12a78e942d23 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:38.025314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0b514-7f9d-48d2-a0f8-0f78f9bd4afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:38.026235 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0b514-7f9d-48d2-a0f8-0f78f9bd4afe None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:38.026509 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0b514-7f9d-48d2-a0f8-0f78f9bd4afe None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:38.026781 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0b514-7f9d-48d2-a0f8-0f78f9bd4afe None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:38.027469 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ef876-052d-4f1d-8ba7-1e8d5c87015a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:38.027916 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0b514-7f9d-48d2-a0f8-0f78f9bd4afe None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:38.030621 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0b514-7f9d-48d2-a0f8-0f78f9bd4afe None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:38.033514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 212/407] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:37 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:38.034693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0b514-7f9d-48d2-a0f8-0f78f9bd4afe None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:38.069480 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe009a3-307f-45b0-8675-4b50070d69a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:38.069688 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe009a3-307f-45b0-8675-4b50070d69a0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:38.069940 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe009a3-307f-45b0-8675-4b50070d69a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:38.070203 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe009a3-307f-45b0-8675-4b50070d69a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:38.070874 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe009a3-307f-45b0-8675-4b50070d69a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:38.071169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe009a3-307f-45b0-8675-4b50070d69a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:38.072645 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe009a3-307f-45b0-8675-4b50070d69a0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:38.089105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 196/408] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:17:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:38.089105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d4cb-9dc0-4595-b1b4-6319b0740f6f None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:38.089105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d4cb-9dc0-4595-b1b4-6319b0740f6f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:38.089105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d4cb-9dc0-4595-b1b4-6319b0740f6f None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:38.089105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 197/409] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:38.089105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018d4cb-9dc0-4595-b1b4-6319b0740f6f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:38.144256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:38.152775 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0b514-7f9d-48d2-a0f8-0f78f9bd4afe None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:38.187509 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5fb4d-7b02-4e50-a1f3-cdd06756e060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:38.188165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5fb4d-7b02-4e50-a1f3-cdd06756e060 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:38.188394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5fb4d-7b02-4e50-a1f3-cdd06756e060 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:38.188664 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5fb4d-7b02-4e50-a1f3-cdd06756e060 None admin] PATH_INFO: `/v3/groups/ecd4c7f0e5e4480cb3256a879ad9b614` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:38.189801 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5fb4d-7b02-4e50-a1f3-cdd06756e060 None admin] RBAC: Authorizing `identity:get_group(group_id=ecd4c7f0e5e4480cb3256a879ad9b614)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:38.191254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5fb4d-7b02-4e50-a1f3-cdd06756e060 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:38.192803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 213/410] 10.222.0.52 () {56 vars in 1180 bytes} [Mon Aug 29 20:17:38 2022] GET /identity/v3/groups/ecd4c7f0e5e4480cb3256a879ad9b614 => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:38.193579 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5fb4d-7b02-4e50-a1f3-cdd06756e060 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:38.213890 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018d4cb-9dc0-4595-b1b4-6319b0740f6f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:38.221875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:38.252802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad096952-e306-4b23-9a17-d30030779726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:38.253489 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad096952-e306-4b23-9a17-d30030779726 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:38.253770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad096952-e306-4b23-9a17-d30030779726 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:38.254037 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad096952-e306-4b23-9a17-d30030779726 None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4/groups/966a197cdfa94922ba1af6351d420084/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:38.255906 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad096952-e306-4b23-9a17-d30030779726 None admin] RBAC: Authorizing `identity:create_grant(project_id=48fa3e38610a4b67b7e535ae4148e9d4, group_id=966a197cdfa94922ba1af6351d420084, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:38.257385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad096952-e306-4b23-9a17-d30030779726 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:38.273398 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 198/411] 10.222.0.52 () {58 vars in 1442 bytes} [Mon Aug 29 20:17:38 2022] PUT /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4/groups/966a197cdfa94922ba1af6351d420084/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:17:38.275083 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1749a45-dd5f-480a-89cf-54c31cdb1786 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:38.275368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1749a45-dd5f-480a-89cf-54c31cdb1786 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:38.275640 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1749a45-dd5f-480a-89cf-54c31cdb1786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:38.300931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e1749a45-dd5f-480a-89cf-54c31cdb1786 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:38.302555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e1749a45-dd5f-480a-89cf-54c31cdb1786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:38.329637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5fb4d-7b02-4e50-a1f3-cdd06756e060 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:38.391403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc45993-ae71-4c0e-9953-87048ec84d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:38.392339 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc45993-ae71-4c0e-9953-87048ec84d91 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:38.392619 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc45993-ae71-4c0e-9953-87048ec84d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:38.392894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc45993-ae71-4c0e-9953-87048ec84d91 None admin] PATH_INFO: `/v3/groups/966a197cdfa94922ba1af6351d420084` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:38.394202 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc45993-ae71-4c0e-9953-87048ec84d91 None admin] RBAC: Authorizing `identity:get_group(group_id=966a197cdfa94922ba1af6351d420084)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:38.395824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc45993-ae71-4c0e-9953-87048ec84d91 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:38.397919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 214/412] 10.222.0.52 () {56 vars in 1180 bytes} [Mon Aug 29 20:17:38 2022] GET /identity/v3/groups/966a197cdfa94922ba1af6351d420084 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:38.402678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc45993-ae71-4c0e-9953-87048ec84d91 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:38.428047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 199/413] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:38.429993 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1749a45-dd5f-480a-89cf-54c31cdb1786 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:38.473121 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:38.523347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:38.534211 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc45993-ae71-4c0e-9953-87048ec84d91 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:38.575537 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007504a-5f56-45a7-97ea-9c91892120d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:38.576489 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007504a-5f56-45a7-97ea-9c91892120d3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:38.576939 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007504a-5f56-45a7-97ea-9c91892120d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:38.577454 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007504a-5f56-45a7-97ea-9c91892120d3 None admin] PATH_INFO: `/v3/projects/e848cede7541492584effd880adbb5d7` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:38.577818 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1749a45-dd5f-480a-89cf-54c31cdb1786 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:38.579037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007504a-5f56-45a7-97ea-9c91892120d3 None admin] RBAC: Authorizing `identity:get_project(project_id=e848cede7541492584effd880adbb5d7)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:38.580913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007504a-5f56-45a7-97ea-9c91892120d3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:38.584031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 215/414] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:38 2022] GET /identity/v3/projects/e848cede7541492584effd880adbb5d7 => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:38.589836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007504a-5f56-45a7-97ea-9c91892120d3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:38.618141 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f22d4b-59cd-4201-a307-b51c1d71672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:38.619124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f22d4b-59cd-4201-a307-b51c1d71672d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:38.619572 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f22d4b-59cd-4201-a307-b51c1d71672d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:38.620023 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f22d4b-59cd-4201-a307-b51c1d71672d None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:38.621393 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f22d4b-59cd-4201-a307-b51c1d71672d None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:38.623036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f22d4b-59cd-4201-a307-b51c1d71672d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:38.625249 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 200/415] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:38 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:38.631137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f22d4b-59cd-4201-a307-b51c1d71672d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:38.707006 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007504a-5f56-45a7-97ea-9c91892120d3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:38.739284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:38.742782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f22d4b-59cd-4201-a307-b51c1d71672d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:38.747503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0584c9-a714-4152-ac92-f59371da1aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:38.748223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0584c9-a714-4152-ac92-f59371da1aaf None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:38.748496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0584c9-a714-4152-ac92-f59371da1aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:38.748759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0584c9-a714-4152-ac92-f59371da1aaf None admin] PATH_INFO: `/v3/projects/e848cede7541492584effd880adbb5d7/groups/ecd4c7f0e5e4480cb3256a879ad9b614/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:38.751017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0584c9-a714-4152-ac92-f59371da1aaf None admin] RBAC: Authorizing `identity:create_grant(project_id=e848cede7541492584effd880adbb5d7, group_id=ecd4c7f0e5e4480cb3256a879ad9b614, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:38.752893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0584c9-a714-4152-ac92-f59371da1aaf None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:38.775715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 216/416] 10.222.0.52 () {58 vars in 1442 bytes} [Mon Aug 29 20:17:38 2022] PUT /identity/v3/projects/e848cede7541492584effd880adbb5d7/groups/ecd4c7f0e5e4480cb3256a879ad9b614/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:17:38.797480 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3a2e3-9cf7-4a09-b11f-72fd5997688d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:38.798215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3a2e3-9cf7-4a09-b11f-72fd5997688d None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:38.798493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3a2e3-9cf7-4a09-b11f-72fd5997688d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:38.798759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3a2e3-9cf7-4a09-b11f-72fd5997688d None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4/groups/966a197cdfa94922ba1af6351d420084/roles/2ae4df0c2db34d5092a5a05f3e512fdc` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:38.801151 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3a2e3-9cf7-4a09-b11f-72fd5997688d None admin] RBAC: Authorizing `identity:create_grant(project_id=48fa3e38610a4b67b7e535ae4148e9d4, group_id=966a197cdfa94922ba1af6351d420084, role_id=2ae4df0c2db34d5092a5a05f3e512fdc)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:38.802739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3a2e3-9cf7-4a09-b11f-72fd5997688d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:38.821960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 201/417] 10.222.0.52 () {58 vars in 1442 bytes} [Mon Aug 29 20:17:38 2022] PUT /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4/groups/966a197cdfa94922ba1af6351d420084/roles/2ae4df0c2db34d5092a5a05f3e512fdc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:17:38.835902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0584c9-a714-4152-ac92-f59371da1aaf None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:38.871746 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:38.999271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0584c9-a714-4152-ac92-f59371da1aaf None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:39.050581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1696af-a98f-48ea-859a-e91e9b611db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:39.051167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1696af-a98f-48ea-859a-e91e9b611db0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:39.051547 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1696af-a98f-48ea-859a-e91e9b611db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:39.051715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1696af-a98f-48ea-859a-e91e9b611db0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:39.065248 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1696af-a98f-48ea-859a-e91e9b611db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:39.070836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-4a1696af-a98f-48ea-859a-e91e9b611db0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:39.070836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:39.070836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:39.070836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:39.070836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:39.070836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:39.070836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:39.070836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:39.070836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:39.070836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:39.070836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:39.070836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:39.070836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:39.070836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:39.070836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:39.070836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:39.071946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:39.071946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:39.071946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:39.071946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:39.071946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:39.071946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:39.071946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:39.071946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:39.071946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:39.071946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:39.071946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:39.071946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:39.071946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:39.071946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:39.071946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:39.071946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:39.072943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:39.072943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:39.072943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:39.072943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:39.072943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:39.072943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:39.072943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:39.072943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:39.072943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:39.072943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:39.072943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:39.072943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:39.073871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523842-49b7-4cdf-8921-a061047f2ab3 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:39.073871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523842-49b7-4cdf-8921-a061047f2ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:39.074015 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 217/418] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:39.074115 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523842-49b7-4cdf-8921-a061047f2ab3 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:39.074115 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 202/419] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:17:39.079729 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b523842-49b7-4cdf-8921-a061047f2ab3 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:39.080049 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a80a2-73eb-4a2e-b9d9-23408597c47a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:39.080319 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a80a2-73eb-4a2e-b9d9-23408597c47a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:39.080548 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a80a2-73eb-4a2e-b9d9-23408597c47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:39.101378 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-751a80a2-73eb-4a2e-b9d9-23408597c47a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:39.102543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-751a80a2-73eb-4a2e-b9d9-23408597c47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:39.222995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 218/420] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:39.239286 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b523842-49b7-4cdf-8921-a061047f2ab3 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:39.298003 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a47c66-4b0c-4480-b8be-65861220b850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:39.298890 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a47c66-4b0c-4480-b8be-65861220b850 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:39.299167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a47c66-4b0c-4480-b8be-65861220b850 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:39.299555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a47c66-4b0c-4480-b8be-65861220b850 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:39.300254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a47c66-4b0c-4480-b8be-65861220b850 None admin] RBAC: Adding query filter params (name=member) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:39.300551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a47c66-4b0c-4480-b8be-65861220b850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:39.302000 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a47c66-4b0c-4480-b8be-65861220b850 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:39.312229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 203/421] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:39.318991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a80a2-73eb-4a2e-b9d9-23408597c47a None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:39.349026 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:39.476845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a80a2-73eb-4a2e-b9d9-23408597c47a None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:39.531667 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f7e90-fde4-4db1-a271-1de787f8be0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:39.532460 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f7e90-fde4-4db1-a271-1de787f8be0e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:39.532913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f7e90-fde4-4db1-a271-1de787f8be0e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:39.533211 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f7e90-fde4-4db1-a271-1de787f8be0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:39.623952 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f7e90-fde4-4db1-a271-1de787f8be0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:39.625863 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f7e90-fde4-4db1-a271-1de787f8be0e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:39.635495 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a47c66-4b0c-4480-b8be-65861220b850 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:39.640791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:39.669080 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:39.744904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 219/422] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:39.755067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f7e90-fde4-4db1-a271-1de787f8be0e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:39.844675 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a47c66-4b0c-4480-b8be-65861220b850 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:39.915947 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d1e82-2f90-43f3-899a-b218980aab18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:39.916641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d1e82-2f90-43f3-899a-b218980aab18 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:39.916921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d1e82-2f90-43f3-899a-b218980aab18 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:39.917192 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d1e82-2f90-43f3-899a-b218980aab18 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:39.940288 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d1e82-2f90-43f3-899a-b218980aab18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:39.945977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-558d1e82-2f90-43f3-899a-b218980aab18 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:39.945977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:39.945977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:39.945977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:39.945977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:39.945977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:39.945977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:39.945977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:39.945977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:39.945977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:39.945977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:39.945977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:39.945977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:39.945977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:39.945977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:39.945977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:39.946888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:39.946888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:39.946888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:39.946888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:39.946888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:39.946888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:39.946888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:39.946888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:39.946888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:39.946888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:39.946888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:39.946888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:39.946888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:39.946888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:39.946888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:39.946888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:39.947950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:39.947950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:39.947950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:39.947950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:39.947950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:39.947950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:39.947950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:39.947950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:39.947950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:39.947950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:39.947950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:39.947950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:39.949219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 204/423] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:17:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:39.956027 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d1e82-2f90-43f3-899a-b218980aab18 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:39.961592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f7e90-fde4-4db1-a271-1de787f8be0e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:39.984887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:40.037982 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c986f5-938d-4502-ba13-b23ed51763bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:40.038596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c986f5-938d-4502-ba13-b23ed51763bb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:40.038856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c986f5-938d-4502-ba13-b23ed51763bb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:40.039130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c986f5-938d-4502-ba13-b23ed51763bb None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:40.040308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c986f5-938d-4502-ba13-b23ed51763bb None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:40.042086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c986f5-938d-4502-ba13-b23ed51763bb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:40.044152 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 220/424] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:39 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:40.050268 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c986f5-938d-4502-ba13-b23ed51763bb None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:40.137179 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:40.175379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d1e82-2f90-43f3-899a-b218980aab18 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:40.222037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c986f5-938d-4502-ba13-b23ed51763bb None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:40.251104 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751044b3-edac-4f7d-8bd2-293f7cc33d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:40.251815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751044b3-edac-4f7d-8bd2-293f7cc33d28 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:40.252037 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751044b3-edac-4f7d-8bd2-293f7cc33d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:40.252306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751044b3-edac-4f7d-8bd2-293f7cc33d28 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:40.253019 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751044b3-edac-4f7d-8bd2-293f7cc33d28 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:40.253325 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751044b3-edac-4f7d-8bd2-293f7cc33d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:40.254874 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751044b3-edac-4f7d-8bd2-293f7cc33d28 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:40.265781 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 205/425] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:17:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:40.273635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751044b3-edac-4f7d-8bd2-293f7cc33d28 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:40.306615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a23d3b-6df3-4157-9ffe-14401a45fdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:40.307189 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a23d3b-6df3-4157-9ffe-14401a45fdea None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:40.307557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a23d3b-6df3-4157-9ffe-14401a45fdea None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:40.307825 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a23d3b-6df3-4157-9ffe-14401a45fdea None admin] PATH_INFO: `/v3/groups/966a197cdfa94922ba1af6351d420084` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:40.309820 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a23d3b-6df3-4157-9ffe-14401a45fdea None admin] RBAC: Authorizing `identity:get_group(group_id=966a197cdfa94922ba1af6351d420084)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:40.311287 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a23d3b-6df3-4157-9ffe-14401a45fdea None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:40.314331 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 221/426] 10.222.0.52 () {56 vars in 1180 bytes} [Mon Aug 29 20:17:40 2022] GET /identity/v3/groups/966a197cdfa94922ba1af6351d420084 => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:40.322513 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a23d3b-6df3-4157-9ffe-14401a45fdea None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:40.414509 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:40.473881 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751044b3-edac-4f7d-8bd2-293f7cc33d28 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:40.509305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d7ebc-3b3d-4018-9365-77993b0cc211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:40.509946 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d7ebc-3b3d-4018-9365-77993b0cc211 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:40.510229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d7ebc-3b3d-4018-9365-77993b0cc211 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:40.510500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d7ebc-3b3d-4018-9365-77993b0cc211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:40.517637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a23d3b-6df3-4157-9ffe-14401a45fdea None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:40.528521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:40.589387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d7ebc-3b3d-4018-9365-77993b0cc211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:40.590810 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d7ebc-3b3d-4018-9365-77993b0cc211 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:40.602071 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449ee37-b705-4c8e-ad27-aa686545f964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:40.603064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449ee37-b705-4c8e-ad27-aa686545f964 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:40.603528 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449ee37-b705-4c8e-ad27-aa686545f964 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:40.603979 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449ee37-b705-4c8e-ad27-aa686545f964 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:40.604903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449ee37-b705-4c8e-ad27-aa686545f964 None admin] RBAC: Adding query filter params (group.id=966a197cdfa94922ba1af6351d420084, role.id=73f8d83949b241d2bcd58d267657768a, scope.project.id=ae8e0eac9762422d8ac3147d4f823f90) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:40.605433 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449ee37-b705-4c8e-ad27-aa686545f964 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:40.607091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449ee37-b705-4c8e-ad27-aa686545f964 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:40.620451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 222/427] 10.222.0.52 () {56 vars in 1376 bytes} [Mon Aug 29 20:17:40 2022] GET /identity/v3/role_assignments?group.id=966a197cdfa94922ba1af6351d420084&scope.project.id=ae8e0eac9762422d8ac3147d4f823f90&role.id=73f8d83949b241d2bcd58d267657768a => generated 611 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:40.703215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4c06e-27cc-42f4-868f-465b3c42abc2 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:40.703859 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4c06e-27cc-42f4-868f-465b3c42abc2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:40.704318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4c06e-27cc-42f4-868f-465b3c42abc2 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:40.705932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 223/428] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:40.714094 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 206/429] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:40.715225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a293087-f6c9-4142-9a24-f939fde4047d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:40.715503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a293087-f6c9-4142-9a24-f939fde4047d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:40.715769 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a293087-f6c9-4142-9a24-f939fde4047d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:40.727144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d7ebc-3b3d-4018-9365-77993b0cc211 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:40.764972 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3a293087-f6c9-4142-9a24-f939fde4047d None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:40.766241 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3a293087-f6c9-4142-9a24-f939fde4047d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:40.835020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:40.864227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 224/430] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:40.900562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d7ebc-3b3d-4018-9365-77993b0cc211 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:40.940258 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa798b-2d10-4498-83d2-3cdf6e0427bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:40.941255 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa798b-2d10-4498-83d2-3cdf6e0427bd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:40.941779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa798b-2d10-4498-83d2-3cdf6e0427bd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:40.942244 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa798b-2d10-4498-83d2-3cdf6e0427bd None admin] PATH_INFO: `/v3/projects/ae8e0eac9762422d8ac3147d4f823f90` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:40.943598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa798b-2d10-4498-83d2-3cdf6e0427bd None admin] RBAC: Authorizing `identity:get_project(project_id=ae8e0eac9762422d8ac3147d4f823f90)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:40.945293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa798b-2d10-4498-83d2-3cdf6e0427bd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:40.947519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 207/431] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:40 2022] GET /identity/v3/projects/ae8e0eac9762422d8ac3147d4f823f90 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:40.953490 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a293087-f6c9-4142-9a24-f939fde4047d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:41.008239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:41.077689 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a293087-f6c9-4142-9a24-f939fde4047d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:41.118803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f9216-25b7-4862-86f1-89ff78a0fae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:41.119370 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f9216-25b7-4862-86f1-89ff78a0fae0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:41.119648 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f9216-25b7-4862-86f1-89ff78a0fae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:41.119915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f9216-25b7-4862-86f1-89ff78a0fae0 None admin] PATH_INFO: `/v3/groups/966a197cdfa94922ba1af6351d420084` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:41.121037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f9216-25b7-4862-86f1-89ff78a0fae0 None admin] RBAC: Authorizing `identity:get_group(group_id=966a197cdfa94922ba1af6351d420084)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:41.122522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f9216-25b7-4862-86f1-89ff78a0fae0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:41.124371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 225/432] 10.222.0.52 () {56 vars in 1180 bytes} [Mon Aug 29 20:17:40 2022] GET /identity/v3/groups/966a197cdfa94922ba1af6351d420084 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:41.130128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa798b-2d10-4498-83d2-3cdf6e0427bd None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:41.170237 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f9216-25b7-4862-86f1-89ff78a0fae0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:41.295218 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa798b-2d10-4498-83d2-3cdf6e0427bd None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:41.306656 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f9216-25b7-4862-86f1-89ff78a0fae0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:41.316929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:41.323775 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:41.355041 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea95445-ac1b-4893-a18f-89a80459c493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:41.355660 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea95445-ac1b-4893-a18f-89a80459c493 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:41.355935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea95445-ac1b-4893-a18f-89a80459c493 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:41.356202 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea95445-ac1b-4893-a18f-89a80459c493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:41.356966 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea95445-ac1b-4893-a18f-89a80459c493 None admin] RBAC: Adding query filter params (group.id=966a197cdfa94922ba1af6351d420084, role.id=2ae4df0c2db34d5092a5a05f3e512fdc, scope.project.id=ae8e0eac9762422d8ac3147d4f823f90) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:41.357069 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbbbff-11ee-4881-b2fa-e17c244e3d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:41.357259 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea95445-ac1b-4893-a18f-89a80459c493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:41.357733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbbbff-11ee-4881-b2fa-e17c244e3d29 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:41.358005 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbbbff-11ee-4881-b2fa-e17c244e3d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:41.358270 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbbbff-11ee-4881-b2fa-e17c244e3d29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:41.358795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea95445-ac1b-4893-a18f-89a80459c493 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:41.365166 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 208/433] 10.222.0.52 () {56 vars in 1376 bytes} [Mon Aug 29 20:17:41 2022] GET /identity/v3/role_assignments?group.id=966a197cdfa94922ba1af6351d420084&scope.project.id=ae8e0eac9762422d8ac3147d4f823f90&role.id=2ae4df0c2db34d5092a5a05f3e512fdc => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:41.366459 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f28a7-d118-43bd-9d68-cb2411661ea8 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:41.366734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f28a7-d118-43bd-9d68-cb2411661ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:41.367050 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f28a7-d118-43bd-9d68-cb2411661ea8 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:41.368454 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 209/434] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:41.375321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbbbff-11ee-4881-b2fa-e17c244e3d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:41.376019 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df93e31-d79f-4a95-b5ca-6d4d21328654 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:41.376405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df93e31-d79f-4a95-b5ca-6d4d21328654 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:41.376774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df93e31-d79f-4a95-b5ca-6d4d21328654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:41.381256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-77fbbbff-11ee-4881-b2fa-e17c244e3d29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:41.381256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:41.381256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:41.381256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:41.381256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:41.381256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:41.381256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:41.381256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:41.381256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:41.381256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:41.381256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:41.381256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:41.381256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:41.381256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:41.381256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:41.381256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:41.382247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:41.382247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:41.382247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:41.382247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:41.382247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:41.382247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:41.382247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:41.382247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:41.382247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:41.382247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:41.382247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:41.382247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:41.382247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:41.382247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:41.382247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:41.382247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:41.383031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:41.383031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:41.383031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:41.383031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:41.383031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:41.383031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:41.383031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:41.383031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:41.383031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:41.383031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:41.383031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:17:41.383031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:41.385803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 226/435] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:41.394578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbbbff-11ee-4881-b2fa-e17c244e3d29 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:41.402564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3df93e31-d79f-4a95-b5ca-6d4d21328654 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:41.404142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3df93e31-d79f-4a95-b5ca-6d4d21328654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:41.506273 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 210/436] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:41.507968 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278d464-29d5-47e6-8159-e7bfeefaf941 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:41.508490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278d464-29d5-47e6-8159-e7bfeefaf941 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:41.508954 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278d464-29d5-47e6-8159-e7bfeefaf941 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:41.511380 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 211/437] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:41.518574 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f04f-61e4-41f0-a47c-780da50ab95b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:41.519421 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f04f-61e4-41f0-a47c-780da50ab95b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:41.519975 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f04f-61e4-41f0-a47c-780da50ab95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:41.543703 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-4902f04f-61e4-41f0-a47c-780da50ab95b None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:41.545526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4902f04f-61e4-41f0-a47c-780da50ab95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:41.548348 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbbbff-11ee-4881-b2fa-e17c244e3d29 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:41.591513 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07084f-9656-448b-8e27-ffb6f839c566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:41.592140 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07084f-9656-448b-8e27-ffb6f839c566 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:41.592428 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07084f-9656-448b-8e27-ffb6f839c566 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:41.592682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07084f-9656-448b-8e27-ffb6f839c566 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:41.594332 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07084f-9656-448b-8e27-ffb6f839c566 None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:41.594755 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07084f-9656-448b-8e27-ffb6f839c566 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:41.596296 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07084f-9656-448b-8e27-ffb6f839c566 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:41.608072 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 227/438] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:17:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:41.614208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07084f-9656-448b-8e27-ffb6f839c566 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:41.637768 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 212/439] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:17:41.652694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:41.729811 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07084f-9656-448b-8e27-ffb6f839c566 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:41.771358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb782fc5-c557-4c8c-ba92-592cd3d4c337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:41.772312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb782fc5-c557-4c8c-ba92-592cd3d4c337 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:41.772773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb782fc5-c557-4c8c-ba92-592cd3d4c337 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:41.773195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb782fc5-c557-4c8c-ba92-592cd3d4c337 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:41.803549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902f04f-61e4-41f0-a47c-780da50ab95b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:41.852959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:41.867638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb782fc5-c557-4c8c-ba92-592cd3d4c337 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:41.870122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb782fc5-c557-4c8c-ba92-592cd3d4c337 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:41.906491 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:41.940014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902f04f-61e4-41f0-a47c-780da50ab95b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:41.975123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f914e-83ac-43c1-86db-fed47f7f0374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:41.975892 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f914e-83ac-43c1-86db-fed47f7f0374 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:41.976170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f914e-83ac-43c1-86db-fed47f7f0374 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:41.976655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f914e-83ac-43c1-86db-fed47f7f0374 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:41.980767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 228/440] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 20:17:41.985108 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb782fc5-c557-4c8c-ba92-592cd3d4c337 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:41.986769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f914e-83ac-43c1-86db-fed47f7f0374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:41.991509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-c80f914e-83ac-43c1-86db-fed47f7f0374 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:41.991509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:41.991509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:41.991509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:41.991509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:41.991509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:41.991509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:41.991509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:41.991509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:41.991509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:41.991509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:41.991509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:41.991509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:41.991509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:41.991509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:41.991509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:41.992557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:41.992557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:41.992557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:41.992557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:41.992557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:41.992557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:41.992557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:41.992557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:41.992557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:41.992557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:41.992557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:41.992557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:41.992557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:41.992557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:41.992557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:41.992557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:41.993378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:41.993378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:41.993378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:41.993378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:41.993378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:41.993378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:41.993378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:41.993378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:41.993378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:41.993378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:41.993378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:41.993378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:41.993378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 213/441] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:17:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:41.994142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f914e-83ac-43c1-86db-fed47f7f0374 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:42.090852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb782fc5-c557-4c8c-ba92-592cd3d4c337 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:42.101643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:42.109636 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f914e-83ac-43c1-86db-fed47f7f0374 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:42.123100 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:42.129915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bdbb2-7aa4-4604-af3e-2549092cb06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:42.130485 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bdbb2-7aa4-4604-af3e-2549092cb06c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:42.130757 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bdbb2-7aa4-4604-af3e-2549092cb06c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:42.131024 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bdbb2-7aa4-4604-af3e-2549092cb06c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:42.142160 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bdbb2-7aa4-4604-af3e-2549092cb06c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:42.145717 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebb6c8-ae46-44a7-a692-8a9617a8237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:42.146345 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebb6c8-ae46-44a7-a692-8a9617a8237f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:42.146618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebb6c8-ae46-44a7-a692-8a9617a8237f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:42.146941 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebb6c8-ae46-44a7-a692-8a9617a8237f None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:42.147542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-410bdbb2-7aa4-4604-af3e-2549092cb06c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:17:42.147542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:42.147542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:42.147542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:42.147542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:42.147542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:42.147542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:42.147542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:42.147542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:42.147542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:42.147542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:42.147542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:42.147542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:42.147542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:42.147542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:42.147542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:42.148436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:42.148436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:42.148436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:42.148436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:42.148436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:42.148436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:42.148436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:42.148436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:42.148436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:42.148436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:42.148436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:42.148436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:42.148436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:42.148436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:42.148436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:42.148436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:42.149559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:42.149559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:42.149559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:42.149559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:42.149559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:42.149559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:42.149559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:42.149559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:42.149559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:42.149559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:42.149559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:17:42.149559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:42.150438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebb6c8-ae46-44a7-a692-8a9617a8237f None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:42.150514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 229/442] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:17:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:42.150579 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebb6c8-ae46-44a7-a692-8a9617a8237f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:42.150642 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bdbb2-7aa4-4604-af3e-2549092cb06c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:42.155938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 214/443] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:41 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:42.155938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebb6c8-ae46-44a7-a692-8a9617a8237f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:42.258006 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bdbb2-7aa4-4604-af3e-2549092cb06c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:42.262328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebb6c8-ae46-44a7-a692-8a9617a8237f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:42.293763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9594ad9-95dc-45d9-ba14-b0023db28af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:42.294375 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9594ad9-95dc-45d9-ba14-b0023db28af9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:42.294677 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9594ad9-95dc-45d9-ba14-b0023db28af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:42.294947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9594ad9-95dc-45d9-ba14-b0023db28af9 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:42.295617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9594ad9-95dc-45d9-ba14-b0023db28af9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:42.295947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9594ad9-95dc-45d9-ba14-b0023db28af9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:42.297346 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9594ad9-95dc-45d9-ba14-b0023db28af9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:42.297571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9577ee-d968-427b-b305-c9e9c1adaa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:42.298183 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9577ee-d968-427b-b305-c9e9c1adaa77 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:42.298456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9577ee-d968-427b-b305-c9e9c1adaa77 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:42.298797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9577ee-d968-427b-b305-c9e9c1adaa77 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:42.299393 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9577ee-d968-427b-b305-c9e9c1adaa77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:42.299690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9577ee-d968-427b-b305-c9e9c1adaa77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:42.301054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9577ee-d968-427b-b305-c9e9c1adaa77 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:42.305723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 230/444] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:17:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:42.306539 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9594ad9-95dc-45d9-ba14-b0023db28af9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:42.314644 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 215/445] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:42.315652 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9577ee-d968-427b-b305-c9e9c1adaa77 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:42.350169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:42.366188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:42.415233 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9594ad9-95dc-45d9-ba14-b0023db28af9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:42.429401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9577ee-d968-427b-b305-c9e9c1adaa77 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:42.449505 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d4d71-719a-435f-b9bd-d63750ee1ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:42.450133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d4d71-719a-435f-b9bd-d63750ee1ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:42.450404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d4d71-719a-435f-b9bd-d63750ee1ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:42.450677 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d4d71-719a-435f-b9bd-d63750ee1ab0 None admin] PATH_INFO: `/v3/groups/966a197cdfa94922ba1af6351d420084` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:42.451803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d4d71-719a-435f-b9bd-d63750ee1ab0 None admin] RBAC: Authorizing `identity:get_group(group_id=966a197cdfa94922ba1af6351d420084)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:42.453282 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d4d71-719a-435f-b9bd-d63750ee1ab0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:42.454894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 231/446] 10.222.0.52 () {56 vars in 1180 bytes} [Mon Aug 29 20:17:42 2022] GET /identity/v3/groups/966a197cdfa94922ba1af6351d420084 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:42.455639 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d4d71-719a-435f-b9bd-d63750ee1ab0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:42.468705 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cefa5e-63cd-45a3-8201-7efea49bf055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:42.469320 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cefa5e-63cd-45a3-8201-7efea49bf055 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:42.469631 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cefa5e-63cd-45a3-8201-7efea49bf055 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:42.469900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cefa5e-63cd-45a3-8201-7efea49bf055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:42.542396 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cefa5e-63cd-45a3-8201-7efea49bf055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:42.543815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cefa5e-63cd-45a3-8201-7efea49bf055 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:42.561907 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d4d71-719a-435f-b9bd-d63750ee1ab0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:42.571729 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:42.583089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:42.598193 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6855229-249c-4a0d-8975-ad952610f8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:42.598799 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6855229-249c-4a0d-8975-ad952610f8e6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:42.599088 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6855229-249c-4a0d-8975-ad952610f8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:42.599358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6855229-249c-4a0d-8975-ad952610f8e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:42.658697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 216/447] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:42.659451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cefa5e-63cd-45a3-8201-7efea49bf055 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:42.676112 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6855229-249c-4a0d-8975-ad952610f8e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:42.677644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6855229-249c-4a0d-8975-ad952610f8e6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:42.767354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cefa5e-63cd-45a3-8201-7efea49bf055 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:42.786121 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 232/448] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:42.786967 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6855229-249c-4a0d-8975-ad952610f8e6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:42.795497 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:42.805508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c410c57-e108-46a6-9b16-6d89734627c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:42.806117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c410c57-e108-46a6-9b16-6d89734627c9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:42.806393 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c410c57-e108-46a6-9b16-6d89734627c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:42.806664 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c410c57-e108-46a6-9b16-6d89734627c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:42.807384 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c410c57-e108-46a6-9b16-6d89734627c9 None admin] RBAC: Adding query filter params (group.id=966a197cdfa94922ba1af6351d420084, role.id=73f8d83949b241d2bcd58d267657768a, scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:42.807685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c410c57-e108-46a6-9b16-6d89734627c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:42.809125 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c410c57-e108-46a6-9b16-6d89734627c9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:42.811886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:42.815315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 217/449] 10.222.0.52 () {56 vars in 1376 bytes} [Mon Aug 29 20:17:42 2022] GET /identity/v3/role_assignments?group.id=966a197cdfa94922ba1af6351d420084&scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4&role.id=73f8d83949b241d2bcd58d267657768a => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:42.816160 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c410c57-e108-46a6-9b16-6d89734627c9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:42.908804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6855229-249c-4a0d-8975-ad952610f8e6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:42.932988 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c410c57-e108-46a6-9b16-6d89734627c9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:42.948744 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905899e-d3d9-40da-80c4-e741dce831ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:42.949751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905899e-d3d9-40da-80c4-e741dce831ef None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:42.950206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905899e-d3d9-40da-80c4-e741dce831ef None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:42.950742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905899e-d3d9-40da-80c4-e741dce831ef None admin] PATH_INFO: `/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:42.952282 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905899e-d3d9-40da-80c4-e741dce831ef None admin] RBAC: Authorizing `identity:get_project(project_id=48fa3e38610a4b67b7e535ae4148e9d4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:42.954036 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905899e-d3d9-40da-80c4-e741dce831ef None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:42.956070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 233/450] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:42 2022] GET /identity/v3/projects/48fa3e38610a4b67b7e535ae4148e9d4 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:42.962008 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905899e-d3d9-40da-80c4-e741dce831ef None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:42.970324 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bff50d-cc09-4133-8300-72d352b1b20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:42.970998 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bff50d-cc09-4133-8300-72d352b1b20c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:42.971279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bff50d-cc09-4133-8300-72d352b1b20c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:42.971279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bff50d-cc09-4133-8300-72d352b1b20c None admin] PATH_INFO: `/v3/projects/e848cede7541492584effd880adbb5d7` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:42.972714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bff50d-cc09-4133-8300-72d352b1b20c None admin] RBAC: Authorizing `identity:get_project(project_id=e848cede7541492584effd880adbb5d7)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:42.974216 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bff50d-cc09-4133-8300-72d352b1b20c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:42.976780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 218/451] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:17:42 2022] GET /identity/v3/projects/e848cede7541492584effd880adbb5d7 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:42.982385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bff50d-cc09-4133-8300-72d352b1b20c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:43.053319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:43.085716 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:43.100079 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905899e-d3d9-40da-80c4-e741dce831ef None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:43.116609 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bff50d-cc09-4133-8300-72d352b1b20c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:43.138760 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d348b-716a-408c-82fd-bb7aa589e966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:43.139517 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d348b-716a-408c-82fd-bb7aa589e966 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:43.139800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d348b-716a-408c-82fd-bb7aa589e966 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:43.140071 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d348b-716a-408c-82fd-bb7aa589e966 None admin] PATH_INFO: `/v3/groups/966a197cdfa94922ba1af6351d420084` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:43.141278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d348b-716a-408c-82fd-bb7aa589e966 None admin] RBAC: Authorizing `identity:get_group(group_id=966a197cdfa94922ba1af6351d420084)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:43.143889 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d348b-716a-408c-82fd-bb7aa589e966 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:43.145885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 234/452] 10.222.0.52 () {56 vars in 1180 bytes} [Mon Aug 29 20:17:42 2022] GET /identity/v3/groups/966a197cdfa94922ba1af6351d420084 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:43.151624 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d348b-716a-408c-82fd-bb7aa589e966 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:43.162151 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcd7f4-166d-473b-8d90-12d01a24516a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:43.162816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcd7f4-166d-473b-8d90-12d01a24516a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:43.163086 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcd7f4-166d-473b-8d90-12d01a24516a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:43.163362 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcd7f4-166d-473b-8d90-12d01a24516a None admin] PATH_INFO: `/v3/groups/ecd4c7f0e5e4480cb3256a879ad9b614` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:43.164965 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcd7f4-166d-473b-8d90-12d01a24516a None admin] RBAC: Authorizing `identity:get_group(group_id=ecd4c7f0e5e4480cb3256a879ad9b614)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:43.166802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcd7f4-166d-473b-8d90-12d01a24516a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:43.168876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 219/453] 10.222.0.52 () {56 vars in 1180 bytes} [Mon Aug 29 20:17:42 2022] GET /identity/v3/groups/ecd4c7f0e5e4480cb3256a879ad9b614 => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:43.177051 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcd7f4-166d-473b-8d90-12d01a24516a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:43.266050 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d348b-716a-408c-82fd-bb7aa589e966 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:43.284872 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcd7f4-166d-473b-8d90-12d01a24516a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:43.301713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78974576-8acf-43d0-8d3d-4a308d497764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:43.302317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78974576-8acf-43d0-8d3d-4a308d497764 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:43.302591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78974576-8acf-43d0-8d3d-4a308d497764 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:43.302856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78974576-8acf-43d0-8d3d-4a308d497764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:43.303629 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78974576-8acf-43d0-8d3d-4a308d497764 None admin] RBAC: Adding query filter params (group.id=966a197cdfa94922ba1af6351d420084, role.id=2ae4df0c2db34d5092a5a05f3e512fdc, scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:43.303881 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78974576-8acf-43d0-8d3d-4a308d497764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:43.305336 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78974576-8acf-43d0-8d3d-4a308d497764 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:43.310583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:43.311689 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 235/454] 10.222.0.52 () {56 vars in 1376 bytes} [Mon Aug 29 20:17:43 2022] GET /identity/v3/role_assignments?group.id=966a197cdfa94922ba1af6351d420084&scope.project.id=48fa3e38610a4b67b7e535ae4148e9d4&role.id=2ae4df0c2db34d5092a5a05f3e512fdc => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:43.320761 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbcc51-a345-476e-9d88-06b56539b214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:43.321432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbcc51-a345-476e-9d88-06b56539b214 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:43.321725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbcc51-a345-476e-9d88-06b56539b214 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:43.321994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbcc51-a345-476e-9d88-06b56539b214 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:43.322734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbcc51-a345-476e-9d88-06b56539b214 None admin] RBAC: Adding query filter params (group.id=ecd4c7f0e5e4480cb3256a879ad9b614, role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=e848cede7541492584effd880adbb5d7) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:43.323038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbcc51-a345-476e-9d88-06b56539b214 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:43.324512 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbcc51-a345-476e-9d88-06b56539b214 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:43.331330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 220/455] 10.222.0.52 () {56 vars in 1376 bytes} [Mon Aug 29 20:17:43 2022] GET /identity/v3/role_assignments?group.id=ecd4c7f0e5e4480cb3256a879ad9b614&scope.project.id=e848cede7541492584effd880adbb5d7&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:45.768450 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c8755-5eb9-4afd-b046-ae61d5c114af None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:45.769502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c8755-5eb9-4afd-b046-ae61d5c114af None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:45.769995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c8755-5eb9-4afd-b046-ae61d5c114af None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:45.771927 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 236/456] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:45.777506 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152628b-3b4e-4384-bff2-14ccb7654822 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:45.778358 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152628b-3b4e-4384-bff2-14ccb7654822 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:45.778834 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152628b-3b4e-4384-bff2-14ccb7654822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:45.802999 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-4152628b-3b4e-4384-bff2-14ccb7654822 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:45.804549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4152628b-3b4e-4384-bff2-14ccb7654822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:45.895409 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 221/457] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:17:46.183001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c8755-5eb9-4afd-b046-ae61d5c114af None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:46.213421 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a730ff-6553-49b5-aee2-e2c0c4fb7010 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:46.214128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a730ff-6553-49b5-aee2-e2c0c4fb7010 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:46.214648 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a730ff-6553-49b5-aee2-e2c0c4fb7010 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:46.217069 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:46.217446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 222/458] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:46.224545 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27c378-79a0-43c4-8df7-bfa7ddc1287d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:46.225105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27c378-79a0-43c4-8df7-bfa7ddc1287d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:46.225563 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27c378-79a0-43c4-8df7-bfa7ddc1287d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:46.260638 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-bb27c378-79a0-43c4-8df7-bfa7ddc1287d None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:46.261933 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bb27c378-79a0-43c4-8df7-bfa7ddc1287d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:46.363072 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c8755-5eb9-4afd-b046-ae61d5c114af None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:46.388798 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 223/459] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:17:46.390803 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fbe17-a834-4206-89ef-a8b78c1c4aaa None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:46.391350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fbe17-a834-4206-89ef-a8b78c1c4aaa None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:46.392046 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fbe17-a834-4206-89ef-a8b78c1c4aaa None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:46.397414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 224/460] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:46.401512 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84feb6-0e24-479a-8fcc-3d35e496e449 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:46.402097 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84feb6-0e24-479a-8fcc-3d35e496e449 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:46.402746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84feb6-0e24-479a-8fcc-3d35e496e449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:46.428178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6d84feb6-0e24-479a-8fcc-3d35e496e449 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:46.429832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6d84feb6-0e24-479a-8fcc-3d35e496e449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:46.432718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954ca75-57b7-4646-9ca1-01068ae2ea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:46.433549 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954ca75-57b7-4646-9ca1-01068ae2ea7a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:46.433864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954ca75-57b7-4646-9ca1-01068ae2ea7a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:46.434182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954ca75-57b7-4646-9ca1-01068ae2ea7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:46.456604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954ca75-57b7-4646-9ca1-01068ae2ea7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:46.458506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954ca75-57b7-4646-9ca1-01068ae2ea7a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:46.485560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-3954ca75-57b7-4646-9ca1-01068ae2ea7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:46.485560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:46.485560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:46.485560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:46.485560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:46.485560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:46.485560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:46.485560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:46.485560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:46.485560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:46.485560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:46.485560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:46.485560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:46.485560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:46.485560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:46.485560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:46.486862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:46.486862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:46.486862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:46.486862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:46.486862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:46.486862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:46.486862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:46.486862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:46.486862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:46.486862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:46.486862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:46.486862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:46.486862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:46.486862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:46.486862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:46.486862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:46.486862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:46.488125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:46.488125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:46.488125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:46.488125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 237/461] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:46.498655 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954ca75-57b7-4646-9ca1-01068ae2ea7a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:46.511873 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:46.542909 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 225/462] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:46.599064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:46.608240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198941bb-9829-4adb-895b-b9f412779140 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:46.608884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198941bb-9829-4adb-895b-b9f412779140 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:46.609592 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198941bb-9829-4adb-895b-b9f412779140 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:46.611402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 226/463] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:46.617796 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c5467-60c0-4394-9766-ca319662f9d0 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:46.618399 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c5467-60c0-4394-9766-ca319662f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:46.618941 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c5467-60c0-4394-9766-ca319662f9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:46.651361 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ab1c5467-60c0-4394-9766-ca319662f9d0 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:46.655205 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ab1c5467-60c0-4394-9766-ca319662f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:46.671496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954ca75-57b7-4646-9ca1-01068ae2ea7a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:46.739757 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af1d00-a91f-463b-ac9f-d8722177a803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:46.740794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af1d00-a91f-463b-ac9f-d8722177a803 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:46.741311 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af1d00-a91f-463b-ac9f-d8722177a803 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:46.741812 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af1d00-a91f-463b-ac9f-d8722177a803 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:46.742731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af1d00-a91f-463b-ac9f-d8722177a803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:46.743227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af1d00-a91f-463b-ac9f-d8722177a803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:46.744916 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af1d00-a91f-463b-ac9f-d8722177a803 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:46.774210 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 238/464] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:46.775810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af1d00-a91f-463b-ac9f-d8722177a803 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:46.792583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 227/465] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:17:46.793584 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c5467-60c0-4394-9766-ca319662f9d0 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:46.919105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af1d00-a91f-463b-ac9f-d8722177a803 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:46.949940 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c5467-60c0-4394-9766-ca319662f9d0 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:46.956238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:46.963112 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5e467-3d4c-4c75-bc88-ef8c9f3ddbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:46.964102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5e467-3d4c-4c75-bc88-ef8c9f3ddbae None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:46.964610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5e467-3d4c-4c75-bc88-ef8c9f3ddbae None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:46.965060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5e467-3d4c-4c75-bc88-ef8c9f3ddbae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:46.965742 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:46.978847 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5e467-3d4c-4c75-bc88-ef8c9f3ddbae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:46.980682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5e467-3d4c-4c75-bc88-ef8c9f3ddbae None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:46.992693 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94bedb-9c77-476f-964f-00d893ab3264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:46.992892 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94bedb-9c77-476f-964f-00d893ab3264 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:46.993168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94bedb-9c77-476f-964f-00d893ab3264 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:46.993472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94bedb-9c77-476f-964f-00d893ab3264 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:46.994121 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94bedb-9c77-476f-964f-00d893ab3264 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:46.995593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94bedb-9c77-476f-964f-00d893ab3264 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:47.003318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-7ca5e467-3d4c-4c75-bc88-ef8c9f3ddbae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:47.003318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:47.003318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:47.003318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:47.003318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:47.003318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:47.003318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:47.003318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:47.003318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:47.003318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:47.003318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:47.003318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:47.003318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:47.003318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:47.003318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:47.003318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:47.004404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:47.004404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:47.004404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:47.004404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:47.004404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:47.004404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:47.004404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:47.004404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:47.004404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:47.004404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:47.004404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:47.004404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:47.004404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:47.004404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:47.004404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:47.004404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:47.004404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:47.005461 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:47.005461 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:47.005461 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:47.009266 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 239/466] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:47.010654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5e467-3d4c-4c75-bc88-ef8c9f3ddbae None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:47.030906 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 228/467] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:17:46 2022] POST /identity/v3/users => generated 246 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:17:47.036824 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94bedb-9c77-476f-964f-00d893ab3264 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:47.164390 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5e467-3d4c-4c75-bc88-ef8c9f3ddbae None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:47.168443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94bedb-9c77-476f-964f-00d893ab3264 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:47.208727 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf41b1-f581-49ff-855a-c621738b5813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:47.209179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10e992-2ecb-4fa0-826b-3a2411945146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:47.209432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf41b1-f581-49ff-855a-c621738b5813 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:47.209716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf41b1-f581-49ff-855a-c621738b5813 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:47.209986 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf41b1-f581-49ff-855a-c621738b5813 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:47.210568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10e992-2ecb-4fa0-826b-3a2411945146 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:47.210666 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf41b1-f581-49ff-855a-c621738b5813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:47.210940 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf41b1-f581-49ff-855a-c621738b5813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:47.211269 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10e992-2ecb-4fa0-826b-3a2411945146 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:47.211696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10e992-2ecb-4fa0-826b-3a2411945146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:47.212340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf41b1-f581-49ff-855a-c621738b5813 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:47.226403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10e992-2ecb-4fa0-826b-3a2411945146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:47.228228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10e992-2ecb-4fa0-826b-3a2411945146 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:47.238828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 229/468] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:47.240484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf41b1-f581-49ff-855a-c621738b5813 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:47.248227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-eb10e992-2ecb-4fa0-826b-3a2411945146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:47.248227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:47.248227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:47.248227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:47.248227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:47.248227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:47.248227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:47.248227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:47.248227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:47.248227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:47.248227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:47.248227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:47.248227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:47.248227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:47.248227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:47.248227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:47.249200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:47.249200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:47.249200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:47.249200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:47.249200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:47.249200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:47.249200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:47.249200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:47.249200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:47.249200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:47.249200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:47.249200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:47.249200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:47.249200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:47.249200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:47.249200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:47.249200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:47.250598 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:47.250598 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:47.250598 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:47.250598 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 240/469] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:47.251585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10e992-2ecb-4fa0-826b-3a2411945146 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:47.290409 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:47.308700 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:47.393962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10e992-2ecb-4fa0-826b-3a2411945146 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:47.395158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf41b1-f581-49ff-855a-c621738b5813 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:47.432927 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262226f-b767-4731-b695-4bb8d99fc35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:47.433788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262226f-b767-4731-b695-4bb8d99fc35a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:47.434133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262226f-b767-4731-b695-4bb8d99fc35a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:47.434397 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262226f-b767-4731-b695-4bb8d99fc35a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:47.435863 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ec866-de3b-48b5-83ed-dfe51a84378d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:47.436818 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ec866-de3b-48b5-83ed-dfe51a84378d None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:47.437163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ec866-de3b-48b5-83ed-dfe51a84378d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:47.437533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ec866-de3b-48b5-83ed-dfe51a84378d None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:47.438662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ec866-de3b-48b5-83ed-dfe51a84378d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:47.440226 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ec866-de3b-48b5-83ed-dfe51a84378d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:47.446969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262226f-b767-4731-b695-4bb8d99fc35a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:47.448592 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262226f-b767-4731-b695-4bb8d99fc35a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:47.465844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-d262226f-b767-4731-b695-4bb8d99fc35a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:47.465844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:47.465844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:47.465844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:47.465844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:47.465844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:47.465844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:47.465844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:47.465844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:47.465844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:47.465844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:47.465844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:47.465844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:47.465844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:47.465844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:47.465844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:47.467013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:47.467013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:47.467013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:47.467013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:47.467013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:47.467013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:47.467013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:47.467013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:47.467013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:47.467013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:47.467013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:47.467013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:47.467013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:47.467013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:47.467013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:47.467013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:47.467013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:47.468625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:47.468625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:47.468625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:47.468625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 230/470] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:47.468998 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262226f-b767-4731-b695-4bb8d99fc35a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:47.473529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 241/471] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:17:47 2022] POST /identity/v3/users => generated 248 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:17:47.475565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ec866-de3b-48b5-83ed-dfe51a84378d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:47.585970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:47.604182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:47.615625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262226f-b767-4731-b695-4bb8d99fc35a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:47.616904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ec866-de3b-48b5-83ed-dfe51a84378d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:47.663054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab001a-6038-48a1-b90d-222dc8f53b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:47.664110 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab001a-6038-48a1-b90d-222dc8f53b0e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:47.664334 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99377735-3e65-46b6-92b9-8a15bffeff24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:47.664817 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab001a-6038-48a1-b90d-222dc8f53b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:47.664943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99377735-3e65-46b6-92b9-8a15bffeff24 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:47.665214 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99377735-3e65-46b6-92b9-8a15bffeff24 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:47.666239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99377735-3e65-46b6-92b9-8a15bffeff24 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:47.666239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99377735-3e65-46b6-92b9-8a15bffeff24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:47.666453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99377735-3e65-46b6-92b9-8a15bffeff24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:47.666703 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab001a-6038-48a1-b90d-222dc8f53b0e None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:47.667528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab001a-6038-48a1-b90d-222dc8f53b0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:47.667841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99377735-3e65-46b6-92b9-8a15bffeff24 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:47.668183 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab001a-6038-48a1-b90d-222dc8f53b0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:47.670047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab001a-6038-48a1-b90d-222dc8f53b0e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:47.681915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 242/472] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:47.683022 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2295a06-b719-4696-9b58-f75d50cf8fd6 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:47.683303 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2295a06-b719-4696-9b58-f75d50cf8fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:47.683575 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2295a06-b719-4696-9b58-f75d50cf8fd6 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:47.684771 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 231/473] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:47.684878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 243/474] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:47.690308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2295a06-b719-4696-9b58-f75d50cf8fd6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:47.690904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53284bd3-6798-4e13-95ca-1091b7c5a234 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:47.691196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53284bd3-6798-4e13-95ca-1091b7c5a234 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:47.691473 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53284bd3-6798-4e13-95ca-1091b7c5a234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:47.711934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-53284bd3-6798-4e13-95ca-1091b7c5a234 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:47.713719 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-53284bd3-6798-4e13-95ca-1091b7c5a234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:47.808804 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 232/475] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:47.809915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53284bd3-6798-4e13-95ca-1091b7c5a234 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:47.854465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2295a06-b719-4696-9b58-f75d50cf8fd6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:47.950378 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f575388-4521-4cfa-8082-6d3a2b0485a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:47.950766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f575388-4521-4cfa-8082-6d3a2b0485a5 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:47.951010 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f575388-4521-4cfa-8082-6d3a2b0485a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:47.951276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f575388-4521-4cfa-8082-6d3a2b0485a5 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:47.952089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f575388-4521-4cfa-8082-6d3a2b0485a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:47.953626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f575388-4521-4cfa-8082-6d3a2b0485a5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:47.957737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:47.995114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 244/476] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:17:47 2022] POST /identity/v3/users => generated 249 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:17:48.006672 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53284bd3-6798-4e13-95ca-1091b7c5a234 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:48.063271 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d459b3c-ff64-4967-8078-12f8fafb050b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:48.063939 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d459b3c-ff64-4967-8078-12f8fafb050b None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:48.064218 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d459b3c-ff64-4967-8078-12f8fafb050b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:48.064488 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d459b3c-ff64-4967-8078-12f8fafb050b None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:48.065164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d459b3c-ff64-4967-8078-12f8fafb050b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:48.067066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d459b3c-ff64-4967-8078-12f8fafb050b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:48.103346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 233/477] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:17:47 2022] POST /identity/v3/users => generated 248 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:17:48.110017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f575388-4521-4cfa-8082-6d3a2b0485a5 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:48.128917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:48.264376 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f575388-4521-4cfa-8082-6d3a2b0485a5 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:48.309142 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ba02f-4454-4743-a3f2-f075e4e05075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:48.309839 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba02f-4454-4743-a3f2-f075e4e05075 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:48.310115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba02f-4454-4743-a3f2-f075e4e05075 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:48.310381 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba02f-4454-4743-a3f2-f075e4e05075 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:48.311331 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ba02f-4454-4743-a3f2-f075e4e05075 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:48.312772 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ba02f-4454-4743-a3f2-f075e4e05075 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:48.322171 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.sql.core [None req-147ba02f-4454-4743-a3f2-f075e4e05075 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 20:17:48.322171 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 20:17:48.322171 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [parameters: {'id': '1882fd7c3e6f41098579e5f190c80726', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 20:17:48.322171 dv-cinder-854263-2-smb devstack@keystone.service[81539]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81539) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 20:17:48.339207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-147ba02f-4454-4743-a3f2-f075e4e05075 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 20:17:48.339207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:48.339207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:17:48.339207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:17:48.339207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:17:48.339207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:17:48.339207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:17:48.339207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:17:48.339207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:17:48.339207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:17:48.339207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:17:48.339207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:17:48.339207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:17:48.339207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application result.read() Aug 29 20:17:48.339207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:17:48.340128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:17:48.341132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 20:17:48.341132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application yield resource Aug 29 20:17:48.341132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:17:48.341132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:17:48.341132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 20:17:48.341132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 20:17:48.341132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 20:17:48.341132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 20:17:48.341132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 20:17:48.341132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise self.value Aug 29 20:17:48.341132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 20:17:48.341132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 20:17:48.341132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 20:17:48.341132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application session.commit() Aug 29 20:17:48.341132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 20:17:48.341132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 20:17:48.341132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 20:17:48.342055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 20:17:48.342055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 20:17:48.342055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self.session.flush() Aug 29 20:17:48.342055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 20:17:48.342055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 20:17:48.342055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 20:17:48.342055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 20:17:48.342055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 20:17:48.342055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application compat.raise_( Aug 29 20:17:48.342055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:17:48.342055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception Aug 29 20:17:48.342055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 20:17:48.342055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 20:17:48.342055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 20:17:48.342055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 20:17:48.342055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 20:17:48.342055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 20:17:48.344159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 20:17:48.344159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 20:17:48.344159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 20:17:48.344159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 20:17:48.344159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 20:17:48.344159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 20:17:48.344159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 20:17:48.344159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 20:17:48.344159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 20:17:48.344159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 20:17:48.344159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 20:17:48.344159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 20:17:48.344159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 20:17:48.344159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 20:17:48.344159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:17:48.344159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception Aug 29 20:17:48.345123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:17:48.345123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:17:48.345123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:17:48.345123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:17:48.345123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:17:48.345123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:17:48.345123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:17:48.345123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:17:48.345123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:17:48.345123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:17:48.345123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:17:48.345123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application result.read() Aug 29 20:17:48.345123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:17:48.345123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:17:48.345123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:17:48.345123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:17:48.346713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:17:48.346713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:17:48.346713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:17:48.346713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:17:48.346713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 20:17:48.346713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 20:17:48.346713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [parameters: {'id': '1882fd7c3e6f41098579e5f190c80726', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 20:17:48.346713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 20:17:48.346713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:48.346713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:17:48.346713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:48.346713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:48.346713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:48.346713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:48.346713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:48.346713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:48.348592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:48.348592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:48.348592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:48.348592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:48.348592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:48.348592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:48.348592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 20:17:48.348592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 20:17:48.348592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:48.348592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:48.348592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 20:17:48.348592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 20:17:48.348592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 20:17:48.348592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 20:17:48.348592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 20:17:48.348592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:48.350498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 245/478] 10.222.0.52 () {60 vars in 1131 bytes} [Mon Aug 29 20:17:48 2022] POST /identity/v3/roles => generated 144 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:48.353553 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d459b3c-ff64-4967-8078-12f8fafb050b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:48.502283 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d459b3c-ff64-4967-8078-12f8fafb050b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:48.528793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:48.543766 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f365a-cab5-479c-b7f2-7f95501cbebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:48.544413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f365a-cab5-479c-b7f2-7f95501cbebd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:48.544742 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f365a-cab5-479c-b7f2-7f95501cbebd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:48.545014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f365a-cab5-479c-b7f2-7f95501cbebd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:48.556714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f365a-cab5-479c-b7f2-7f95501cbebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:48.562084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-1f9f365a-cab5-479c-b7f2-7f95501cbebd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:48.562084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:48.562084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:48.562084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:48.562084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:48.562084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:48.562084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:48.562084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:48.562084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:48.562084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:48.562084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:48.562084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:48.562084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:48.562084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:48.562084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:48.562084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:48.562969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:48.562969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:48.562969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:48.562969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:48.562969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:48.562969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:48.562969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:48.562969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:48.562969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:48.562969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:48.562969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:48.562969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:48.562969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:48.562969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:48.562969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:48.562969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:48.563773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:48.563773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:48.563773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:48.563773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:48.563773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:48.563773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:48.563773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:48.563773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:48.563773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:48.563773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:48.563773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:17:48.563773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:48.563773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 234/479] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:17:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:48.569984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ba02f-4454-4743-a3f2-f075e4e05075 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:48.666557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:48.709280 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ba02f-4454-4743-a3f2-f075e4e05075 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:48.764982 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df38090-a476-4eab-88c6-9866ef00f2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:48.765545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df38090-a476-4eab-88c6-9866ef00f2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:48.765873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df38090-a476-4eab-88c6-9866ef00f2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:48.766147 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df38090-a476-4eab-88c6-9866ef00f2f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:48.766831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df38090-a476-4eab-88c6-9866ef00f2f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:48.767134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df38090-a476-4eab-88c6-9866ef00f2f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:48.768531 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df38090-a476-4eab-88c6-9866ef00f2f4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:48.782229 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 246/480] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:17:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:49.365254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee12e-19c3-4f8c-bbc2-9964d25ff3b4 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:49.365863 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee12e-19c3-4f8c-bbc2-9964d25ff3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:49.365863 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee12e-19c3-4f8c-bbc2-9964d25ff3b4 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:49.367150 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 235/481] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:49.373557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17870f-8de1-4834-bc7a-1e5be462811e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:49.374056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17870f-8de1-4834-bc7a-1e5be462811e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:49.374128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17870f-8de1-4834-bc7a-1e5be462811e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:49.397718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ec17870f-8de1-4834-bc7a-1e5be462811e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:49.398924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ec17870f-8de1-4834-bc7a-1e5be462811e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:49.505408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 247/482] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:49.729559 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c51b8-0f17-4cc8-850b-d741b1b8ed66 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:49.729936 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c51b8-0f17-4cc8-850b-d741b1b8ed66 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:49.730129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c51b8-0f17-4cc8-850b-d741b1b8ed66 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:49.732462 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 236/483] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:49.738713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a7956-ab46-4dd7-aad4-1f3dc910613f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:49.739002 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a7956-ab46-4dd7-aad4-1f3dc910613f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:49.739278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a7956-ab46-4dd7-aad4-1f3dc910613f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:49.759348 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-358a7956-ab46-4dd7-aad4-1f3dc910613f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:49.760557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-358a7956-ab46-4dd7-aad4-1f3dc910613f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:49.857747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:49.862576 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 248/484] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:50.032065 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c51b8-0f17-4cc8-850b-d741b1b8ed66 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:50.178216 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c51b8-0f17-4cc8-850b-d741b1b8ed66 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:50.230340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8ceeb-4fb5-461b-845b-083ca8c3d554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:50.231048 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8ceeb-4fb5-461b-845b-083ca8c3d554 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:50.231431 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8ceeb-4fb5-461b-845b-083ca8c3d554 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:50.231767 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8ceeb-4fb5-461b-845b-083ca8c3d554 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:50.246026 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a7956-ab46-4dd7-aad4-1f3dc910613f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:50.247233 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8ceeb-4fb5-461b-845b-083ca8c3d554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:50.252793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-7fb8ceeb-4fb5-461b-845b-083ca8c3d554 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:50.252793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:50.252793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:50.252793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:50.252793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:50.252793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:50.252793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:50.252793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:50.252793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:50.252793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:50.252793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:50.252793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:50.252793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:50.252793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:50.252793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:50.252793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:50.253805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:50.253805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:50.253805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:50.253805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:50.253805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:50.253805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:50.253805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:50.253805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:50.253805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:50.253805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:50.253805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:50.253805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:50.253805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:50.253805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:50.253805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:50.253805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:50.254606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:50.254606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:50.254606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:50.254606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:50.254606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:50.254606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:50.254606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:50.254606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:50.254606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:50.254606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:50.254606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:50.254606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:50.255694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 237/485] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:17:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:50.261691 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8ceeb-4fb5-461b-845b-083ca8c3d554 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:50.313896 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:50.434202 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8ceeb-4fb5-461b-845b-083ca8c3d554 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:50.497563 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dba74-5a39-4d14-9cb3-b32f2f106845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:50.499259 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dba74-5a39-4d14-9cb3-b32f2f106845 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:50.501058 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dba74-5a39-4d14-9cb3-b32f2f106845 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:50.501503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dba74-5a39-4d14-9cb3-b32f2f106845 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:50.502324 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827dba74-5a39-4d14-9cb3-b32f2f106845 None admin] RBAC: Adding query filter params (name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:50.503360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827dba74-5a39-4d14-9cb3-b32f2f106845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:50.505442 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827dba74-5a39-4d14-9cb3-b32f2f106845 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:50.509842 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a7956-ab46-4dd7-aad4-1f3dc910613f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:50.527434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 238/486] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:17:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:50.533227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dba74-5a39-4d14-9cb3-b32f2f106845 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:50.649441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827dba74-5a39-4d14-9cb3-b32f2f106845 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:50.650105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77454ed5-cf4b-47ad-9012-1a94ce5118a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:50.650772 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77454ed5-cf4b-47ad-9012-1a94ce5118a1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:50.651056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77454ed5-cf4b-47ad-9012-1a94ce5118a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:50.651329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77454ed5-cf4b-47ad-9012-1a94ce5118a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:50.658756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:50.688997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77454ed5-cf4b-47ad-9012-1a94ce5118a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:50.695104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-77454ed5-cf4b-47ad-9012-1a94ce5118a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:50.695104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:50.695104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:50.695104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:50.695104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:50.695104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:50.695104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:50.695104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:50.695104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:50.695104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:50.695104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:50.695104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:50.695104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:50.695104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:50.695104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:50.695104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:50.696190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:50.696190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:50.696190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:50.696190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:50.696190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:50.696190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:50.696190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:50.696190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:50.696190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:50.696190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:50.696190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:50.696190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:50.696190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:50.696190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:50.696190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:50.696190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:50.697168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:50.697168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:50.697168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:50.697168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:50.697168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:50.697168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:50.697168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:50.697168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:50.697168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:50.697168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:50.697168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:50.697168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:50.700541 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30871919-8247-4d94-9f7e-b8073a16c1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:50.701346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30871919-8247-4d94-9f7e-b8073a16c1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:50.701801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30871919-8247-4d94-9f7e-b8073a16c1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:50.702229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30871919-8247-4d94-9f7e-b8073a16c1e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:50.705736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 249/487] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:17:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 460 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:50.711500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77454ed5-cf4b-47ad-9012-1a94ce5118a1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:50.718256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30871919-8247-4d94-9f7e-b8073a16c1e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:50.719982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30871919-8247-4d94-9f7e-b8073a16c1e7 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:50.754641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-30871919-8247-4d94-9f7e-b8073a16c1e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:50.754641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:50.754641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:50.754641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:50.754641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:50.754641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:50.754641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:50.754641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:50.754641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:50.754641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:50.754641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:50.754641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:50.754641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:50.754641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:50.754641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:50.754641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:50.755788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:50.755788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:50.755788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:50.755788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:50.755788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:50.755788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:50.755788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:50.755788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:50.755788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:50.755788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:50.755788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:50.755788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:50.755788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:50.755788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:50.755788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:50.755788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:50.755788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:50.756810 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:50.756810 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:50.756810 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:50.758802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 239/488] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:50.760641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26769257-9df2-4388-b834-0aca35d1a39e None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:50.761095 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26769257-9df2-4388-b834-0aca35d1a39e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:50.761533 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26769257-9df2-4388-b834-0aca35d1a39e None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:50.763179 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 240/489] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:50.764049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26769257-9df2-4388-b834-0aca35d1a39e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:50.808705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:50.859250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77454ed5-cf4b-47ad-9012-1a94ce5118a1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:50.878641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26769257-9df2-4388-b834-0aca35d1a39e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:50.902468 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeaa3f-9967-4c61-b787-d791fdf58308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:50.903030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeaa3f-9967-4c61-b787-d791fdf58308 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:50.903264 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeaa3f-9967-4c61-b787-d791fdf58308 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:50.903649 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeaa3f-9967-4c61-b787-d791fdf58308 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:50.904432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeaa3f-9967-4c61-b787-d791fdf58308 None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:50.904728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeaa3f-9967-4c61-b787-d791fdf58308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:50.906354 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeaa3f-9967-4c61-b787-d791fdf58308 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:50.916234 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 250/490] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:17:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:50.922115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb1c04-4968-4a8d-ac2c-7da0fbefc56a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:50.922463 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7d54f-a755-4656-90aa-97fadf1061ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:50.922564 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb1c04-4968-4a8d-ac2c-7da0fbefc56a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:50.922761 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb1c04-4968-4a8d-ac2c-7da0fbefc56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:50.923235 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7d54f-a755-4656-90aa-97fadf1061ef None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:50.923470 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7d54f-a755-4656-90aa-97fadf1061ef None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:50.924067 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7d54f-a755-4656-90aa-97fadf1061ef None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:50.924770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7d54f-a755-4656-90aa-97fadf1061ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:50.925075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7d54f-a755-4656-90aa-97fadf1061ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:50.926955 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7d54f-a755-4656-90aa-97fadf1061ef None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:50.942440 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 241/491] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:50.943980 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c877e2-32c9-4a67-9e18-641494c784e0 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:50.944340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c877e2-32c9-4a67-9e18-641494c784e0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:50.944664 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c877e2-32c9-4a67-9e18-641494c784e0 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:50.948178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 242/492] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:50.948178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c877e2-32c9-4a67-9e18-641494c784e0 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:50.950773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d1fb1c04-4968-4a8d-ac2c-7da0fbefc56a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:50.952533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d1fb1c04-4968-4a8d-ac2c-7da0fbefc56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:50.973102 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:51.036619 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 251/493] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:51.037153 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb1c04-4968-4a8d-ac2c-7da0fbefc56a None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:51.079877 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c877e2-32c9-4a67-9e18-641494c784e0 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:51.093089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:51.120635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b03911-9712-4d8a-bf8b-97b382ee1898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:51.121692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b03911-9712-4d8a-bf8b-97b382ee1898 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:51.122199 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b03911-9712-4d8a-bf8b-97b382ee1898 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:51.122684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b03911-9712-4d8a-bf8b-97b382ee1898 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:51.134579 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b03911-9712-4d8a-bf8b-97b382ee1898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:51.136408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b03911-9712-4d8a-bf8b-97b382ee1898 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:51.154494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-82b03911-9712-4d8a-bf8b-97b382ee1898 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:51.154494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:51.154494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:51.154494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:51.154494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:51.154494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:51.154494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:51.154494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:51.154494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:51.154494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:51.154494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:51.154494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:51.154494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:51.154494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:51.154494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:51.154494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:51.155552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:51.155552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:51.155552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:51.155552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:51.155552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:51.155552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:51.155552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:51.155552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:51.155552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:51.155552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:51.155552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:51.155552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:51.155552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:51.155552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:51.155552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:51.155552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:51.155552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:51.156460 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:51.156460 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:51.156460 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:51.163355 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 243/494] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:51.164178 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb1c04-4968-4a8d-ac2c-7da0fbefc56a None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:51.165309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8c740-aea6-4e07-bc03-5382f391453d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:51.165837 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8c740-aea6-4e07-bc03-5382f391453d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:51.166300 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8c740-aea6-4e07-bc03-5382f391453d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:51.192498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-bdf8c740-aea6-4e07-bc03-5382f391453d None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:51.194114 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bdf8c740-aea6-4e07-bc03-5382f391453d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:51.201825 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cb76b-b017-4952-b280-b622bd474329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:51.202617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cb76b-b017-4952-b280-b622bd474329 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:51.202899 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cb76b-b017-4952-b280-b622bd474329 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:51.203167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cb76b-b017-4952-b280-b622bd474329 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:51.211506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cb76b-b017-4952-b280-b622bd474329 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:51.213078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cb76b-b017-4952-b280-b622bd474329 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:51.227506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-ce9cb76b-b017-4952-b280-b622bd474329 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:17:51.227506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:51.227506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:51.227506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:51.227506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:51.227506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:51.227506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:51.227506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:51.227506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:51.227506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:51.227506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:51.227506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:51.227506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:17:51.227506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:17:51.227506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:17:51.227506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:51.228452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:51.229389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:51.229389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:51.229389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:17:51.229389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:17:51.229389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:17:51.229389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:17:51.229389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:17:51.229389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:17:51.229389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:17:51.229389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:51.233443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 252/495] 10.222.0.52 () {56 vars in 1093 bytes} [Mon Aug 29 20:17:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:51.234420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cb76b-b017-4952-b280-b622bd474329 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:51.268717 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:51.280805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 244/496] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:51.282224 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8c740-aea6-4e07-bc03-5382f391453d None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:51.362734 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cb76b-b017-4952-b280-b622bd474329 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:51.370766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:51.402357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3305a-7a71-4728-9c2c-7d0cc33fbc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:51.402976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3305a-7a71-4728-9c2c-7d0cc33fbc64 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:51.403252 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3305a-7a71-4728-9c2c-7d0cc33fbc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:51.403520 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3305a-7a71-4728-9c2c-7d0cc33fbc64 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:51.404176 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3305a-7a71-4728-9c2c-7d0cc33fbc64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:51.404478 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3305a-7a71-4728-9c2c-7d0cc33fbc64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:51.406163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3305a-7a71-4728-9c2c-7d0cc33fbc64 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:51.412849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8c740-aea6-4e07-bc03-5382f391453d None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:51.418929 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 253/497] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:51.419838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3305a-7a71-4728-9c2c-7d0cc33fbc64 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:51.456357 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340232fd-e5d0-4a0f-98e4-6b65437abc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:51.457015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340232fd-e5d0-4a0f-98e4-6b65437abc90 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:51.457264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340232fd-e5d0-4a0f-98e4-6b65437abc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:51.457571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340232fd-e5d0-4a0f-98e4-6b65437abc90 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:51.458323 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340232fd-e5d0-4a0f-98e4-6b65437abc90 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:51.458632 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340232fd-e5d0-4a0f-98e4-6b65437abc90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:51.460118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340232fd-e5d0-4a0f-98e4-6b65437abc90 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:51.502379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 245/498] 10.222.0.52 () {56 vars in 1133 bytes} [Mon Aug 29 20:17:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:51.503254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340232fd-e5d0-4a0f-98e4-6b65437abc90 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:51.563150 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3305a-7a71-4728-9c2c-7d0cc33fbc64 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:51.575178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:51.608370 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a55e1e-01dd-4c3f-bd73-9bba4bce452f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:51.609076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a55e1e-01dd-4c3f-bd73-9bba4bce452f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:51.609383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a55e1e-01dd-4c3f-bd73-9bba4bce452f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:51.609670 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a55e1e-01dd-4c3f-bd73-9bba4bce452f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:51.620397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a55e1e-01dd-4c3f-bd73-9bba4bce452f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:51.621688 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340232fd-e5d0-4a0f-98e4-6b65437abc90 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:51.625844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-00a55e1e-01dd-4c3f-bd73-9bba4bce452f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:51.625844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:51.625844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:51.625844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:51.625844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:51.625844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:51.625844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:51.625844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:51.625844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:51.625844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:51.625844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:51.625844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:51.625844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:51.625844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:51.625844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:51.625844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:51.627151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:51.627151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:51.627151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:51.627151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:51.627151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:51.627151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:51.627151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:51.627151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:51.627151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:51.627151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:51.627151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:51.627151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:51.627151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:51.627151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:51.627151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:51.627151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:51.627970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:51.627970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:51.627970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:51.627970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:51.627970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:51.627970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:51.627970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:51.627970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:51.627970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:51.627970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:51.627970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:51.627970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:51.629655 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 254/499] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:17:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:51.631349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f1139-5cc1-4393-82be-3034a47de7a5 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:51.631654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f1139-5cc1-4393-82be-3034a47de7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:51.631932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f1139-5cc1-4393-82be-3034a47de7a5 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:51.633642 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 255/500] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:51.634345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f1139-5cc1-4393-82be-3034a47de7a5 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:51.660025 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d998d6-7df2-41ac-a58d-3456b799e97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:51.660737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d998d6-7df2-41ac-a58d-3456b799e97f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:51.660961 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d998d6-7df2-41ac-a58d-3456b799e97f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:51.661314 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d998d6-7df2-41ac-a58d-3456b799e97f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:51.668073 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:51.669768 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d998d6-7df2-41ac-a58d-3456b799e97f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:51.671286 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d998d6-7df2-41ac-a58d-3456b799e97f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:51.685219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-e8d998d6-7df2-41ac-a58d-3456b799e97f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:17:51.685219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:51.685219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:51.685219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:51.685219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:51.685219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:51.685219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:51.685219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:51.685219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:51.685219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:51.685219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:51.685219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:51.685219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:17:51.685219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:17:51.685219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:17:51.685219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:51.686245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:51.687257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:51.687257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:51.687257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:17:51.687257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:17:51.687257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:17:51.687257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:17:51.687257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:17:51.687257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:17:51.687257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:17:51.687257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:51.687257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 246/501] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:51.687257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d998d6-7df2-41ac-a58d-3456b799e97f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:51.750513 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f1139-5cc1-4393-82be-3034a47de7a5 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:51.786309 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396a9e6-6191-45ea-9cab-cf0c3348cd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:51.786888 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396a9e6-6191-45ea-9cab-cf0c3348cd3f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:51.787169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396a9e6-6191-45ea-9cab-cf0c3348cd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:51.787439 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396a9e6-6191-45ea-9cab-cf0c3348cd3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:51.793058 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d998d6-7df2-41ac-a58d-3456b799e97f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:51.810659 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:51.830478 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b44fa1-c49a-4dd0-8466-b6257bab03b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:51.831200 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44fa1-c49a-4dd0-8466-b6257bab03b4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:51.831470 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44fa1-c49a-4dd0-8466-b6257bab03b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:51.831738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44fa1-c49a-4dd0-8466-b6257bab03b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:51.842534 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b44fa1-c49a-4dd0-8466-b6257bab03b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:51.848090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-f9b44fa1-c49a-4dd0-8466-b6257bab03b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:51.848090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:51.848090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:51.848090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:51.848090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:51.848090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:51.848090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:51.848090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:51.848090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:51.848090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:51.848090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:51.848090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:51.848090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:51.848090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:51.848090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:51.848090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:51.849177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:51.849177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:51.849177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:51.849177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:51.849177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:51.849177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:51.849177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:51.849177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:51.849177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:51.849177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:51.849177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:51.849177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:51.849177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:51.849177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:51.849177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:51.849177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:51.850009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:51.850009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:51.850009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:51.850009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:51.850009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:51.850009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:51.850009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:51.850009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:51.850009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:51.850009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:51.850009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:51.850009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:51.850009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 247/502] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:17:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:51.850009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b44fa1-c49a-4dd0-8466-b6257bab03b4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:51.861491 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396a9e6-6191-45ea-9cab-cf0c3348cd3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:51.862943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396a9e6-6191-45ea-9cab-cf0c3348cd3f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:51.890431 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:51.956860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b44fa1-c49a-4dd0-8466-b6257bab03b4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:51.968878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 256/503] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:51.974734 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5e19f-e2df-4ca8-8bd6-13fcfdb079b4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:51.975017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5e19f-e2df-4ca8-8bd6-13fcfdb079b4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:51.975286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5e19f-e2df-4ca8-8bd6-13fcfdb079b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:51.993820 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-94e5e19f-e2df-4ca8-8bd6-13fcfdb079b4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:51.994027 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683538b-4168-4aaf-8f15-8d4a2dec9282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:51.994526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683538b-4168-4aaf-8f15-8d4a2dec9282 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:51.994805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683538b-4168-4aaf-8f15-8d4a2dec9282 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:51.995021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-94e5e19f-e2df-4ca8-8bd6-13fcfdb079b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:51.995123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683538b-4168-4aaf-8f15-8d4a2dec9282 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:51.995724 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683538b-4168-4aaf-8f15-8d4a2dec9282 None admin] RBAC: Adding query filter params (name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:51.996026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683538b-4168-4aaf-8f15-8d4a2dec9282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:51.997441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683538b-4168-4aaf-8f15-8d4a2dec9282 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:52.006171 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 248/504] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:17:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:52.007195 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683538b-4168-4aaf-8f15-8d4a2dec9282 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:52.059260 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:52.070903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 257/505] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:52.071769 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5e19f-e2df-4ca8-8bd6-13fcfdb079b4 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:52.131280 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:52.144818 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683538b-4168-4aaf-8f15-8d4a2dec9282 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:52.180790 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5e19f-e2df-4ca8-8bd6-13fcfdb079b4 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:52.181311 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a490a-1b48-4d07-9d76-608ea86ce1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:52.181960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a490a-1b48-4d07-9d76-608ea86ce1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:52.182250 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a490a-1b48-4d07-9d76-608ea86ce1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:52.182603 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a490a-1b48-4d07-9d76-608ea86ce1f4 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:52.183661 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a490a-1b48-4d07-9d76-608ea86ce1f4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:52.183661 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a490a-1b48-4d07-9d76-608ea86ce1f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:52.185089 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a490a-1b48-4d07-9d76-608ea86ce1f4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:52.211057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 249/506] 10.222.0.52 () {56 vars in 1137 bytes} [Mon Aug 29 20:17:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:52.211057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a490a-1b48-4d07-9d76-608ea86ce1f4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:52.224570 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e0468-b154-4edd-b91f-f72cd71c45e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:52.225188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0468-b154-4edd-b91f-f72cd71c45e5 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:52.225489 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0468-b154-4edd-b91f-f72cd71c45e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:52.225756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0468-b154-4edd-b91f-f72cd71c45e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:52.226475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e0468-b154-4edd-b91f-f72cd71c45e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:52.226778 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e0468-b154-4edd-b91f-f72cd71c45e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:52.228426 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e0468-b154-4edd-b91f-f72cd71c45e5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:52.237443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 258/507] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:17:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:52.238102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e0468-b154-4edd-b91f-f72cd71c45e5 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:52.326186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:52.331802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a490a-1b48-4d07-9d76-608ea86ce1f4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:52.351624 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e0468-b154-4edd-b91f-f72cd71c45e5 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:52.369071 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:52.370940 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352fad2-f5ce-43f4-bda3-0eb70d6a9a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:52.371611 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352fad2-f5ce-43f4-bda3-0eb70d6a9a41 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:52.371892 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352fad2-f5ce-43f4-bda3-0eb70d6a9a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:52.372164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352fad2-f5ce-43f4-bda3-0eb70d6a9a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:52.382356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352fad2-f5ce-43f4-bda3-0eb70d6a9a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:52.383864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352fad2-f5ce-43f4-bda3-0eb70d6a9a41 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:52.386859 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18c2db-8fac-46da-be24-282fcda8b36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:52.387452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18c2db-8fac-46da-be24-282fcda8b36f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:52.387724 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18c2db-8fac-46da-be24-282fcda8b36f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:52.387990 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18c2db-8fac-46da-be24-282fcda8b36f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:52.398529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-7352fad2-f5ce-43f4-bda3-0eb70d6a9a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:52.398529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:52.398529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:52.398529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:52.398529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:52.398529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:52.398529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:52.398529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:52.398529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:52.398529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:52.398529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:52.398529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:52.398529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:52.398529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:52.398529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:52.398529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:52.399662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:52.399662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:52.399662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:52.399662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:52.399662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:52.399662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:52.399662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:52.399662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:52.399662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:52.399662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:52.399662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:52.399662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:52.399662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:52.399662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:52.399662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:52.399662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:52.399662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:52.400623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:52.400623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:52.400623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:52.400783 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18c2db-8fac-46da-be24-282fcda8b36f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:52.400852 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 250/508] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:52.400914 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18c2db-8fac-46da-be24-282fcda8b36f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:52.400986 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352fad2-f5ce-43f4-bda3-0eb70d6a9a41 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:52.414873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-aa18c2db-8fac-46da-be24-282fcda8b36f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:52.414873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:52.414873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:52.414873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:52.414873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:52.414873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:52.414873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:52.414873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:52.414873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:52.414873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:52.414873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:52.414873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:52.414873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:52.414873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:52.414873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:52.414873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:52.415786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:52.415786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:52.415786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:52.415786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:52.415786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:52.415786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:52.415786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:52.415786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:52.415786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:52.415786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:52.415786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:52.415786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:52.415786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:52.415786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:52.415786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:52.415786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:52.415786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:52.417225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:52.417225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:52.417225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:52.417225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 259/509] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:52.417225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18c2db-8fac-46da-be24-282fcda8b36f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:52.511006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352fad2-f5ce-43f4-bda3-0eb70d6a9a41 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:52.519387 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18c2db-8fac-46da-be24-282fcda8b36f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:52.549448 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860dc6e-a853-4819-ab89-c04c73607685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:52.550048 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860dc6e-a853-4819-ab89-c04c73607685 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:52.550323 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860dc6e-a853-4819-ab89-c04c73607685 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:52.550590 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860dc6e-a853-4819-ab89-c04c73607685 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:52.559040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b0bfb-687b-4b75-987e-e1fe0eb48674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:52.559675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b0bfb-687b-4b75-987e-e1fe0eb48674 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:52.559957 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b0bfb-687b-4b75-987e-e1fe0eb48674 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:52.560229 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b0bfb-687b-4b75-987e-e1fe0eb48674 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:52.571158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:52.572176 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b0bfb-687b-4b75-987e-e1fe0eb48674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:52.573942 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b0bfb-687b-4b75-987e-e1fe0eb48674 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:52.589860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-364b0bfb-687b-4b75-987e-e1fe0eb48674 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:52.589860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:52.589860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:52.589860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:52.589860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:52.589860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:52.589860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:52.589860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:52.589860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:52.589860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:52.589860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:52.589860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:52.589860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:52.589860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:52.589860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:52.589860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:52.591604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:52.591604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:52.591604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:52.591604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:52.591604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:52.591604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:52.591604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:52.591604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:52.591604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:52.591604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:52.591604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:52.591604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:52.591604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:52.591604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:52.591604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:52.591604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:52.591604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:52.593350 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:52.593350 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:52.593350 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:52.593350 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 260/510] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:52.593350 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b0bfb-687b-4b75-987e-e1fe0eb48674 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:52.619659 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:52.627976 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860dc6e-a853-4819-ab89-c04c73607685 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:52.629522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860dc6e-a853-4819-ab89-c04c73607685 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:52.702250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b0bfb-687b-4b75-987e-e1fe0eb48674 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:52.742043 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa13faa-4ae3-4c7f-b2ac-572afc4b947d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:52.742669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa13faa-4ae3-4c7f-b2ac-572afc4b947d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:52.742943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa13faa-4ae3-4c7f-b2ac-572afc4b947d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:52.743207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa13faa-4ae3-4c7f-b2ac-572afc4b947d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:52.744221 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 251/511] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:52.745832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860dc6e-a853-4819-ab89-c04c73607685 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:52.754513 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa13faa-4ae3-4c7f-b2ac-572afc4b947d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:52.756451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa13faa-4ae3-4c7f-b2ac-572afc4b947d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:52.773156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-8aa13faa-4ae3-4c7f-b2ac-572afc4b947d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:52.773156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:52.773156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:52.773156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:52.773156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:52.773156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:52.773156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:52.773156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:52.773156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:52.773156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:52.773156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:52.773156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:52.773156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:52.773156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:52.773156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:52.773156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:52.774159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:52.774159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:52.774159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:52.774159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:52.774159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:52.774159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:52.774159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:52.774159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:52.774159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:52.774159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:52.774159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:52.774159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:52.774159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:52.774159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:52.774159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:52.774159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:52.774159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:52.775004 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:52.775004 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:52.775004 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:52.775004 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 261/512] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:52.775004 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa13faa-4ae3-4c7f-b2ac-572afc4b947d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:52.803730 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:52.857994 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:52.858314 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860dc6e-a853-4819-ab89-c04c73607685 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:52.882804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa13faa-4ae3-4c7f-b2ac-572afc4b947d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:52.895237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f7c21-9700-4854-93e2-c418be2dd5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:52.895843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f7c21-9700-4854-93e2-c418be2dd5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:52.896119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f7c21-9700-4854-93e2-c418be2dd5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:52.896389 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f7c21-9700-4854-93e2-c418be2dd5a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:52.897030 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f7c21-9700-4854-93e2-c418be2dd5a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:52.897330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f7c21-9700-4854-93e2-c418be2dd5a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:52.898837 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f7c21-9700-4854-93e2-c418be2dd5a1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:52.910509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 252/513] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:52.911344 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f7c21-9700-4854-93e2-c418be2dd5a1 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:52.919908 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83840bc4-b8d7-4d3f-bb41-31b15523be1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:52.920523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83840bc4-b8d7-4d3f-bb41-31b15523be1c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:52.920810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83840bc4-b8d7-4d3f-bb41-31b15523be1c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:52.921070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83840bc4-b8d7-4d3f-bb41-31b15523be1c None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:52.921910 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83840bc4-b8d7-4d3f-bb41-31b15523be1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:52.922106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83840bc4-b8d7-4d3f-bb41-31b15523be1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:52.923586 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83840bc4-b8d7-4d3f-bb41-31b15523be1c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:52.937161 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 262/514] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:52.938078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83840bc4-b8d7-4d3f-bb41-31b15523be1c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:53.034377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f7c21-9700-4854-93e2-c418be2dd5a1 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:53.046667 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:53.058702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83840bc4-b8d7-4d3f-bb41-31b15523be1c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:53.081655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97d48e-b5f3-4087-87f0-abc193e6a861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:53.082420 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97d48e-b5f3-4087-87f0-abc193e6a861 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:53.082704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97d48e-b5f3-4087-87f0-abc193e6a861 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:53.082978 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97d48e-b5f3-4087-87f0-abc193e6a861 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:53.083808 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97d48e-b5f3-4087-87f0-abc193e6a861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:53.084127 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97d48e-b5f3-4087-87f0-abc193e6a861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:53.085542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97d48e-b5f3-4087-87f0-abc193e6a861 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:53.096262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbe6b6-f38f-4bdf-a492-16d9836f1637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:53.096510 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbe6b6-f38f-4bdf-a492-16d9836f1637 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:53.096785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbe6b6-f38f-4bdf-a492-16d9836f1637 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:53.097158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbe6b6-f38f-4bdf-a492-16d9836f1637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:53.099486 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 253/515] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:53.099776 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:53.100363 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97d48e-b5f3-4087-87f0-abc193e6a861 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:53.111003 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbe6b6-f38f-4bdf-a492-16d9836f1637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:53.112521 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbe6b6-f38f-4bdf-a492-16d9836f1637 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:53.129188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-33fbe6b6-f38f-4bdf-a492-16d9836f1637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:53.129188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:53.129188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:53.129188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:53.129188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:53.129188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:53.129188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:53.129188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:53.129188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:53.129188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:53.129188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:53.129188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:53.129188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:53.129188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:53.129188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:53.129188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:53.134871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:53.134871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:53.134871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:53.134871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:53.134871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:53.134871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:53.134871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:53.134871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:53.134871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:53.134871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:53.134871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:53.134871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:53.134871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:53.134871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:53.134871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:53.134871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:53.134871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:53.135861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:53.135861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:53.135861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:53.135861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 263/516] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:53.135861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbe6b6-f38f-4bdf-a492-16d9836f1637 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:53.237809 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97d48e-b5f3-4087-87f0-abc193e6a861 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:53.244408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbe6b6-f38f-4bdf-a492-16d9836f1637 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:53.283008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a03b1-a6c0-41f9-886b-1144e5b463f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:53.283623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a03b1-a6c0-41f9-886b-1144e5b463f1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:53.283895 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a03b1-a6c0-41f9-886b-1144e5b463f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:53.284146 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a03b1-a6c0-41f9-886b-1144e5b463f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:53.284864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a03b1-a6c0-41f9-886b-1144e5b463f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:53.285098 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a03b1-a6c0-41f9-886b-1144e5b463f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:53.286521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a03b1-a6c0-41f9-886b-1144e5b463f1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:53.286714 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22aa43-7cc6-4376-a1b2-e4c1d2e410df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:53.287696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22aa43-7cc6-4376-a1b2-e4c1d2e410df None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:53.288126 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22aa43-7cc6-4376-a1b2-e4c1d2e410df None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:53.288581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22aa43-7cc6-4376-a1b2-e4c1d2e410df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:53.296803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22aa43-7cc6-4376-a1b2-e4c1d2e410df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:53.298301 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22aa43-7cc6-4376-a1b2-e4c1d2e410df None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:53.298464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 254/517] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:53.299280 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a03b1-a6c0-41f9-886b-1144e5b463f1 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:53.311435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-3e22aa43-7cc6-4376-a1b2-e4c1d2e410df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:17:53.311435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:53.311435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:53.311435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:53.311435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:53.311435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:53.311435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:53.311435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:53.311435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:53.311435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:53.311435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:53.311435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:53.311435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:17:53.311435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:17:53.311435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:17:53.312498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:17:53.312498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:53.312498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:53.312498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:53.312498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:53.312498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:53.312498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:53.312498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:53.312498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:53.312498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:53.312498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:53.312498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:53.312498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:53.312498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:53.312498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:53.312498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:53.312498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:53.319617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:17:53.319617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:17:53.319617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:17:53.319617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:17:53.319617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:17:53.319617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:17:53.319617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:17:53.319617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:53.319617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 264/518] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:17:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:53.319617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22aa43-7cc6-4376-a1b2-e4c1d2e410df None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:53.339349 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:53.371496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:53.426115 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a03b1-a6c0-41f9-886b-1144e5b463f1 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:53.437268 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22aa43-7cc6-4376-a1b2-e4c1d2e410df None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:53.463876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa65a2-8700-49a9-91ee-7949950fb5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:53.464530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa65a2-8700-49a9-91ee-7949950fb5fd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:53.464803 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa65a2-8700-49a9-91ee-7949950fb5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:53.465071 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa65a2-8700-49a9-91ee-7949950fb5fd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:53.473834 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa65a2-8700-49a9-91ee-7949950fb5fd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:53.475411 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa65a2-8700-49a9-91ee-7949950fb5fd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:53.478052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2beb43-3402-4748-a801-8015e4a45179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:53.478854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2beb43-3402-4748-a801-8015e4a45179 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:53.479135 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2beb43-3402-4748-a801-8015e4a45179 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:53.479402 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2beb43-3402-4748-a801-8015e4a45179 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:53.487441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-14aa65a2-8700-49a9-91ee-7949950fb5fd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:17:53.487441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:53.487441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:53.487441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:53.487441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:53.487441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:53.487441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:53.487441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:53.487441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:53.487441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:53.487441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:53.487441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:53.487441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:17:53.487441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:17:53.487441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:17:53.487441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:53.488371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:53.489263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:53.489263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:53.489263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:17:53.489263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:17:53.489263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:17:53.489263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:17:53.489263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:17:53.489263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:17:53.489263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:17:53.489263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:53.489263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 255/519] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:17:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:53.489842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa65a2-8700-49a9-91ee-7949950fb5fd None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:53.490818 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2beb43-3402-4748-a801-8015e4a45179 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:53.492289 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2beb43-3402-4748-a801-8015e4a45179 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:53.507132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-fc2beb43-3402-4748-a801-8015e4a45179 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:17:53.507132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:53.507132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:53.507132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:53.507132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:53.507132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:53.507132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:53.507132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:53.507132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:53.507132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:53.507132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:53.507132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:53.507132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:17:53.507132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:17:53.507132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:17:53.507132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:53.508180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:53.509222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:53.509222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:53.509222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:17:53.509222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:17:53.509222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:17:53.509222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:17:53.509222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:17:53.509222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:17:53.509222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:17:53.509222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:53.509222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 265/520] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:53.510439 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2beb43-3402-4748-a801-8015e4a45179 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:53.603024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:53.614075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa65a2-8700-49a9-91ee-7949950fb5fd None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:53.631566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2beb43-3402-4748-a801-8015e4a45179 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:53.639243 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:53.650411 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c146d69-a604-4d18-ac7f-a5421323e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:53.651083 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c146d69-a604-4d18-ac7f-a5421323e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:53.651389 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c146d69-a604-4d18-ac7f-a5421323e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:53.651647 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c146d69-a604-4d18-ac7f-a5421323e6f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:53.652301 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c146d69-a604-4d18-ac7f-a5421323e6f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:53.652605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c146d69-a604-4d18-ac7f-a5421323e6f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:53.654042 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c146d69-a604-4d18-ac7f-a5421323e6f4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:53.666994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 256/521] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:53.667850 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c146d69-a604-4d18-ac7f-a5421323e6f4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:53.678603 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0ec34-28ba-432d-87c6-429b90c34a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:53.678839 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0ec34-28ba-432d-87c6-429b90c34a6d None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:53.679303 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0ec34-28ba-432d-87c6-429b90c34a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:53.679789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0ec34-28ba-432d-87c6-429b90c34a6d None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:53.681094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0ec34-28ba-432d-87c6-429b90c34a6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:53.683428 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0ec34-28ba-432d-87c6-429b90c34a6d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:53.714151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 266/522] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:17:53 2022] POST /identity/v3/users => generated 247 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:17:53.714999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0ec34-28ba-432d-87c6-429b90c34a6d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:53.813139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c146d69-a604-4d18-ac7f-a5421323e6f4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:53.855222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0ec34-28ba-432d-87c6-429b90c34a6d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:53.868282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32daad-95ac-410e-8ad1-18118e76e2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:53.869507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32daad-95ac-410e-8ad1-18118e76e2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:53.869507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32daad-95ac-410e-8ad1-18118e76e2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:53.869507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32daad-95ac-410e-8ad1-18118e76e2b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:53.870426 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32daad-95ac-410e-8ad1-18118e76e2b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:53.870766 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32daad-95ac-410e-8ad1-18118e76e2b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:53.873846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32daad-95ac-410e-8ad1-18118e76e2b5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:53.895304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 257/523] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:17:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:53.896091 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32daad-95ac-410e-8ad1-18118e76e2b5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:53.909958 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0f313-b5b7-49a0-aa02-0f3d13b9c04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:53.910575 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0f313-b5b7-49a0-aa02-0f3d13b9c04c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:53.910852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0f313-b5b7-49a0-aa02-0f3d13b9c04c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:53.911123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0f313-b5b7-49a0-aa02-0f3d13b9c04c None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:53.911862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0f313-b5b7-49a0-aa02-0f3d13b9c04c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:53.912163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0f313-b5b7-49a0-aa02-0f3d13b9c04c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:53.912256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:53.913679 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0f313-b5b7-49a0-aa02-0f3d13b9c04c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:53.957720 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 267/524] 10.222.0.52 () {56 vars in 1139 bytes} [Mon Aug 29 20:17:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:53.958783 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0f313-b5b7-49a0-aa02-0f3d13b9c04c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:53.986463 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:54.031783 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32daad-95ac-410e-8ad1-18118e76e2b5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:54.078304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621d52a-85e5-4ea9-bb02-04b5d082edfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:54.078951 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621d52a-85e5-4ea9-bb02-04b5d082edfd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:54.079319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621d52a-85e5-4ea9-bb02-04b5d082edfd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:54.079611 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621d52a-85e5-4ea9-bb02-04b5d082edfd None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:54.080368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621d52a-85e5-4ea9-bb02-04b5d082edfd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:54.080671 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621d52a-85e5-4ea9-bb02-04b5d082edfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:54.082267 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621d52a-85e5-4ea9-bb02-04b5d082edfd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:54.104196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0f313-b5b7-49a0-aa02-0f3d13b9c04c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:54.105583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 258/525] 10.222.0.52 () {56 vars in 1137 bytes} [Mon Aug 29 20:17:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:54.111184 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621d52a-85e5-4ea9-bb02-04b5d082edfd None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:54.144858 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72fe95-e591-41ef-9689-2fec7122439b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:54.145580 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72fe95-e591-41ef-9689-2fec7122439b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:54.145966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72fe95-e591-41ef-9689-2fec7122439b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:54.146235 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72fe95-e591-41ef-9689-2fec7122439b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:54.153788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72fe95-e591-41ef-9689-2fec7122439b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:54.155504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72fe95-e591-41ef-9689-2fec7122439b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:54.170034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-1a72fe95-e591-41ef-9689-2fec7122439b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:17:54.170034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:54.170034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:54.170034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:54.170034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:54.170034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:54.170034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:54.170034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:54.170034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:54.170034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:54.170034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:54.170034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:54.170034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:17:54.170034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:17:54.170034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:17:54.170962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:17:54.170962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:54.170962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:54.170962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:54.170962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:54.170962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:54.170962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:54.170962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:54.170962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:54.170962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:54.170962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:54.170962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:54.170962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:54.170962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:54.170962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:54.170962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:54.170962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:54.171893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:17:54.171893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:17:54.171893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:17:54.171893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:17:54.171893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:17:54.171893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:17:54.171893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:17:54.171893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:54.175983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 268/526] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:17:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:54.176901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72fe95-e591-41ef-9689-2fec7122439b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:54.204076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:54.256482 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621d52a-85e5-4ea9-bb02-04b5d082edfd None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:54.276844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:54.302385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae6c56-d547-45be-903f-31ea64391d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:54.303157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72fe95-e591-41ef-9689-2fec7122439b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:54.303335 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae6c56-d547-45be-903f-31ea64391d6b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:54.303674 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae6c56-d547-45be-903f-31ea64391d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:54.304104 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae6c56-d547-45be-903f-31ea64391d6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:54.305153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae6c56-d547-45be-903f-31ea64391d6b None admin] RBAC: Adding query filter params (role.id=8352f2960aa74837804150f4c8774dbc, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=9c95d16fd4da4fa7987b893eae0b3ef5) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:54.305614 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae6c56-d547-45be-903f-31ea64391d6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:54.308018 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae6c56-d547-45be-903f-31ea64391d6b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:54.315740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 259/527] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:17:54 2022] GET /identity/v3/role_assignments?user.id=9c95d16fd4da4fa7987b893eae0b3ef5&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=8352f2960aa74837804150f4c8774dbc => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:54.327540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae6c56-d547-45be-903f-31ea64391d6b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:54.372321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a9a4d-40bd-46c8-a272-7df3f8367ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:54.373010 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a9a4d-40bd-46c8-a272-7df3f8367ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:54.373499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a9a4d-40bd-46c8-a272-7df3f8367ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:54.373882 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a9a4d-40bd-46c8-a272-7df3f8367ac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:54.469534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a9a4d-40bd-46c8-a272-7df3f8367ac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:54.471415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a9a4d-40bd-46c8-a272-7df3f8367ac6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:54.557857 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae6c56-d547-45be-903f-31ea64391d6b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:54.597882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:54.602632 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc862b-45c5-41d8-8eb7-5971a8882e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:54.603653 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc862b-45c5-41d8-8eb7-5971a8882e91 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:54.604282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc862b-45c5-41d8-8eb7-5971a8882e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:54.604282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc862b-45c5-41d8-8eb7-5971a8882e91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:54.605112 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:54.631555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 269/528] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:54.632707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a9a4d-40bd-46c8-a272-7df3f8367ac6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:54.690310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc862b-45c5-41d8-8eb7-5971a8882e91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:54.692037 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc862b-45c5-41d8-8eb7-5971a8882e91 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:54.779183 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a9a4d-40bd-46c8-a272-7df3f8367ac6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:54.828372 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea11e0-3b04-43b4-8c35-94abb7adf5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:54.829227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea11e0-3b04-43b4-8c35-94abb7adf5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:54.829693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea11e0-3b04-43b4-8c35-94abb7adf5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:54.830098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea11e0-3b04-43b4-8c35-94abb7adf5d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:54.830989 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea11e0-3b04-43b4-8c35-94abb7adf5d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:54.831514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea11e0-3b04-43b4-8c35-94abb7adf5d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:54.833180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea11e0-3b04-43b4-8c35-94abb7adf5d9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:54.834470 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 260/529] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:54.835418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc862b-45c5-41d8-8eb7-5971a8882e91 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:54.860212 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 270/530] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:17:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:54.861457 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea11e0-3b04-43b4-8c35-94abb7adf5d9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:54.893916 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:54.919689 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:54.975923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc862b-45c5-41d8-8eb7-5971a8882e91 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:54.993336 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea11e0-3b04-43b4-8c35-94abb7adf5d9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:55.027548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d7ee6-6073-4ac9-886a-36ed1c775785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:55.028597 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d7ee6-6073-4ac9-886a-36ed1c775785 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:55.028999 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d7ee6-6073-4ac9-886a-36ed1c775785 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:55.029374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d7ee6-6073-4ac9-886a-36ed1c775785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:55.037290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d725a-a7b7-46bf-9714-fd2e588b608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:55.038325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d725a-a7b7-46bf-9714-fd2e588b608a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:55.038831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d725a-a7b7-46bf-9714-fd2e588b608a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:55.039275 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d725a-a7b7-46bf-9714-fd2e588b608a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:55.042446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d7ee6-6073-4ac9-886a-36ed1c775785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:55.044488 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d7ee6-6073-4ac9-886a-36ed1c775785 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:55.054190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d725a-a7b7-46bf-9714-fd2e588b608a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:55.056276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d725a-a7b7-46bf-9714-fd2e588b608a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:55.063077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-8e7d7ee6-6073-4ac9-886a-36ed1c775785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:55.063077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:55.063077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:55.063077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:55.063077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:55.063077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:55.063077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:55.063077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:55.063077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:55.063077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:55.063077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:55.063077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:55.063077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:55.063077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:55.063077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:55.063077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:55.064282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:55.064282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:55.064282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:55.064282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:55.064282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:55.064282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:55.064282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:55.064282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:55.064282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:55.064282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:55.064282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:55.064282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:55.064282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:55.064282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:55.064282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:55.064282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:55.064282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:55.065349 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:55.065349 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:55.065349 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:55.065822 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 261/531] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:55.066709 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d7ee6-6073-4ac9-886a-36ed1c775785 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:55.079288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-fa4d725a-a7b7-46bf-9714-fd2e588b608a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:55.079288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:55.079288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:55.079288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:55.079288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:55.079288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:55.079288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:55.079288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:55.079288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:55.079288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:55.079288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:55.079288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:55.079288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:55.079288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:55.079288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:55.079288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:55.080499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:55.080499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:55.080499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:55.080499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:55.080499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:55.080499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:55.080499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:55.080499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:55.080499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:55.080499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:55.080499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:55.080499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:55.080499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:55.080499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:55.080499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:55.080499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:55.080499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:55.082343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:55.082343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:55.082343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:55.083344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 271/532] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:55.089435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d725a-a7b7-46bf-9714-fd2e588b608a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:55.195557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:55.214419 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d7ee6-6073-4ac9-886a-36ed1c775785 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:55.221546 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:55.233103 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d725a-a7b7-46bf-9714-fd2e588b608a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:55.254960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df0bb0-6fb7-4efd-9c29-a6c7ecc3058a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:55.256000 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df0bb0-6fb7-4efd-9c29-a6c7ecc3058a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:55.256494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df0bb0-6fb7-4efd-9c29-a6c7ecc3058a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:55.256962 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df0bb0-6fb7-4efd-9c29-a6c7ecc3058a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:55.257938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df0bb0-6fb7-4efd-9c29-a6c7ecc3058a None admin] RBAC: Adding query filter params (role.id=8352f2960aa74837804150f4c8774dbc, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=960a2be5cb58461fb9fb8e99094398d6) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:55.258515 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df0bb0-6fb7-4efd-9c29-a6c7ecc3058a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:55.260180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df0bb0-6fb7-4efd-9c29-a6c7ecc3058a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:55.273766 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 262/533] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:17:55 2022] GET /identity/v3/role_assignments?user.id=960a2be5cb58461fb9fb8e99094398d6&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=8352f2960aa74837804150f4c8774dbc => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:55.275186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df0bb0-6fb7-4efd-9c29-a6c7ecc3058a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:55.281564 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf51437-d278-422a-b087-5a604d6259a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:55.282195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf51437-d278-422a-b087-5a604d6259a0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:55.282468 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf51437-d278-422a-b087-5a604d6259a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:55.282731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf51437-d278-422a-b087-5a604d6259a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:55.283387 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf51437-d278-422a-b087-5a604d6259a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:55.283686 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf51437-d278-422a-b087-5a604d6259a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:55.285109 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf51437-d278-422a-b087-5a604d6259a0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:55.324755 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 272/534] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:55.326994 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf51437-d278-422a-b087-5a604d6259a0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:55.477100 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf51437-d278-422a-b087-5a604d6259a0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:55.536612 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df0bb0-6fb7-4efd-9c29-a6c7ecc3058a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:55.556678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2d6fe-013f-4cd3-ae90-20d5ade4151c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:55.557320 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2d6fe-013f-4cd3-ae90-20d5ade4151c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:55.557624 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2d6fe-013f-4cd3-ae90-20d5ade4151c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:55.557893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2d6fe-013f-4cd3-ae90-20d5ade4151c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:55.569601 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2d6fe-013f-4cd3-ae90-20d5ade4151c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:55.571928 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2d6fe-013f-4cd3-ae90-20d5ade4151c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:55.594582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-1df2d6fe-013f-4cd3-ae90-20d5ade4151c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:17:55.594582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:55.594582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:55.594582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:55.594582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:55.594582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:55.594582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:55.594582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:55.594582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:55.594582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:55.594582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:55.594582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:55.594582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:17:55.594582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:17:55.594582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:17:55.595486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:17:55.595486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:55.595486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:55.595486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:55.595486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:55.595486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:55.595486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:55.595486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:55.595486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:55.595486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:55.595486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:55.595486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:55.595486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:55.595486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:55.595486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:55.595486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:55.595486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:55.596351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:17:55.596351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:17:55.596351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:17:55.596351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:17:55.596351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:17:55.596351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:17:55.596351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:17:55.596351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:55.596351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 273/535] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:17:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:55.605628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2d6fe-013f-4cd3-ae90-20d5ade4151c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:55.621246 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf2b79-7b57-4228-b1fe-fd513aea367f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:55.621948 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf2b79-7b57-4228-b1fe-fd513aea367f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:55.622180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf2b79-7b57-4228-b1fe-fd513aea367f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:55.622455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf2b79-7b57-4228-b1fe-fd513aea367f None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:55.623109 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf2b79-7b57-4228-b1fe-fd513aea367f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:55.623479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf2b79-7b57-4228-b1fe-fd513aea367f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:55.624895 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf2b79-7b57-4228-b1fe-fd513aea367f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:55.625557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:55.656094 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 263/536] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:55.664354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf2b79-7b57-4228-b1fe-fd513aea367f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:55.684584 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:55.767680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2d6fe-013f-4cd3-ae90-20d5ade4151c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:55.834904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba3749-f8ce-434b-9d07-1cd110c73ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:55.835522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba3749-f8ce-434b-9d07-1cd110c73ebb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:55.835797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba3749-f8ce-434b-9d07-1cd110c73ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:55.836062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba3749-f8ce-434b-9d07-1cd110c73ebb None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:55.836766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba3749-f8ce-434b-9d07-1cd110c73ebb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:55.837068 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba3749-f8ce-434b-9d07-1cd110c73ebb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:55.838567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba3749-f8ce-434b-9d07-1cd110c73ebb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:55.846331 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf2b79-7b57-4228-b1fe-fd513aea367f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:55.868981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 274/537] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:17:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:55.875759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba3749-f8ce-434b-9d07-1cd110c73ebb None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:55.899613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ec86a-337d-4ebd-a7dc-cbb1be31e78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:55.900263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ec86a-337d-4ebd-a7dc-cbb1be31e78d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:55.900540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ec86a-337d-4ebd-a7dc-cbb1be31e78d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:55.900808 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ec86a-337d-4ebd-a7dc-cbb1be31e78d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:55.916206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ec86a-337d-4ebd-a7dc-cbb1be31e78d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:55.917781 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ec86a-337d-4ebd-a7dc-cbb1be31e78d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:55.939133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-5e2ec86a-337d-4ebd-a7dc-cbb1be31e78d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:17:55.939133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:55.939133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:55.939133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:55.939133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:55.939133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:55.939133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:55.939133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:55.939133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:55.939133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:55.939133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:55.939133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:55.939133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:17:55.939133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:17:55.939133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:17:55.940036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:17:55.940036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:55.940036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:55.940036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:55.940036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:55.940036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:55.940036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:55.940036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:55.940036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:55.940036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:55.940036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:55.940036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:55.940036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:55.940036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:55.940036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:55.940036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:55.940036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:55.940897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:17:55.940897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:17:55.940897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:17:55.940897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:17:55.940897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:17:55.940897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:17:55.940897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:17:55.940897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:55.948777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 264/538] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:17:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:17:55.954528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ec86a-337d-4ebd-a7dc-cbb1be31e78d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:56.000759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:56.028225 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:56.028834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba3749-f8ce-434b-9d07-1cd110c73ebb None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:56.066547 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0c28c-82ab-4f2c-88f6-11a0d56afc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:56.067254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0c28c-82ab-4f2c-88f6-11a0d56afc40 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:56.067573 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0c28c-82ab-4f2c-88f6-11a0d56afc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:56.067819 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ec86a-337d-4ebd-a7dc-cbb1be31e78d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:56.067923 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0c28c-82ab-4f2c-88f6-11a0d56afc40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:56.068913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0c28c-82ab-4f2c-88f6-11a0d56afc40 None admin] RBAC: Adding query filter params (role.id=8352f2960aa74837804150f4c8774dbc, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=382b0ee3bd634cc8800f1769c91b7a8a) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:56.069219 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0c28c-82ab-4f2c-88f6-11a0d56afc40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:56.070852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0c28c-82ab-4f2c-88f6-11a0d56afc40 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:56.085543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 275/539] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:17:55 2022] GET /identity/v3/role_assignments?user.id=382b0ee3bd634cc8800f1769c91b7a8a&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=8352f2960aa74837804150f4c8774dbc => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:17:56.087061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764bfcc-1621-439a-9719-bc618337c3b5 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:56.087288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764bfcc-1621-439a-9719-bc618337c3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:56.087599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764bfcc-1621-439a-9719-bc618337c3b5 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:56.089269 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 276/540] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:56.103278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0088c0-cb99-4676-bbc1-4acbdc2db0b4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:56.103601 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0088c0-cb99-4676-bbc1-4acbdc2db0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:56.103817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0088c0-cb99-4676-bbc1-4acbdc2db0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:56.115647 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a222aea-f2c2-41b0-8ea2-58dca707b47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:56.117905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a222aea-f2c2-41b0-8ea2-58dca707b47f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:56.118420 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a222aea-f2c2-41b0-8ea2-58dca707b47f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:56.119322 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a222aea-f2c2-41b0-8ea2-58dca707b47f None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:56.121176 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a222aea-f2c2-41b0-8ea2-58dca707b47f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:56.121755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a222aea-f2c2-41b0-8ea2-58dca707b47f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:56.124123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a222aea-f2c2-41b0-8ea2-58dca707b47f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:56.147624 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-8a0088c0-cb99-4676-bbc1-4acbdc2db0b4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:56.149985 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8a0088c0-cb99-4676-bbc1-4acbdc2db0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:56.161076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 265/541] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:17:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:56.169863 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a222aea-f2c2-41b0-8ea2-58dca707b47f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:56.269962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 277/542] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:17:56.318445 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a222aea-f2c2-41b0-8ea2-58dca707b47f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:56.370913 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:56.381052 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d8227-1cd5-4e5d-9acb-f63c9c1c1f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:56.381951 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d8227-1cd5-4e5d-9acb-f63c9c1c1f23 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:56.382417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d8227-1cd5-4e5d-9acb-f63c9c1c1f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:56.382826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d8227-1cd5-4e5d-9acb-f63c9c1c1f23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:56.383748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d8227-1cd5-4e5d-9acb-f63c9c1c1f23 None admin] RBAC: Adding query filter params (role.id=8352f2960aa74837804150f4c8774dbc, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=47429aec6d8a4339b4ec0fb32b25e90b) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:56.384213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d8227-1cd5-4e5d-9acb-f63c9c1c1f23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:56.385845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d8227-1cd5-4e5d-9acb-f63c9c1c1f23 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:56.396213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 266/543] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:17:56 2022] GET /identity/v3/role_assignments?user.id=47429aec6d8a4339b4ec0fb32b25e90b&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=8352f2960aa74837804150f4c8774dbc => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:56.436721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3fcdc-9012-4260-8165-b79f6a6c3db1 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:56.437064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3fcdc-9012-4260-8165-b79f6a6c3db1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:56.437336 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3fcdc-9012-4260-8165-b79f6a6c3db1 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:56.438982 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 278/544] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:56.444690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f90f18-ac79-4056-a537-c754ffda9707 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:56.445241 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f90f18-ac79-4056-a537-c754ffda9707 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:56.445715 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f90f18-ac79-4056-a537-c754ffda9707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:56.465495 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c2f90f18-ac79-4056-a537-c754ffda9707 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:56.467118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c2f90f18-ac79-4056-a537-c754ffda9707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:56.542128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 267/545] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:56.554764 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3fcdc-9012-4260-8165-b79f6a6c3db1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:56.658469 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:56.715141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3fcdc-9012-4260-8165-b79f6a6c3db1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:56.756271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa732f1-e95a-4abc-91c6-69e60aa133ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:56.756904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa732f1-e95a-4abc-91c6-69e60aa133ac None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:56.757185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa732f1-e95a-4abc-91c6-69e60aa133ac None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:56.757478 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa732f1-e95a-4abc-91c6-69e60aa133ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:56.770175 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa732f1-e95a-4abc-91c6-69e60aa133ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:56.775098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-0fa732f1-e95a-4abc-91c6-69e60aa133ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:56.775098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:56.775098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:56.775098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:56.775098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:56.775098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:56.775098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:56.775098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:56.775098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:56.775098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:56.775098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:56.775098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:56.775098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:56.775098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:56.775098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:56.775098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:56.775984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:56.775984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:56.775984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:56.775984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:56.775984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:56.775984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:56.775984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:56.775984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:56.775984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:56.775984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:56.775984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:56.775984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:56.775984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:56.775984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:56.775984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:56.775984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:56.776774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:56.776774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:56.776774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:56.776774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:56.776774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:56.776774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:56.776774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:56.776774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:56.776774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:56.776774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:56.776774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:56.776774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:56.776774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 279/546] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:17:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:56.792696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f90f18-ac79-4056-a537-c754ffda9707 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:56.914583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa732f1-e95a-4abc-91c6-69e60aa133ac None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:56.943254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f90f18-ac79-4056-a537-c754ffda9707 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:56.973853 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:56.988199 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6d53b-37da-42b7-b1d1-4516a19cbe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:56.988821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6d53b-37da-42b7-b1d1-4516a19cbe88 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:56.989095 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6d53b-37da-42b7-b1d1-4516a19cbe88 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:56.989385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6d53b-37da-42b7-b1d1-4516a19cbe88 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:56.990063 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6d53b-37da-42b7-b1d1-4516a19cbe88 None admin] RBAC: Adding query filter params (name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:56.990362 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6d53b-37da-42b7-b1d1-4516a19cbe88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:56.991849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6d53b-37da-42b7-b1d1-4516a19cbe88 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:57.020226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 268/547] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:17:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:57.030896 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6d53b-37da-42b7-b1d1-4516a19cbe88 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:57.118151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa732f1-e95a-4abc-91c6-69e60aa133ac None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:57.171634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:57.194064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370de39-f6e2-4bed-ad66-91fa329eab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:57.195178 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370de39-f6e2-4bed-ad66-91fa329eab4e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:57.195681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370de39-f6e2-4bed-ad66-91fa329eab4e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:57.196160 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370de39-f6e2-4bed-ad66-91fa329eab4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:57.227532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370de39-f6e2-4bed-ad66-91fa329eab4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:57.232367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-f370de39-f6e2-4bed-ad66-91fa329eab4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:57.232367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:57.232367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:57.232367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:57.232367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:57.232367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:57.232367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:57.232367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:57.232367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:57.232367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:57.232367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:57.232367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:57.232367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:57.232367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:57.232367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:57.232367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:57.233288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:57.233288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:57.233288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:57.233288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:57.233288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:57.233288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:57.233288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:57.233288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:57.233288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:57.233288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:57.233288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:57.233288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:57.233288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:57.233288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:57.233288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:57.233288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:57.234106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:57.234106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:57.234106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:57.234106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:57.234106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:57.234106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:57.234106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:57.234106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:57.234106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:57.234106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:57.234106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:57.234106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:57.234106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 280/548] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:17:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:17:57.242970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370de39-f6e2-4bed-ad66-91fa329eab4e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:57.262709 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6d53b-37da-42b7-b1d1-4516a19cbe88 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:57.319547 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ee025-3b99-4614-ab2d-1b367bafcdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:57.323662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ee025-3b99-4614-ab2d-1b367bafcdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:57.323960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ee025-3b99-4614-ab2d-1b367bafcdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:57.324238 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ee025-3b99-4614-ab2d-1b367bafcdf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:57.353381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ee025-3b99-4614-ab2d-1b367bafcdf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:57.353381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ee025-3b99-4614-ab2d-1b367bafcdf5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:57.388369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-345ee025-3b99-4614-ab2d-1b367bafcdf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:57.388369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:57.388369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:57.388369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:57.388369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:57.388369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:57.388369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:57.388369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:57.388369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:57.388369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:57.388369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:57.388369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:57.388369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:57.388369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:57.388369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:57.388369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:57.390718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:57.390718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:57.390718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:57.390718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:57.390718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:57.390718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:57.390718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:57.390718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:57.390718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:57.390718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:57.390718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:57.390718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:57.390718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:57.390718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:57.390718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:57.390718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:57.390718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:57.392226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:57.392226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:57.392226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:57.394507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 269/549] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:17:57.395703 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ee025-3b99-4614-ab2d-1b367bafcdf5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:57.459877 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370de39-f6e2-4bed-ad66-91fa329eab4e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:57.461299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:57.499111 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2337be1-64b6-46bc-9517-2b3f2fd3b794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:57.499763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2337be1-64b6-46bc-9517-2b3f2fd3b794 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:57.500040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2337be1-64b6-46bc-9517-2b3f2fd3b794 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:57.500312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2337be1-64b6-46bc-9517-2b3f2fd3b794 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:57.500994 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2337be1-64b6-46bc-9517-2b3f2fd3b794 None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:57.501297 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2337be1-64b6-46bc-9517-2b3f2fd3b794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:57.502884 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2337be1-64b6-46bc-9517-2b3f2fd3b794 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:57.512471 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 281/550] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:17:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:57.513931 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2393290-f159-4cc2-b68e-44cc0607d952 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:57.514216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2393290-f159-4cc2-b68e-44cc0607d952 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:57.514488 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2393290-f159-4cc2-b68e-44cc0607d952 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:57.515960 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 282/551] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:57.521613 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36747157-4718-48a0-bb86-5008b17243a5 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:57.521890 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36747157-4718-48a0-bb86-5008b17243a5 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:57.522161 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36747157-4718-48a0-bb86-5008b17243a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:57.543571 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-36747157-4718-48a0-bb86-5008b17243a5 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:57.544393 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ee025-3b99-4614-ab2d-1b367bafcdf5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:57.544761 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-36747157-4718-48a0-bb86-5008b17243a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:57.581231 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6a280-9a04-40a3-a408-f8fb50fc756b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:57.582242 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6a280-9a04-40a3-a408-f8fb50fc756b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:57.582732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6a280-9a04-40a3-a408-f8fb50fc756b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:57.583207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6a280-9a04-40a3-a408-f8fb50fc756b None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:57.584048 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6a280-9a04-40a3-a408-f8fb50fc756b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:57.584648 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6a280-9a04-40a3-a408-f8fb50fc756b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:57.586252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6a280-9a04-40a3-a408-f8fb50fc756b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:57.597160 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:57.601283 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 270/552] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:57.602484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6a280-9a04-40a3-a408-f8fb50fc756b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:57.624799 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 283/553] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:57.625577 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36747157-4718-48a0-bb86-5008b17243a5 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:57.716679 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:57.725557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6a280-9a04-40a3-a408-f8fb50fc756b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:57.741383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36747157-4718-48a0-bb86-5008b17243a5 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:57.772625 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294751b-f645-4668-bece-0084ae8c2c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:57.773296 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294751b-f645-4668-bece-0084ae8c2c49 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:57.773536 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294751b-f645-4668-bece-0084ae8c2c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:57.773708 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294751b-f645-4668-bece-0084ae8c2c49 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:57.781566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294751b-f645-4668-bece-0084ae8c2c49 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:57.783246 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294751b-f645-4668-bece-0084ae8c2c49 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:57.792777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c1fd3-a881-4783-aeeb-36906c4c7087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:57.794266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c1fd3-a881-4783-aeeb-36906c4c7087 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:57.794763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c1fd3-a881-4783-aeeb-36906c4c7087 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:57.795310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c1fd3-a881-4783-aeeb-36906c4c7087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:57.801389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-f294751b-f645-4668-bece-0084ae8c2c49 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:17:57.801389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:57.801389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:57.801389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:57.801389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:57.801389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:57.801389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:57.801389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:57.801389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:57.801389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:57.801389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:57.801389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:57.801389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:17:57.801389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:17:57.801389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:17:57.801389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:57.802399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:57.803352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:57.803352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:57.803352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:17:57.803352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:17:57.803352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:17:57.803352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:17:57.803352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:17:57.803352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:17:57.803352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:17:57.803352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:57.803352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 284/554] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:17:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:57.811052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294751b-f645-4668-bece-0084ae8c2c49 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:57.814299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c1fd3-a881-4783-aeeb-36906c4c7087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:57.817457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c1fd3-a881-4783-aeeb-36906c4c7087 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:57.841329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-ed4c1fd3-a881-4783-aeeb-36906c4c7087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:57.841329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:57.841329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:57.841329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:57.841329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:57.841329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:57.841329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:57.841329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:57.841329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:57.841329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:57.841329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:57.841329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:57.841329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:57.841329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:57.841329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:57.841329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:57.842746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:57.842746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:57.842746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:57.842746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:57.842746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:57.842746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:57.842746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:57.842746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:57.842746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:57.842746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:57.842746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:57.842746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:57.842746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:57.842746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:57.842746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:57.842746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:57.842746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:57.843608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:57.843608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:57.843608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:57.843608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 271/555] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:57.848900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c1fd3-a881-4783-aeeb-36906c4c7087 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:57.887152 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:58.021476 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294751b-f645-4668-bece-0084ae8c2c49 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:58.033548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c1fd3-a881-4783-aeeb-36906c4c7087 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:58.064178 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc959c8c-2f98-4f13-81d7-edcccb0489eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:58.064785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc959c8c-2f98-4f13-81d7-edcccb0489eb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:58.065063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc959c8c-2f98-4f13-81d7-edcccb0489eb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:58.065348 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc959c8c-2f98-4f13-81d7-edcccb0489eb None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:58.066090 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc959c8c-2f98-4f13-81d7-edcccb0489eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:58.066393 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc959c8c-2f98-4f13-81d7-edcccb0489eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:58.068125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc959c8c-2f98-4f13-81d7-edcccb0489eb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:58.073180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582392c6-77cf-4426-8889-de5ae8e31a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:58.074286 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582392c6-77cf-4426-8889-de5ae8e31a21 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:58.074775 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582392c6-77cf-4426-8889-de5ae8e31a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:58.075259 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582392c6-77cf-4426-8889-de5ae8e31a21 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:58.076111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582392c6-77cf-4426-8889-de5ae8e31a21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:58.076658 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582392c6-77cf-4426-8889-de5ae8e31a21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:58.078335 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582392c6-77cf-4426-8889-de5ae8e31a21 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:58.090351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 285/556] 10.222.0.52 () {56 vars in 1135 bytes} [Mon Aug 29 20:17:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:58.091223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc959c8c-2f98-4f13-81d7-edcccb0489eb None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:58.092915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 272/557] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:58.102484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582392c6-77cf-4426-8889-de5ae8e31a21 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:58.113712 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:58.195014 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:58.202251 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc959c8c-2f98-4f13-81d7-edcccb0489eb None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:58.209752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582392c6-77cf-4426-8889-de5ae8e31a21 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:58.239106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f6585-2efc-4cd3-a28a-3616ed4dcf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:58.239750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f6585-2efc-4cd3-a28a-3616ed4dcf5b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:58.240032 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f6585-2efc-4cd3-a28a-3616ed4dcf5b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:58.240302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f6585-2efc-4cd3-a28a-3616ed4dcf5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:58.247213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf8b6-1ac2-444d-85f6-7f179a205f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:58.247970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf8b6-1ac2-444d-85f6-7f179a205f9f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:58.248460 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf8b6-1ac2-444d-85f6-7f179a205f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:58.248907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf8b6-1ac2-444d-85f6-7f179a205f9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:58.251793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f6585-2efc-4cd3-a28a-3616ed4dcf5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:58.256702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-ad5f6585-2efc-4cd3-a28a-3616ed4dcf5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:58.256702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:58.256702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:58.256702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:58.256702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:58.256702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:58.256702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:58.256702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:58.256702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:58.256702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:58.256702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:58.256702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:58.256702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:58.256702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:58.256702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:58.256702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:58.257674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:58.257674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:58.257674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:58.257674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:58.257674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:58.257674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:58.257674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:58.257674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:58.257674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:58.257674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:58.257674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:58.257674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:58.257674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:58.257674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:58.257674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:58.257674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:58.258511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:58.258511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:58.258511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:58.258511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:58.258511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:58.258511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:58.258511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:58.258511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:58.258511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:58.258511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:58.258511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:58.258511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:58.258511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 286/558] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:17:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:58.259205 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f6585-2efc-4cd3-a28a-3616ed4dcf5b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:58.338628 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaf8b6-1ac2-444d-85f6-7f179a205f9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:58.340461 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaf8b6-1ac2-444d-85f6-7f179a205f9f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:58.357806 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:58.368271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f6585-2efc-4cd3-a28a-3616ed4dcf5b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:58.405154 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bc81a-3b9b-4da5-92a7-eb52d4ee8f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:58.405816 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc81a-3b9b-4da5-92a7-eb52d4ee8f2b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:58.406097 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc81a-3b9b-4da5-92a7-eb52d4ee8f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:58.406370 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc81a-3b9b-4da5-92a7-eb52d4ee8f2b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:58.414390 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bc81a-3b9b-4da5-92a7-eb52d4ee8f2b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:58.416303 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bc81a-3b9b-4da5-92a7-eb52d4ee8f2b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:58.428759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-758bc81a-3b9b-4da5-92a7-eb52d4ee8f2b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:17:58.428759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:58.428759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:58.428759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:58.428759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:58.428759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:58.428759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:58.428759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:58.428759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:58.428759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:58.428759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:58.428759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:58.428759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:17:58.428759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:17:58.428759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:17:58.428759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:58.429870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:58.430821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:58.430821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:58.430821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:17:58.430821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:17:58.430821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:17:58.430821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:17:58.430821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:17:58.430821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:17:58.430821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:17:58.430821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:58.430821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 287/559] 10.222.0.52 () {56 vars in 1093 bytes} [Mon Aug 29 20:17:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:58.430821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bc81a-3b9b-4da5-92a7-eb52d4ee8f2b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:58.450542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:58.457007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 273/560] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:17:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:17:58.458248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf8b6-1ac2-444d-85f6-7f179a205f9f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:58.545444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bc81a-3b9b-4da5-92a7-eb52d4ee8f2b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:58.578797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf8b6-1ac2-444d-85f6-7f179a205f9f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:58.583793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664e998-4005-40b4-9746-8dfae929eab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:58.584429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664e998-4005-40b4-9746-8dfae929eab6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:58.584706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664e998-4005-40b4-9746-8dfae929eab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:58.584971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664e998-4005-40b4-9746-8dfae929eab6 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:58.585662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664e998-4005-40b4-9746-8dfae929eab6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:58.585978 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664e998-4005-40b4-9746-8dfae929eab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:58.587380 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664e998-4005-40b4-9746-8dfae929eab6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:58.589585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:58.601412 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 288/561] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:17:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:58.601412 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664e998-4005-40b4-9746-8dfae929eab6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:58.619777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc501f-b164-4997-89a2-2227758b08c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:58.620398 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc501f-b164-4997-89a2-2227758b08c9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:58.620834 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc501f-b164-4997-89a2-2227758b08c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:58.621114 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc501f-b164-4997-89a2-2227758b08c9 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:58.622197 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc501f-b164-4997-89a2-2227758b08c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:58.622541 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc501f-b164-4997-89a2-2227758b08c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:58.624069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc501f-b164-4997-89a2-2227758b08c9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:58.653410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 274/562] 10.222.0.52 () {56 vars in 1133 bytes} [Mon Aug 29 20:17:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:58.653410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0806475-ab3b-486f-8cb1-8d242b9b7545 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:58.653410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0806475-ab3b-486f-8cb1-8d242b9b7545 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:58.653410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0806475-ab3b-486f-8cb1-8d242b9b7545 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:58.653410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 275/563] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:58.653410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0806475-ab3b-486f-8cb1-8d242b9b7545 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:58.684112 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:58.706869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664e998-4005-40b4-9746-8dfae929eab6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:58.741702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcfc1d-766d-4766-9141-39ab250b9905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:58.742334 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcfc1d-766d-4766-9141-39ab250b9905 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:58.742602 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcfc1d-766d-4766-9141-39ab250b9905 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:58.742866 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcfc1d-766d-4766-9141-39ab250b9905 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:58.753835 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcfc1d-766d-4766-9141-39ab250b9905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:58.755300 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcfc1d-766d-4766-9141-39ab250b9905 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:58.762885 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0806475-ab3b-486f-8cb1-8d242b9b7545 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:58.769800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-ffdcfc1d-766d-4766-9141-39ab250b9905 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:58.769800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:58.769800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:58.769800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:58.769800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:58.769800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:58.769800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:58.769800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:58.769800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:58.769800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:58.769800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:58.769800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:58.769800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:58.769800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:58.769800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:58.769800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:58.770936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:58.770936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:58.770936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:58.770936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:58.770936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:58.770936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:58.770936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:58.770936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:58.770936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:58.770936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:58.770936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:58.770936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:58.770936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:58.770936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:58.770936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:58.770936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:58.770936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:58.777076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:58.777076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:58.777076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:58.777076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 289/564] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:58.777076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffc41f-297f-4976-9c00-a72d5f16d6aa None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:58.777076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffc41f-297f-4976-9c00-a72d5f16d6aa None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:58.777076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffc41f-297f-4976-9c00-a72d5f16d6aa None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:58.777076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 290/565] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:17:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:58.777076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffc41f-297f-4976-9c00-a72d5f16d6aa None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:58.803060 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a868555-9e5e-40d2-8482-2f9dc1285e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:58.803752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a868555-9e5e-40d2-8482-2f9dc1285e73 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:58.804225 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a868555-9e5e-40d2-8482-2f9dc1285e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:58.804347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a868555-9e5e-40d2-8482-2f9dc1285e73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:58.816381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a868555-9e5e-40d2-8482-2f9dc1285e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:58.817931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a868555-9e5e-40d2-8482-2f9dc1285e73 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:58.833208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-1a868555-9e5e-40d2-8482-2f9dc1285e73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:58.833208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:58.833208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:58.833208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:58.833208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:58.833208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:58.833208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:58.833208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:58.833208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:58.833208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:58.833208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:58.833208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:58.833208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:58.833208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:58.833208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:58.833208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:58.834484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:58.834484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:58.834484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:58.834484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:58.834484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:58.834484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:58.834484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:58.834484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:58.834484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:58.834484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:58.834484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:58.834484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:58.834484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:58.834484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:58.834484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:58.834484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:58.834484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:58.835370 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:58.835370 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:58.835370 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:58.835370 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 276/566] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:58.835925 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77248b1f-4b68-406d-a546-31df71456d44 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:58.836201 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77248b1f-4b68-406d-a546-31df71456d44 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:58.836467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77248b1f-4b68-406d-a546-31df71456d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:58.855716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-77248b1f-4b68-406d-a546-31df71456d44 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:58.857197 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-77248b1f-4b68-406d-a546-31df71456d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:58.871114 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:58.895428 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffc41f-297f-4976-9c00-a72d5f16d6aa None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:58.925153 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:58.928060 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 277/567] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:58.928807 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77248b1f-4b68-406d-a546-31df71456d44 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:58.933183 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b13b49-bb7b-49f0-b8d0-bf6af1c5b4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:58.933842 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b13b49-bb7b-49f0-b8d0-bf6af1c5b4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:58.934128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b13b49-bb7b-49f0-b8d0-bf6af1c5b4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:58.934398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b13b49-bb7b-49f0-b8d0-bf6af1c5b4f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:58.945758 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b13b49-bb7b-49f0-b8d0-bf6af1c5b4f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:58.947277 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b13b49-bb7b-49f0-b8d0-bf6af1c5b4f3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:58.963035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-b9b13b49-bb7b-49f0-b8d0-bf6af1c5b4f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:58.963035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:58.963035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:58.963035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:58.963035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:58.963035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:58.963035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:58.963035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:58.963035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:58.963035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:58.963035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:58.963035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:58.963035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:17:58.963035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:17:58.963035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:17:58.963035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:17:58.964052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:58.964052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:58.964052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:58.964052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:58.964052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:58.964052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:58.964052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:58.964052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:58.964052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:58.964052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:58.964052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:58.964052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:58.964052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:58.964052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:58.964052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:58.964052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:58.964052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:17:58.964997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:17:58.964997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:17:58.964997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:58.964997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 291/568] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:58.965778 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe2847-ca16-4eac-9346-4af268847417 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:58.965778 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe2847-ca16-4eac-9346-4af268847417 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:58.966015 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe2847-ca16-4eac-9346-4af268847417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:58.986653 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f7fe2847-ca16-4eac-9346-4af268847417 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:58.987772 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f7fe2847-ca16-4eac-9346-4af268847417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:59.056636 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77248b1f-4b68-406d-a546-31df71456d44 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:59.064874 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 292/569] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:17:59.066056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe2847-ca16-4eac-9346-4af268847417 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:59.115734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91d7e2-637c-48db-967d-c87db743b47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:59.116843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d7e2-637c-48db-967d-c87db743b47d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:59.117268 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d7e2-637c-48db-967d-c87db743b47d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:59.117690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91d7e2-637c-48db-967d-c87db743b47d None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:59.118730 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91d7e2-637c-48db-967d-c87db743b47d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:59.119647 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91d7e2-637c-48db-967d-c87db743b47d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:59.121470 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91d7e2-637c-48db-967d-c87db743b47d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:59.138880 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 278/570] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:59.140315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91d7e2-637c-48db-967d-c87db743b47d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:59.158544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:59.180521 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe2847-ca16-4eac-9346-4af268847417 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:59.194871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:59.229977 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bf27b-9feb-431e-8cc4-60f1c689f90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:59.230592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bf27b-9feb-431e-8cc4-60f1c689f90c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:59.230865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bf27b-9feb-431e-8cc4-60f1c689f90c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:59.231128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bf27b-9feb-431e-8cc4-60f1c689f90c None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:59.231955 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bf27b-9feb-431e-8cc4-60f1c689f90c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:59.232074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bf27b-9feb-431e-8cc4-60f1c689f90c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:59.233551 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bf27b-9feb-431e-8cc4-60f1c689f90c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:59.245302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 293/571] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:59.245967 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bf27b-9feb-431e-8cc4-60f1c689f90c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:59.276495 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91d7e2-637c-48db-967d-c87db743b47d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:59.314862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c71f7b-a33e-441e-820a-b31b9bc781a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:59.315550 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c71f7b-a33e-441e-820a-b31b9bc781a1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:59.315731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c71f7b-a33e-441e-820a-b31b9bc781a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:59.315998 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c71f7b-a33e-441e-820a-b31b9bc781a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:59.316728 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c71f7b-a33e-441e-820a-b31b9bc781a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:59.317021 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c71f7b-a33e-441e-820a-b31b9bc781a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:59.318506 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c71f7b-a33e-441e-820a-b31b9bc781a1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:59.334738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 279/572] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:59.335876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c71f7b-a33e-441e-820a-b31b9bc781a1 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:59.362552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bf27b-9feb-431e-8cc4-60f1c689f90c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:59.396033 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b852c-7dfe-4bbe-96cb-e7a62ca47381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:59.396574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b852c-7dfe-4bbe-96cb-e7a62ca47381 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:59.396847 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b852c-7dfe-4bbe-96cb-e7a62ca47381 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:59.397106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b852c-7dfe-4bbe-96cb-e7a62ca47381 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:59.403942 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b852c-7dfe-4bbe-96cb-e7a62ca47381 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:59.404643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:59.405449 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b852c-7dfe-4bbe-96cb-e7a62ca47381 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:59.417273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-4a3b852c-7dfe-4bbe-96cb-e7a62ca47381 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:17:59.417273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:59.417273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:59.417273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:59.417273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:59.417273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:59.417273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:59.417273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:59.417273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:59.417273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:59.417273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:59.417273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:59.417273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:17:59.417273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:17:59.417273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:17:59.418453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:17:59.418453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:59.418453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:59.418453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:59.418453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:59.418453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:59.418453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:59.418453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:59.418453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:59.418453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:59.418453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:59.418453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:59.418453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:59.418453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:59.418453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:59.418453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:59.418453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:59.419394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:17:59.419394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:17:59.419394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:17:59.419394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:17:59.419394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:17:59.419394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:17:59.419394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:17:59.419394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:59.419394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 294/573] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:17:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:59.419886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b852c-7dfe-4bbe-96cb-e7a62ca47381 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:59.442863 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c71f7b-a33e-441e-820a-b31b9bc781a1 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:59.457248 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:59.491066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa29e6-089a-434f-bf00-490868a37761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:59.491695 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa29e6-089a-434f-bf00-490868a37761 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:59.491967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa29e6-089a-434f-bf00-490868a37761 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:59.492234 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa29e6-089a-434f-bf00-490868a37761 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:59.504230 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa29e6-089a-434f-bf00-490868a37761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:59.509054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-39aa29e6-089a-434f-bf00-490868a37761 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:59.509054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:59.509054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:59.509054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:59.509054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:59.509054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:59.509054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:59.509054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:59.509054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:59.509054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:59.509054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:59.509054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:59.509054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:59.509054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:59.509054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:59.509054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:59.510038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:59.510038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:59.510038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:59.510038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:59.510038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:59.510038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:59.510038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:59.510038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:59.510038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:59.510038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:59.510038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:59.510038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:59.510038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:59.510038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:59.510038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:59.510038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:59.510862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:59.510862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:59.510862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:59.510862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:59.510862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:59.510862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:59.510862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:59.510862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:59.510862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:59.510862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:59.510862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:59.510862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:59.510862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 280/574] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:17:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:59.511661 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa29e6-089a-434f-bf00-490868a37761 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:59.537188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b852c-7dfe-4bbe-96cb-e7a62ca47381 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:59.575536 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736c58b-a0e5-4a2c-8fe6-e01a91d24557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:59.576280 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736c58b-a0e5-4a2c-8fe6-e01a91d24557 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:59.576602 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736c58b-a0e5-4a2c-8fe6-e01a91d24557 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:59.576885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736c58b-a0e5-4a2c-8fe6-e01a91d24557 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:59.585346 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736c58b-a0e5-4a2c-8fe6-e01a91d24557 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:59.586843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736c58b-a0e5-4a2c-8fe6-e01a91d24557 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:59.599136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-6736c58b-a0e5-4a2c-8fe6-e01a91d24557 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:17:59.599136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:59.599136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:59.599136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:59.599136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:59.599136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:59.599136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:59.599136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:59.599136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:59.599136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:59.599136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:59.599136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:59.599136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:17:59.599136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:17:59.599136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:17:59.599136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:59.600337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:59.601278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:59.601278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:59.601278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:17:59.601278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:17:59.601278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:17:59.601278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:17:59.601278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:17:59.601278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:17:59.601278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:17:59.601278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:59.601278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 295/575] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:17:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:59.601278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736c58b-a0e5-4a2c-8fe6-e01a91d24557 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:59.627896 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa29e6-089a-434f-bf00-490868a37761 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:59.655728 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:59.664303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e1245-282c-49ea-bde4-b39bc0bbfa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:59.664939 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e1245-282c-49ea-bde4-b39bc0bbfa05 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:59.665217 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e1245-282c-49ea-bde4-b39bc0bbfa05 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:59.665519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e1245-282c-49ea-bde4-b39bc0bbfa05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:59.675821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e1245-282c-49ea-bde4-b39bc0bbfa05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:17:59.680684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-987e1245-282c-49ea-bde4-b39bc0bbfa05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:59.680684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:59.680684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:59.680684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:59.680684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:59.680684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:59.680684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:59.680684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:59.680684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:59.680684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:59.680684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:59.680684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:59.680684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:17:59.680684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:17:59.680684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:17:59.680684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:17:59.681738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:17:59.681738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:17:59.681738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:17:59.681738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:17:59.681738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:59.681738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:59.681738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:59.681738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:59.681738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:59.681738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:59.681738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:59.681738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:59.681738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:59.681738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:59.681738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:59.681738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:59.682587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:59.682587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:59.682587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:59.682587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:59.682587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:17:59.682587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:17:59.682587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:17:59.682587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:17:59.682587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:17:59.682587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:17:59.682587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:17:59.682587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:17:59.682587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 281/576] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:17:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:59.682587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e1245-282c-49ea-bde4-b39bc0bbfa05 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:59.698282 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:59.711696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736c58b-a0e5-4a2c-8fe6-e01a91d24557 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:59.749907 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bb1b4-83d9-4c72-8bbf-ce1d0d03be7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:59.751281 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bb1b4-83d9-4c72-8bbf-ce1d0d03be7a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:59.751565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bb1b4-83d9-4c72-8bbf-ce1d0d03be7a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:59.751828 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bb1b4-83d9-4c72-8bbf-ce1d0d03be7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:59.759238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bb1b4-83d9-4c72-8bbf-ce1d0d03be7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:59.760704 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bb1b4-83d9-4c72-8bbf-ce1d0d03be7a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:59.779527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-741bb1b4-83d9-4c72-8bbf-ce1d0d03be7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:17:59.779527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:17:59.779527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:17:59.779527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:17:59.779527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:17:59.779527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:17:59.779527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:17:59.779527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:17:59.779527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:17:59.779527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:17:59.779527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:17:59.779527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:17:59.779527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:17:59.779527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:17:59.779527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:17:59.781906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:17:59.781906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:17:59.781906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:17:59.781906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:17:59.781906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:17:59.781906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:17:59.781906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:17:59.781906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:17:59.781906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:17:59.781906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:17:59.781906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:17:59.781906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:17:59.781906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:17:59.781906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:17:59.781906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:17:59.781906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:17:59.781906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:17:59.783122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:17:59.783122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:17:59.783122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:17:59.783122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:17:59.783122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:17:59.783122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:17:59.783122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:17:59.783122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:17:59.783122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 296/577] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:17:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:17:59.783122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bb1b4-83d9-4c72-8bbf-ce1d0d03be7a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:59.810298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e1245-282c-49ea-bde4-b39bc0bbfa05 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:59.848841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86d25f-6f6f-408b-8dbd-32efdc700282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:59.850053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86d25f-6f6f-408b-8dbd-32efdc700282 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:59.850053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86d25f-6f6f-408b-8dbd-32efdc700282 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:59.850053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86d25f-6f6f-408b-8dbd-32efdc700282 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:59.850641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86d25f-6f6f-408b-8dbd-32efdc700282 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:59.850944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86d25f-6f6f-408b-8dbd-32efdc700282 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:59.852404 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86d25f-6f6f-408b-8dbd-32efdc700282 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:59.870200 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 282/578] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:17:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:59.870200 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86d25f-6f6f-408b-8dbd-32efdc700282 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:59.919952 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bb1b4-83d9-4c72-8bbf-ce1d0d03be7a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:59.923419 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:59.962291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878354b-6813-4ef3-bbf1-b20063aeb70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:59.962900 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878354b-6813-4ef3-bbf1-b20063aeb70e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:59.963199 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878354b-6813-4ef3-bbf1-b20063aeb70e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:59.963480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878354b-6813-4ef3-bbf1-b20063aeb70e None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:59.964159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878354b-6813-4ef3-bbf1-b20063aeb70e None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:59.964449 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878354b-6813-4ef3-bbf1-b20063aeb70e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:59.965885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878354b-6813-4ef3-bbf1-b20063aeb70e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:59.974987 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 297/579] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:17:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:59.975801 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878354b-6813-4ef3-bbf1-b20063aeb70e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:59.986567 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86d25f-6f6f-408b-8dbd-32efdc700282 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:00.003051 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:00.027174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15b699-27b6-4c80-8540-7f915ec7db86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:00.027795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15b699-27b6-4c80-8540-7f915ec7db86 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:00.028070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15b699-27b6-4c80-8540-7f915ec7db86 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:00.028323 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15b699-27b6-4c80-8540-7f915ec7db86 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:00.029181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15b699-27b6-4c80-8540-7f915ec7db86 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:00.029535 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15b699-27b6-4c80-8540-7f915ec7db86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:00.031055 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15b699-27b6-4c80-8540-7f915ec7db86 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:00.060475 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 283/580] 10.222.0.52 () {56 vars in 1137 bytes} [Mon Aug 29 20:17:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:00.061542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15b699-27b6-4c80-8540-7f915ec7db86 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:00.099491 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878354b-6813-4ef3-bbf1-b20063aeb70e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:00.142425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cfb78-2e9a-44b9-bb65-6cfc7a9085b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:00.143039 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cfb78-2e9a-44b9-bb65-6cfc7a9085b3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:00.143317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cfb78-2e9a-44b9-bb65-6cfc7a9085b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:00.143588 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cfb78-2e9a-44b9-bb65-6cfc7a9085b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:00.144249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cfb78-2e9a-44b9-bb65-6cfc7a9085b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:00.144550 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cfb78-2e9a-44b9-bb65-6cfc7a9085b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:00.146012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cfb78-2e9a-44b9-bb65-6cfc7a9085b3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:00.154179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 298/581] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:17:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:00.155062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cfb78-2e9a-44b9-bb65-6cfc7a9085b3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:00.175735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15b699-27b6-4c80-8540-7f915ec7db86 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:00.183361 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:00.222715 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2326234-a897-41bf-bfed-576fb1cdfa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:00.223475 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2326234-a897-41bf-bfed-576fb1cdfa0c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:00.223840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2326234-a897-41bf-bfed-576fb1cdfa0c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:00.224216 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2326234-a897-41bf-bfed-576fb1cdfa0c None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:00.225119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2326234-a897-41bf-bfed-576fb1cdfa0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:00.225589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2326234-a897-41bf-bfed-576fb1cdfa0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:00.227099 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2326234-a897-41bf-bfed-576fb1cdfa0c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:00.237163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:00.239478 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 284/582] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:00.240568 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2326234-a897-41bf-bfed-576fb1cdfa0c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:00.262213 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cfb78-2e9a-44b9-bb65-6cfc7a9085b3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:00.297672 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53693f6-f9f7-4e0a-91e8-fe2e692df335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:00.298281 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53693f6-f9f7-4e0a-91e8-fe2e692df335 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:00.298558 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53693f6-f9f7-4e0a-91e8-fe2e692df335 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:00.298828 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53693f6-f9f7-4e0a-91e8-fe2e692df335 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:00.299586 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53693f6-f9f7-4e0a-91e8-fe2e692df335 None admin] RBAC: Adding query filter params (role.id=8352f2960aa74837804150f4c8774dbc, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=dcb9791ea73d46b191ad9fc146297565) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:00.299893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53693f6-f9f7-4e0a-91e8-fe2e692df335 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:00.301375 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53693f6-f9f7-4e0a-91e8-fe2e692df335 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:00.307179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 299/583] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:18:00 2022] GET /identity/v3/role_assignments?user.id=dcb9791ea73d46b191ad9fc146297565&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=8352f2960aa74837804150f4c8774dbc => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:00.307813 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53693f6-f9f7-4e0a-91e8-fe2e692df335 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:00.361093 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2326234-a897-41bf-bfed-576fb1cdfa0c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:00.402425 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe109c-5bb1-4cf4-b90f-c48c2b771be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:00.402923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe109c-5bb1-4cf4-b90f-c48c2b771be8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:00.403120 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe109c-5bb1-4cf4-b90f-c48c2b771be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:00.403400 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe109c-5bb1-4cf4-b90f-c48c2b771be8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:00.416381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe109c-5bb1-4cf4-b90f-c48c2b771be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:00.418125 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe109c-5bb1-4cf4-b90f-c48c2b771be8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:00.434755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-a5fe109c-5bb1-4cf4-b90f-c48c2b771be8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:00.434755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:00.434755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:00.434755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:00.434755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:00.434755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:00.434755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:00.434755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:00.434755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:00.434755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:00.434755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:00.434755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:00.434755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:00.434755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:00.434755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:00.434755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:00.435848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:00.435848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:00.435848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:00.435848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:00.435848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:00.435848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:00.435848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:00.435848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:00.435848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:00.435848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:00.435848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:00.435848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:00.435848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:00.435848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:00.435848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:00.435848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:00.435848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:00.436757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:00.436757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:00.436757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:00.436757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 285/584] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:00.436987 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe109c-5bb1-4cf4-b90f-c48c2b771be8 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:00.448243 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53693f6-f9f7-4e0a-91e8-fe2e692df335 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:00.466090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:00.487752 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3ea94-95f9-4c7a-b6f3-3c2491ff5aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:00.488392 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3ea94-95f9-4c7a-b6f3-3c2491ff5aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:00.488672 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3ea94-95f9-4c7a-b6f3-3c2491ff5aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:00.488939 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3ea94-95f9-4c7a-b6f3-3c2491ff5aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:00.500410 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:00.503195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3ea94-95f9-4c7a-b6f3-3c2491ff5aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:00.505262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3ea94-95f9-4c7a-b6f3-3c2491ff5aa2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:00.521060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-e1a3ea94-95f9-4c7a-b6f3-3c2491ff5aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:00.521060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:00.521060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:00.521060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:00.521060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:00.521060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:00.521060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:00.521060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:00.521060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:00.521060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:00.521060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:00.521060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:00.521060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:00.521060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:00.521060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:00.521060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:00.522173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:00.522173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:00.522173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:00.522173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:00.522173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:00.522173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:00.522173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:00.522173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:00.522173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:00.522173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:00.522173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:00.522173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:00.522173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:00.522173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:00.522173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:00.522173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:00.522173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:00.523053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:00.523053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:00.523053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:00.523053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 300/585] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:00.523053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3ea94-95f9-4c7a-b6f3-3c2491ff5aa2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:00.563659 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe109c-5bb1-4cf4-b90f-c48c2b771be8 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:00.617175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbc94e-9e00-43ca-b10e-ed59b058bc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:00.618260 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbc94e-9e00-43ca-b10e-ed59b058bc29 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:00.618694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbc94e-9e00-43ca-b10e-ed59b058bc29 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:00.618976 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbc94e-9e00-43ca-b10e-ed59b058bc29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:00.634579 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbc94e-9e00-43ca-b10e-ed59b058bc29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:00.635441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3ea94-95f9-4c7a-b6f3-3c2491ff5aa2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:00.637304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbc94e-9e00-43ca-b10e-ed59b058bc29 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:00.664725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-58fbc94e-9e00-43ca-b10e-ed59b058bc29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:00.664725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:00.664725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:00.664725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:00.664725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:00.664725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:00.664725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:00.664725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:00.664725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:00.664725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:00.664725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:00.664725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:00.664725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:00.664725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:00.664725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:00.664725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:00.665911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:00.665911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:00.665911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:00.665911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:00.665911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:00.665911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:00.665911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:00.665911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:00.665911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:00.665911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:00.665911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:00.665911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:00.665911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:00.665911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:00.665911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:00.665911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:00.665911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:00.666956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:00.666956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:00.666956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:00.667181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 286/586] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:00.668590 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbc94e-9e00-43ca-b10e-ed59b058bc29 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:00.678273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d72cc-3f9c-4bd3-99af-e3dd87e67de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:00.679145 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d72cc-3f9c-4bd3-99af-e3dd87e67de3 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:00.679590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d72cc-3f9c-4bd3-99af-e3dd87e67de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:00.680002 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d72cc-3f9c-4bd3-99af-e3dd87e67de3 None admin] PATH_INFO: `/v3/projects/03ca2c70c46a477494884c9997540861/users/9c95d16fd4da4fa7987b893eae0b3ef5/roles/8352f2960aa74837804150f4c8774dbc` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:00.696049 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d72cc-3f9c-4bd3-99af-e3dd87e67de3 None admin] RBAC: Authorizing `identity:create_grant(project_id=03ca2c70c46a477494884c9997540861, user_id=9c95d16fd4da4fa7987b893eae0b3ef5, role_id=8352f2960aa74837804150f4c8774dbc)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:00.697821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d72cc-3f9c-4bd3-99af-e3dd87e67de3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:00.714042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 301/587] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:18:00 2022] PUT /identity/v3/projects/03ca2c70c46a477494884c9997540861/users/9c95d16fd4da4fa7987b893eae0b3ef5/roles/8352f2960aa74837804150f4c8774dbc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:18:00.715111 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d72cc-3f9c-4bd3-99af-e3dd87e67de3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:00.774659 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:00.801155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:00.850652 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbc94e-9e00-43ca-b10e-ed59b058bc29 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:00.851802 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d72cc-3f9c-4bd3-99af-e3dd87e67de3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:00.896159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080a409-37e0-40f2-9501-8826353448a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:00.896887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080a409-37e0-40f2-9501-8826353448a1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:00.897258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080a409-37e0-40f2-9501-8826353448a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:00.897567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080a409-37e0-40f2-9501-8826353448a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:00.898222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080a409-37e0-40f2-9501-8826353448a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:00.898527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080a409-37e0-40f2-9501-8826353448a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:00.899287 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76752ba2-f6ef-43c6-9e53-ac694e5d8c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:00.899909 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080a409-37e0-40f2-9501-8826353448a1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:00.900241 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76752ba2-f6ef-43c6-9e53-ac694e5d8c0b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:00.900671 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76752ba2-f6ef-43c6-9e53-ac694e5d8c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:00.901088 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76752ba2-f6ef-43c6-9e53-ac694e5d8c0b None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:00.901908 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76752ba2-f6ef-43c6-9e53-ac694e5d8c0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:00.902350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76752ba2-f6ef-43c6-9e53-ac694e5d8c0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:00.903890 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76752ba2-f6ef-43c6-9e53-ac694e5d8c0b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:00.915084 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 302/588] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:00.915729 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080a409-37e0-40f2-9501-8826353448a1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:00.923769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 287/589] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:00.924691 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76752ba2-f6ef-43c6-9e53-ac694e5d8c0b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:01.035043 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080a409-37e0-40f2-9501-8826353448a1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:01.036751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:01.066305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76752ba2-f6ef-43c6-9e53-ac694e5d8c0b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:01.076492 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a1765-441a-4481-8e82-41d1c8770a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:01.077166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a1765-441a-4481-8e82-41d1c8770a34 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:01.077511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a1765-441a-4481-8e82-41d1c8770a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:01.077917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a1765-441a-4481-8e82-41d1c8770a34 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:01.078579 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a1765-441a-4481-8e82-41d1c8770a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:01.078875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a1765-441a-4481-8e82-41d1c8770a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:01.080351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a1765-441a-4481-8e82-41d1c8770a34 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:01.094545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 303/590] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:01.095407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a1765-441a-4481-8e82-41d1c8770a34 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:01.111801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:01.120639 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f039c82-b888-45bc-b775-45b77647595c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:01.122114 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f039c82-b888-45bc-b775-45b77647595c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:01.122624 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f039c82-b888-45bc-b775-45b77647595c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:01.126524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f039c82-b888-45bc-b775-45b77647595c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:01.135159 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f039c82-b888-45bc-b775-45b77647595c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:01.136963 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f039c82-b888-45bc-b775-45b77647595c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:01.152831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-5f039c82-b888-45bc-b775-45b77647595c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:01.152831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:01.152831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:01.152831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:01.152831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:01.152831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:01.152831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:01.152831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:01.152831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:01.152831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:01.152831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:01.152831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:01.152831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:01.152831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:01.152831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:01.153997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:01.153997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:01.153997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:01.153997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:01.153997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:01.153997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:01.153997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:01.153997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:01.153997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:01.153997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:01.153997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:01.153997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:01.153997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:01.153997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:01.153997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:01.153997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:01.153997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:01.155038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:01.155038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:01.155038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:01.155038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:01.155038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:01.155038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:01.155038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:01.155038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:01.162379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 288/591] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:01.162379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f039c82-b888-45bc-b775-45b77647595c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:01.228642 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a1765-441a-4481-8e82-41d1c8770a34 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:01.266049 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce18a1-c1ff-4b5a-81be-cff60c9888a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:01.266717 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce18a1-c1ff-4b5a-81be-cff60c9888a5 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:01.266995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce18a1-c1ff-4b5a-81be-cff60c9888a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:01.267267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce18a1-c1ff-4b5a-81be-cff60c9888a5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:01.275602 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce18a1-c1ff-4b5a-81be-cff60c9888a5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:01.277076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce18a1-c1ff-4b5a-81be-cff60c9888a5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:01.290693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-23ce18a1-c1ff-4b5a-81be-cff60c9888a5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:18:01.290693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:01.290693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:01.290693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:01.290693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:01.290693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:01.290693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:01.290693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:01.290693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:01.290693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:01.290693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:01.290693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:01.290693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:01.290693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:01.290693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:01.290693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:01.291662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:01.292993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:01.292993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:01.292993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:01.292993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:01.292993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:01.292993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:01.292993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:01.292993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:01.292993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:18:01.292993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:01.292993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 304/592] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:18:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:01.292993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce18a1-c1ff-4b5a-81be-cff60c9888a5 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:01.305573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f039c82-b888-45bc-b775-45b77647595c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:01.340338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:01.352984 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c749c4b-a098-4e01-b5b5-dce41ef72108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:01.353666 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c749c4b-a098-4e01-b5b5-dce41ef72108 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:01.353953 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c749c4b-a098-4e01-b5b5-dce41ef72108 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:01.354225 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c749c4b-a098-4e01-b5b5-dce41ef72108 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:01.363808 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c749c4b-a098-4e01-b5b5-dce41ef72108 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:01.365939 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c749c4b-a098-4e01-b5b5-dce41ef72108 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:01.380542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-9c749c4b-a098-4e01-b5b5-dce41ef72108 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:18:01.380542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:01.380542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:01.380542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:01.380542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:01.380542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:01.380542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:01.380542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:01.380542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:01.380542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:01.380542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:01.380542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:01.380542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:01.380542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:01.380542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:01.380542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:01.381575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:01.382510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:01.382510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:01.382510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:01.382510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:01.382510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:01.382510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:01.382510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:01.382510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:01.382510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:18:01.382510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:01.389539 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 289/593] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:18:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:01.390780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c749c4b-a098-4e01-b5b5-dce41ef72108 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:01.434825 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce18a1-c1ff-4b5a-81be-cff60c9888a5 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:01.448860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:01.489333 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1524002-c2c3-4921-b42e-b1300796f727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:01.490631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1524002-c2c3-4921-b42e-b1300796f727 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:01.491342 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1524002-c2c3-4921-b42e-b1300796f727 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:01.491829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1524002-c2c3-4921-b42e-b1300796f727 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:01.492802 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1524002-c2c3-4921-b42e-b1300796f727 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:01.493107 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1524002-c2c3-4921-b42e-b1300796f727 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:01.494596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1524002-c2c3-4921-b42e-b1300796f727 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:01.508209 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c749c4b-a098-4e01-b5b5-dce41ef72108 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:01.513487 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 305/594] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:01.513487 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1524002-c2c3-4921-b42e-b1300796f727 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:01.549807 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb00f6-3fb0-465b-bf20-d29cdd30c205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:01.550816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb00f6-3fb0-465b-bf20-d29cdd30c205 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:01.551294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb00f6-3fb0-465b-bf20-d29cdd30c205 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:01.551766 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb00f6-3fb0-465b-bf20-d29cdd30c205 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:01.552694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb00f6-3fb0-465b-bf20-d29cdd30c205 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:01.553222 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb00f6-3fb0-465b-bf20-d29cdd30c205 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:01.554910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb00f6-3fb0-465b-bf20-d29cdd30c205 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:01.578634 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 290/595] 10.222.0.52 () {56 vars in 1139 bytes} [Mon Aug 29 20:18:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:01.580708 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb00f6-3fb0-465b-bf20-d29cdd30c205 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:01.603906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:01.626148 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1524002-c2c3-4921-b42e-b1300796f727 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:01.666662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf727f-1176-493a-853a-7b3e51b926a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:01.667637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf727f-1176-493a-853a-7b3e51b926a0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:01.668179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf727f-1176-493a-853a-7b3e51b926a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:01.668868 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf727f-1176-493a-853a-7b3e51b926a0 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:01.670188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf727f-1176-493a-853a-7b3e51b926a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:01.670904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf727f-1176-493a-853a-7b3e51b926a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:01.672729 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf727f-1176-493a-853a-7b3e51b926a0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:01.689634 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb00f6-3fb0-465b-bf20-d29cdd30c205 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:01.694161 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 306/596] 10.222.0.52 () {56 vars in 1137 bytes} [Mon Aug 29 20:18:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:01.694161 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf727f-1176-493a-853a-7b3e51b926a0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:01.716595 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:01.751356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520d548-731f-4218-b1a1-7c3992aa4a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:01.752605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520d548-731f-4218-b1a1-7c3992aa4a68 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:01.752883 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520d548-731f-4218-b1a1-7c3992aa4a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:01.753456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520d548-731f-4218-b1a1-7c3992aa4a68 None admin] PATH_INFO: `/v3/projects/03ca2c70c46a477494884c9997540861/users/960a2be5cb58461fb9fb8e99094398d6/roles/8352f2960aa74837804150f4c8774dbc` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:01.772175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520d548-731f-4218-b1a1-7c3992aa4a68 None admin] RBAC: Authorizing `identity:create_grant(project_id=03ca2c70c46a477494884c9997540861, user_id=960a2be5cb58461fb9fb8e99094398d6, role_id=8352f2960aa74837804150f4c8774dbc)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:01.773678 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520d548-731f-4218-b1a1-7c3992aa4a68 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:01.793808 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 291/597] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:18:01 2022] PUT /identity/v3/projects/03ca2c70c46a477494884c9997540861/users/960a2be5cb58461fb9fb8e99094398d6/roles/8352f2960aa74837804150f4c8774dbc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:18:01.795007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520d548-731f-4218-b1a1-7c3992aa4a68 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:01.812820 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf727f-1176-493a-853a-7b3e51b926a0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:01.853768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b9728-39f8-4a18-b1a2-3db96235311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:01.854579 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b9728-39f8-4a18-b1a2-3db96235311b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:01.854792 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b9728-39f8-4a18-b1a2-3db96235311b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:01.855108 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b9728-39f8-4a18-b1a2-3db96235311b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:01.864865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:01.869148 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b9728-39f8-4a18-b1a2-3db96235311b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:01.870781 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b9728-39f8-4a18-b1a2-3db96235311b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:01.889673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-812b9728-39f8-4a18-b1a2-3db96235311b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:01.889673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:01.889673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:01.889673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:01.889673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:01.889673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:01.889673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:01.889673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:01.889673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:01.889673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:01.889673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:01.889673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:01.889673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:01.889673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:01.889673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:01.889673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:01.890699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:01.890699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:01.890699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:01.890699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:01.890699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:01.890699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:01.890699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:01.890699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:01.890699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:01.890699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:01.890699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:01.890699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:01.890699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:01.890699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:01.890699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:01.890699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:01.890699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:01.892710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:01.892710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:01.892710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:01.892710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 307/598] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:01.897077 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b9728-39f8-4a18-b1a2-3db96235311b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:01.921180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520d548-731f-4218-b1a1-7c3992aa4a68 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:01.975007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c606d-7167-4839-84c4-25aee3275e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:01.975664 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c606d-7167-4839-84c4-25aee3275e9c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:01.975944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c606d-7167-4839-84c4-25aee3275e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:01.976218 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c606d-7167-4839-84c4-25aee3275e9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:01.988484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c606d-7167-4839-84c4-25aee3275e9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:01.990306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c606d-7167-4839-84c4-25aee3275e9c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:02.006698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-497c606d-7167-4839-84c4-25aee3275e9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:02.006698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:02.006698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:02.006698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:02.006698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:02.006698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:02.006698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:02.006698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:02.006698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:02.006698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:02.006698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:02.006698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:02.006698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:02.006698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:02.006698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:02.006698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:02.008643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:02.008643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:02.008643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:02.008643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:02.008643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:02.008643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:02.008643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:02.008643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:02.008643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:02.008643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:02.008643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:02.008643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:02.008643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:02.008643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:02.008643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:02.008643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:02.008643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:02.009765 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:02.009765 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:02.009765 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:02.009765 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 292/599] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:02.015600 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b9728-39f8-4a18-b1a2-3db96235311b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:02.020923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c606d-7167-4839-84c4-25aee3275e9c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:02.049822 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:02.055745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd605222-ee29-4c12-b6cb-a3f360aa3958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:02.056766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd605222-ee29-4c12-b6cb-a3f360aa3958 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:02.057450 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd605222-ee29-4c12-b6cb-a3f360aa3958 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:02.057894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd605222-ee29-4c12-b6cb-a3f360aa3958 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:02.059000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd605222-ee29-4c12-b6cb-a3f360aa3958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:02.059540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd605222-ee29-4c12-b6cb-a3f360aa3958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:02.062116 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd605222-ee29-4c12-b6cb-a3f360aa3958 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:02.084730 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 308/600] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:02.094929 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd605222-ee29-4c12-b6cb-a3f360aa3958 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:02.186297 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:02.194592 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c606d-7167-4839-84c4-25aee3275e9c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:02.253186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facec4b3-79d4-4fc8-8d01-04d2bfca5a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:02.254177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facec4b3-79d4-4fc8-8d01-04d2bfca5a1c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:02.254622 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facec4b3-79d4-4fc8-8d01-04d2bfca5a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:02.255069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facec4b3-79d4-4fc8-8d01-04d2bfca5a1c None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:02.256149 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facec4b3-79d4-4fc8-8d01-04d2bfca5a1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:02.256670 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facec4b3-79d4-4fc8-8d01-04d2bfca5a1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:02.259090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facec4b3-79d4-4fc8-8d01-04d2bfca5a1c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:02.269051 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd605222-ee29-4c12-b6cb-a3f360aa3958 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:02.280227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 293/601] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:02.285851 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facec4b3-79d4-4fc8-8d01-04d2bfca5a1c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:02.329141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd8d10-860b-4ddc-bf23-976a7dd3695e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:02.330337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd8d10-860b-4ddc-bf23-976a7dd3695e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:02.330825 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd8d10-860b-4ddc-bf23-976a7dd3695e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:02.331286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd8d10-860b-4ddc-bf23-976a7dd3695e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:02.353142 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd8d10-860b-4ddc-bf23-976a7dd3695e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:02.355865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd8d10-860b-4ddc-bf23-976a7dd3695e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:02.377869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-2ffd8d10-860b-4ddc-bf23-976a7dd3695e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:02.377869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:02.377869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:02.377869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:02.377869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:02.377869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:02.377869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:02.377869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:02.377869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:02.377869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:02.377869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:02.377869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:02.377869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:02.377869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:02.377869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:02.378886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:02.378886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:02.378886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:02.378886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:02.378886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:02.378886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:02.378886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:02.378886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:02.378886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:02.378886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:02.378886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:02.378886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:02.378886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:02.378886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:02.378886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:02.378886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:02.378886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:02.379838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:02.379838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:02.379838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:02.379838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:02.379838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:02.379838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:02.379838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:02.379838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:02.380785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 309/602] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:02.389094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd8d10-860b-4ddc-bf23-976a7dd3695e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:02.449798 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:02.491683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facec4b3-79d4-4fc8-8d01-04d2bfca5a1c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:02.528280 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec12f0-c5a8-4aae-a33a-be1741251f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:02.529454 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec12f0-c5a8-4aae-a33a-be1741251f32 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:02.529929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec12f0-c5a8-4aae-a33a-be1741251f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:02.530410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec12f0-c5a8-4aae-a33a-be1741251f32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:02.538075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec12f0-c5a8-4aae-a33a-be1741251f32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:02.540061 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec12f0-c5a8-4aae-a33a-be1741251f32 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:02.552613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-4cec12f0-c5a8-4aae-a33a-be1741251f32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:02.552613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:02.552613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:02.552613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:02.552613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:02.552613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:02.552613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:02.552613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:02.552613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:02.552613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:02.552613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:02.552613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:02.552613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:02.552613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:02.552613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:02.553839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:02.553839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:02.553839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:02.553839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:02.553839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:02.553839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:02.553839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:02.553839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:02.553839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:02.553839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:02.553839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:02.553839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:02.553839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:02.553839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:02.553839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:02.553839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:02.553839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:02.554769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:02.554769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:02.554769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:02.554769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:02.554769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:02.554769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:02.554769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:02.554769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:02.561670 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 294/603] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:02.563362 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a6bd6-33c1-4f1d-8e7c-94f9ec43381f None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:02.563864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a6bd6-33c1-4f1d-8e7c-94f9ec43381f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:02.564326 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a6bd6-33c1-4f1d-8e7c-94f9ec43381f None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:02.565167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd8d10-860b-4ddc-bf23-976a7dd3695e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:02.570481 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 295/604] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:02.572102 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a6bd6-33c1-4f1d-8e7c-94f9ec43381f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:02.590334 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:02.628117 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ce7e8-ed08-4a6a-ba72-37a1286ed5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:02.629084 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ce7e8-ed08-4a6a-ba72-37a1286ed5bb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:02.629646 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ce7e8-ed08-4a6a-ba72-37a1286ed5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:02.630113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ce7e8-ed08-4a6a-ba72-37a1286ed5bb None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:02.631360 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ce7e8-ed08-4a6a-ba72-37a1286ed5bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:02.631956 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ce7e8-ed08-4a6a-ba72-37a1286ed5bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:02.634609 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ce7e8-ed08-4a6a-ba72-37a1286ed5bb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:02.665399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 310/605] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:02.667743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bc2f8-00df-4606-97a2-d66d374d00b3 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:02.668209 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bc2f8-00df-4606-97a2-d66d374d00b3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:02.668674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bc2f8-00df-4606-97a2-d66d374d00b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:02.690401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a6bd6-33c1-4f1d-8e7c-94f9ec43381f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:02.698776 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d01bc2f8-00df-4606-97a2-d66d374d00b3 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:02.700650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d01bc2f8-00df-4606-97a2-d66d374d00b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:02.732501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693393f-53aa-4f02-a22b-6be81616dee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:02.733485 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693393f-53aa-4f02-a22b-6be81616dee2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:02.733964 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693393f-53aa-4f02-a22b-6be81616dee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:02.734410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693393f-53aa-4f02-a22b-6be81616dee2 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:02.735278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693393f-53aa-4f02-a22b-6be81616dee2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:02.735771 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693393f-53aa-4f02-a22b-6be81616dee2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:02.737560 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693393f-53aa-4f02-a22b-6be81616dee2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:02.751147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 296/606] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:02.751462 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:02.752471 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693393f-53aa-4f02-a22b-6be81616dee2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:02.822740 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 311/607] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:18:02.822740 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bc2f8-00df-4606-97a2-d66d374d00b3 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:02.901604 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693393f-53aa-4f02-a22b-6be81616dee2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:02.979060 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f245778-db26-490c-8664-5523792356d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:02.979827 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f245778-db26-490c-8664-5523792356d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:02.979944 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bc2f8-00df-4606-97a2-d66d374d00b3 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:02.980303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f245778-db26-490c-8664-5523792356d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:02.980380 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f245778-db26-490c-8664-5523792356d8 None admin] PATH_INFO: `/v3/projects/03ca2c70c46a477494884c9997540861/users/382b0ee3bd634cc8800f1769c91b7a8a/roles/8352f2960aa74837804150f4c8774dbc` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:02.981672 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:03.001651 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f245778-db26-490c-8664-5523792356d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=03ca2c70c46a477494884c9997540861, user_id=382b0ee3bd634cc8800f1769c91b7a8a, role_id=8352f2960aa74837804150f4c8774dbc)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:03.003420 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f245778-db26-490c-8664-5523792356d8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:03.022622 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 297/608] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:18:02 2022] PUT /identity/v3/projects/03ca2c70c46a477494884c9997540861/users/382b0ee3bd634cc8800f1769c91b7a8a/roles/8352f2960aa74837804150f4c8774dbc => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:18:03.024051 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12be0d-ae64-4303-a0a5-690a721e3a8e None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:03.024335 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12be0d-ae64-4303-a0a5-690a721e3a8e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:03.024667 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12be0d-ae64-4303-a0a5-690a721e3a8e None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:03.030868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 298/609] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:03.032726 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9caa7-235f-4b36-8972-c8ce74470f7f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:03.033119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9caa7-235f-4b36-8972-c8ce74470f7f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:03.033499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9caa7-235f-4b36-8972-c8ce74470f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:03.038144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ca29f-7b46-4dd2-8f7e-d2d3bec6b4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:03.039125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ca29f-7b46-4dd2-8f7e-d2d3bec6b4e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:03.039409 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ca29f-7b46-4dd2-8f7e-d2d3bec6b4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:03.039807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ca29f-7b46-4dd2-8f7e-d2d3bec6b4e9 None admin] PATH_INFO: `/v3/projects/03ca2c70c46a477494884c9997540861/users/47429aec6d8a4339b4ec0fb32b25e90b/roles/8352f2960aa74837804150f4c8774dbc` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:03.067709 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-02f9caa7-235f-4b36-8972-c8ce74470f7f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:03.070773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-02f9caa7-235f-4b36-8972-c8ce74470f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:03.082369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ca29f-7b46-4dd2-8f7e-d2d3bec6b4e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=03ca2c70c46a477494884c9997540861, user_id=47429aec6d8a4339b4ec0fb32b25e90b, role_id=8352f2960aa74837804150f4c8774dbc)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:03.084365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ca29f-7b46-4dd2-8f7e-d2d3bec6b4e9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:03.112153 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 312/610] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:18:02 2022] PUT /identity/v3/projects/03ca2c70c46a477494884c9997540861/users/47429aec6d8a4339b4ec0fb32b25e90b/roles/8352f2960aa74837804150f4c8774dbc => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:18:03.158624 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:03.168233 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ca29f-7b46-4dd2-8f7e-d2d3bec6b4e9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:03.231118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 299/611] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:18:03.318850 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ca29f-7b46-4dd2-8f7e-d2d3bec6b4e9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:03.357871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2e536-6b03-435d-8273-561cb2db231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:03.358577 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2e536-6b03-435d-8273-561cb2db231d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:03.358847 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2e536-6b03-435d-8273-561cb2db231d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:03.359116 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2e536-6b03-435d-8273-561cb2db231d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:03.371672 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2e536-6b03-435d-8273-561cb2db231d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:03.376566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-0be2e536-6b03-435d-8273-561cb2db231d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:03.376566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:03.376566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:03.376566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:03.376566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:03.376566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:03.376566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:03.376566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:03.376566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:03.376566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:03.376566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:03.376566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:03.376566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:03.376566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:03.376566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:03.376566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:03.377545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:03.377545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:03.377545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:03.377545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:03.377545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:03.377545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:03.377545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:03.377545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:03.377545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:03.377545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:03.377545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:03.377545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:03.377545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:03.377545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:03.377545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:03.377545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:03.378453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:03.378453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:03.378453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:03.378453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:03.378453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:03.378453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:03.378453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:03.378453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:03.378453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:03.378453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:03.378453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:03.378453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:03.378453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 313/612] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:18:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:03.383990 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9caa7-235f-4b36-8972-c8ce74470f7f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:03.495785 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9caa7-235f-4b36-8972-c8ce74470f7f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:03.554120 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845cb87-8af6-4dec-8a78-c816840959c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:03.554754 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845cb87-8af6-4dec-8a78-c816840959c6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:03.555037 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845cb87-8af6-4dec-8a78-c816840959c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:03.555304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845cb87-8af6-4dec-8a78-c816840959c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:03.555992 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845cb87-8af6-4dec-8a78-c816840959c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:03.556295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845cb87-8af6-4dec-8a78-c816840959c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:03.557710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845cb87-8af6-4dec-8a78-c816840959c6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:03.560238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2e536-6b03-435d-8273-561cb2db231d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:03.573285 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 300/613] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:18:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:03.582610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845cb87-8af6-4dec-8a78-c816840959c6 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:03.589727 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:03.639354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:03.719170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845cb87-8af6-4dec-8a78-c816840959c6 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:03.767588 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601d573-89f9-4c41-be6f-39389d9b0216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:03.770991 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601d573-89f9-4c41-be6f-39389d9b0216 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:03.771325 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601d573-89f9-4c41-be6f-39389d9b0216 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:03.771607 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601d573-89f9-4c41-be6f-39389d9b0216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:03.796287 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601d573-89f9-4c41-be6f-39389d9b0216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:03.798346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601d573-89f9-4c41-be6f-39389d9b0216 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:03.809394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2e536-6b03-435d-8273-561cb2db231d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:03.824172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-4601d573-89f9-4c41-be6f-39389d9b0216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:03.824172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:03.824172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:03.824172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:03.824172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:03.824172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:03.824172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:03.824172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:03.824172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:03.824172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:03.824172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:03.824172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:03.824172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:03.824172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:03.824172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:03.824172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:03.825170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:03.825170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:03.825170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:03.825170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:03.825170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:03.825170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:03.825170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:03.825170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:03.825170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:03.825170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:03.825170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:03.825170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:03.825170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:03.825170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:03.825170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:03.825170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:03.825170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:03.826283 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:03.826283 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:03.826283 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:03.828616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 301/614] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:03.834413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601d573-89f9-4c41-be6f-39389d9b0216 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:03.877850 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525716ad-9f40-4bda-830a-698887c4a951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:03.879083 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525716ad-9f40-4bda-830a-698887c4a951 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:03.879648 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525716ad-9f40-4bda-830a-698887c4a951 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:03.880156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525716ad-9f40-4bda-830a-698887c4a951 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:03.903584 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525716ad-9f40-4bda-830a-698887c4a951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:03.910198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-525716ad-9f40-4bda-830a-698887c4a951 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:03.910198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:03.910198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:03.910198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:03.910198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:03.910198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:03.910198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:03.910198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:03.910198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:03.910198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:03.910198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:03.910198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:03.910198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:03.910198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:03.910198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:03.910198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:03.911163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:03.911163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:03.911163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:03.911163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:03.911163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:03.911163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:03.911163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:03.911163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:03.911163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:03.911163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:03.911163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:03.911163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:03.911163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:03.911163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:03.911163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:03.911163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:03.912162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:03.912162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:03.912162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:03.912162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:03.912162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:03.912162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:03.912162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:03.912162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:03.912162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:03.912162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:03.912162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:03.912162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:03.915535 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 314/615] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:18:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:03.926971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525716ad-9f40-4bda-830a-698887c4a951 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:04.018330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:04.049814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601d573-89f9-4c41-be6f-39389d9b0216 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:04.076768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:04.112807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525716ad-9f40-4bda-830a-698887c4a951 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:04.149281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c26a8-b309-48d6-bc79-47fe1a28bc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:04.150651 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c26a8-b309-48d6-bc79-47fe1a28bc93 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:04.151610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c26a8-b309-48d6-bc79-47fe1a28bc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:04.152518 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c26a8-b309-48d6-bc79-47fe1a28bc93 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:04.153939 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c26a8-b309-48d6-bc79-47fe1a28bc93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:04.154799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c26a8-b309-48d6-bc79-47fe1a28bc93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:04.156338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b8a08-d9f7-40fd-9f19-4be329f03c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:04.157201 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8a08-d9f7-40fd-9f19-4be329f03c10 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:04.158700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c26a8-b309-48d6-bc79-47fe1a28bc93 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:04.159242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8a08-d9f7-40fd-9f19-4be329f03c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:04.159702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8a08-d9f7-40fd-9f19-4be329f03c10 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:04.160570 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b8a08-d9f7-40fd-9f19-4be329f03c10 None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:04.162784 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b8a08-d9f7-40fd-9f19-4be329f03c10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:04.164579 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b8a08-d9f7-40fd-9f19-4be329f03c10 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:04.182887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 315/616] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:18:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:04.187490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 302/617] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:04.188707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b8a08-d9f7-40fd-9f19-4be329f03c10 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:04.190571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c26a8-b309-48d6-bc79-47fe1a28bc93 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:04.374663 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b8a08-d9f7-40fd-9f19-4be329f03c10 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:04.384621 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c26a8-b309-48d6-bc79-47fe1a28bc93 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:04.438375 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601552b-8839-43d7-ad61-aee444aec1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:04.439024 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601552b-8839-43d7-ad61-aee444aec1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:04.439298 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601552b-8839-43d7-ad61-aee444aec1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:04.439564 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601552b-8839-43d7-ad61-aee444aec1d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:04.443015 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:04.450671 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d855d-ba25-43ef-8b92-afe013e82446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:04.451395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d855d-ba25-43ef-8b92-afe013e82446 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:04.451675 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d855d-ba25-43ef-8b92-afe013e82446 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:04.451951 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d855d-ba25-43ef-8b92-afe013e82446 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:04.454785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601552b-8839-43d7-ad61-aee444aec1d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:04.456534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601552b-8839-43d7-ad61-aee444aec1d0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:04.463379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d855d-ba25-43ef-8b92-afe013e82446 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:04.463379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d855d-ba25-43ef-8b92-afe013e82446 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:04.481998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-6601552b-8839-43d7-ad61-aee444aec1d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:04.481998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:04.481998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:04.481998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:04.481998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:04.481998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:04.481998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:04.481998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:04.481998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:04.481998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:04.481998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:04.481998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:04.481998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:04.481998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:04.481998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:04.481998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:04.483141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:04.483141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:04.483141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:04.483141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:04.483141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:04.483141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:04.483141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:04.483141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:04.483141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:04.483141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:04.483141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:04.483141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:04.483141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:04.483141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:04.483141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:04.483141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:04.483141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:04.484100 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:04.484100 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:04.484100 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:04.484302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-507d855d-ba25-43ef-8b92-afe013e82446 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:18:04.484302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:04.484302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:04.484302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:04.484302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:04.484302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:04.484302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:04.484302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:04.484302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:04.484302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:04.484302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:04.484302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:04.484302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:04.484302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:04.484302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:04.484302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:04.485302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:04.486295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:04.486295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:04.486295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:04.486295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:04.486295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:04.486295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:04.486295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:04.486295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:04.486295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:18:04.486295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:04.491399 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 303/618] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:18:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:04.493118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 316/619] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:04.493236 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d855d-ba25-43ef-8b92-afe013e82446 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:04.498269 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:04.500582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601552b-8839-43d7-ad61-aee444aec1d0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:04.619859 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601552b-8839-43d7-ad61-aee444aec1d0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:04.639815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d855d-ba25-43ef-8b92-afe013e82446 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:04.658578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153951e3-412a-4174-8c36-471de3524987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:04.659180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153951e3-412a-4174-8c36-471de3524987 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:04.659459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153951e3-412a-4174-8c36-471de3524987 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:04.659729 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153951e3-412a-4174-8c36-471de3524987 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:04.660376 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153951e3-412a-4174-8c36-471de3524987 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:04.660676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153951e3-412a-4174-8c36-471de3524987 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:04.662107 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153951e3-412a-4174-8c36-471de3524987 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:04.675562 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 317/620] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:04.676835 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26827f8-34e2-49b1-9673-dc65fbf08e7d None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:04.677119 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26827f8-34e2-49b1-9673-dc65fbf08e7d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:04.677409 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26827f8-34e2-49b1-9673-dc65fbf08e7d None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:04.682796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 318/621] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:04.683607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26827f8-34e2-49b1-9673-dc65fbf08e7d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:04.687190 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3f5c5-9ac9-47ec-8bfb-1f74439fbcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:04.689020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3f5c5-9ac9-47ec-8bfb-1f74439fbcbd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:04.689561 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3f5c5-9ac9-47ec-8bfb-1f74439fbcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:04.690032 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3f5c5-9ac9-47ec-8bfb-1f74439fbcbd None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:04.690989 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3f5c5-9ac9-47ec-8bfb-1f74439fbcbd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:04.691491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3f5c5-9ac9-47ec-8bfb-1f74439fbcbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:04.693828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3f5c5-9ac9-47ec-8bfb-1f74439fbcbd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:04.724396 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 304/622] 10.222.0.52 () {56 vars in 1135 bytes} [Mon Aug 29 20:18:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:04.726445 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c813e4-8f8c-4600-a5c9-d8cb0e60cbeb None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:04.727315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c813e4-8f8c-4600-a5c9-d8cb0e60cbeb None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:04.727315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c813e4-8f8c-4600-a5c9-d8cb0e60cbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:04.743681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:04.753740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-94c813e4-8f8c-4600-a5c9-d8cb0e60cbeb None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:04.756034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-94c813e4-8f8c-4600-a5c9-d8cb0e60cbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:04.819449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:04.822017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26827f8-34e2-49b1-9673-dc65fbf08e7d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:04.837678 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 305/623] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:18:04.838730 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c813e4-8f8c-4600-a5c9-d8cb0e60cbeb None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:04.866653 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65344b5c-f50a-450c-8cb1-4966e4dfb05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:04.867550 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65344b5c-f50a-450c-8cb1-4966e4dfb05d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:04.868001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65344b5c-f50a-450c-8cb1-4966e4dfb05d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:04.868439 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65344b5c-f50a-450c-8cb1-4966e4dfb05d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:04.878417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65344b5c-f50a-450c-8cb1-4966e4dfb05d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:04.880639 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65344b5c-f50a-450c-8cb1-4966e4dfb05d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:04.894731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-65344b5c-f50a-450c-8cb1-4966e4dfb05d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:18:04.894731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:04.894731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:04.894731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:04.894731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:04.894731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:04.894731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:04.894731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:04.894731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:04.894731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:04.894731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:04.894731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:04.894731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:04.894731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:04.894731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:04.894731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:04.895879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:04.896926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:04.896926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:04.896926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:04.896926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:04.896926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:04.896926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:04.896926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:04.896926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:04.896926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:18:04.896926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:04.899345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 319/624] 10.222.0.52 () {56 vars in 1093 bytes} [Mon Aug 29 20:18:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:04.906819 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65344b5c-f50a-450c-8cb1-4966e4dfb05d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:05.062933 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c813e4-8f8c-4600-a5c9-d8cb0e60cbeb None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:05.105785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65344b5c-f50a-450c-8cb1-4966e4dfb05d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:05.123422 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:05.134153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290de3b-ab15-4484-98bd-2c3a9eff0e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:05.135220 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290de3b-ab15-4484-98bd-2c3a9eff0e5c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:05.135494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290de3b-ab15-4484-98bd-2c3a9eff0e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:05.135766 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290de3b-ab15-4484-98bd-2c3a9eff0e5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:05.163491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290de3b-ab15-4484-98bd-2c3a9eff0e5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:05.165323 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290de3b-ab15-4484-98bd-2c3a9eff0e5c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:05.178122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23da339-aaa7-49f5-8215-b82c089e49e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:05.179089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23da339-aaa7-49f5-8215-b82c089e49e2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:05.179627 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23da339-aaa7-49f5-8215-b82c089e49e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:05.180142 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23da339-aaa7-49f5-8215-b82c089e49e2 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:05.181070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23da339-aaa7-49f5-8215-b82c089e49e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:05.181585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23da339-aaa7-49f5-8215-b82c089e49e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:05.183244 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23da339-aaa7-49f5-8215-b82c089e49e2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:05.188343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-7290de3b-ab15-4484-98bd-2c3a9eff0e5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:05.188343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:05.188343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:05.188343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:05.188343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:05.188343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:05.188343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:05.188343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:05.188343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:05.188343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:05.188343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:05.188343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:05.188343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:05.188343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:05.188343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:05.188343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:05.189304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:05.189304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:05.189304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:05.189304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:05.189304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:05.189304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:05.189304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:05.189304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:05.189304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:05.189304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:05.189304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:05.189304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:05.189304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:05.189304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:05.189304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:05.189304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:05.189304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:05.190247 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:05.190247 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:05.190247 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:05.190247 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 306/625] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:05.190872 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290de3b-ab15-4484-98bd-2c3a9eff0e5c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:05.207865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 320/626] 10.222.0.52 () {56 vars in 1133 bytes} [Mon Aug 29 20:18:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:05.209101 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23da339-aaa7-49f5-8215-b82c089e49e2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:05.260459 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:05.326016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23da339-aaa7-49f5-8215-b82c089e49e2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:05.339180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290de3b-ab15-4484-98bd-2c3a9eff0e5c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:05.374018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84c4a0-8043-40c2-b46f-afb8e904fe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:05.374585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84c4a0-8043-40c2-b46f-afb8e904fe80 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:05.374857 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84c4a0-8043-40c2-b46f-afb8e904fe80 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:05.375120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84c4a0-8043-40c2-b46f-afb8e904fe80 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:05.375760 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84c4a0-8043-40c2-b46f-afb8e904fe80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:05.376056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84c4a0-8043-40c2-b46f-afb8e904fe80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:05.377209 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba103652-4ab5-4057-8193-b900c5454a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:05.377482 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84c4a0-8043-40c2-b46f-afb8e904fe80 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:05.378271 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba103652-4ab5-4057-8193-b900c5454a8a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:05.378750 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba103652-4ab5-4057-8193-b900c5454a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:05.379372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba103652-4ab5-4057-8193-b900c5454a8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:05.389250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 321/627] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:05.390048 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84c4a0-8043-40c2-b46f-afb8e904fe80 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:05.393339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba103652-4ab5-4057-8193-b900c5454a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:05.400106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-ba103652-4ab5-4057-8193-b900c5454a8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:05.400106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:05.400106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:05.400106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:05.400106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:05.400106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:05.400106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:05.400106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:05.400106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:05.400106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:05.400106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:05.400106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:05.400106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:05.400106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:05.400106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:05.400106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:05.401143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:05.401143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:05.401143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:05.401143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:05.401143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:05.401143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:05.401143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:05.401143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:05.401143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:05.401143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:05.401143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:05.401143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:05.401143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:05.401143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:05.401143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:05.401143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:05.402215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:05.402215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:05.402215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:05.402215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:05.402215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:05.402215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:05.402215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:05.402215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:05.402215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:05.402215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:05.402215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:05.402215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:05.403595 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 307/628] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:18:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:05.405161 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61726f9e-d26a-469d-af1d-795f12b17573 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:05.405538 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61726f9e-d26a-469d-af1d-795f12b17573 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:05.406306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61726f9e-d26a-469d-af1d-795f12b17573 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:05.407317 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 308/629] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:05.408097 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61726f9e-d26a-469d-af1d-795f12b17573 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:05.430025 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:05.511564 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84c4a0-8043-40c2-b46f-afb8e904fe80 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:05.518988 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61726f9e-d26a-469d-af1d-795f12b17573 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:05.521345 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:05.544844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd146a-ad9d-49a8-8b45-3cb90b7f3128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:05.545406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd146a-ad9d-49a8-8b45-3cb90b7f3128 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:05.545682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd146a-ad9d-49a8-8b45-3cb90b7f3128 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:05.545971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd146a-ad9d-49a8-8b45-3cb90b7f3128 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:05.566047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd6fba-244a-48b1-8c42-b773cf5d3e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:05.566682 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd6fba-244a-48b1-8c42-b773cf5d3e6e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:05.566961 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd6fba-244a-48b1-8c42-b773cf5d3e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:05.567229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd6fba-244a-48b1-8c42-b773cf5d3e6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:05.574399 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd6fba-244a-48b1-8c42-b773cf5d3e6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:05.576284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd6fba-244a-48b1-8c42-b773cf5d3e6e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:05.587228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-e7fd6fba-244a-48b1-8c42-b773cf5d3e6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:05.587228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:05.587228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:05.587228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:05.587228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:05.587228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:05.587228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:05.587228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:05.587228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:05.587228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:05.587228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:05.587228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:05.587228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:05.587228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:05.587228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:05.588306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:05.588306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:05.588306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:05.588306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:05.588306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:05.588306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:05.588306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:05.588306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:05.588306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:05.588306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:05.588306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:05.588306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:05.588306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:05.588306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:05.588306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:05.588306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:05.588306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:05.589430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:05.589430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:05.589430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:05.589430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:05.589430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:05.589430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:05.589430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:05.589430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:05.593449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 309/630] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:05.594382 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd6fba-244a-48b1-8c42-b773cf5d3e6e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:05.618617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd146a-ad9d-49a8-8b45-3cb90b7f3128 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:05.620379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd146a-ad9d-49a8-8b45-3cb90b7f3128 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:05.646674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:05.707745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd6fba-244a-48b1-8c42-b773cf5d3e6e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:05.727137 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 322/631] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:18:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:05.728723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd54af5-eb90-4c6f-aad2-6fcbacd1abd5 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:05.729065 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd54af5-eb90-4c6f-aad2-6fcbacd1abd5 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:05.729334 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd54af5-eb90-4c6f-aad2-6fcbacd1abd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:05.747285 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e229d-a21f-4ad3-bd7e-d74d62777c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:05.747979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e229d-a21f-4ad3-bd7e-d74d62777c39 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:05.748268 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e229d-a21f-4ad3-bd7e-d74d62777c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:05.748543 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e229d-a21f-4ad3-bd7e-d74d62777c39 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:05.749059 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-fdd54af5-eb90-4c6f-aad2-6fcbacd1abd5 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:05.749208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e229d-a21f-4ad3-bd7e-d74d62777c39 None admin] RBAC: Adding query filter params (name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:05.749550 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e229d-a21f-4ad3-bd7e-d74d62777c39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:05.750600 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fdd54af5-eb90-4c6f-aad2-6fcbacd1abd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:05.750926 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e229d-a21f-4ad3-bd7e-d74d62777c39 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:05.759496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 310/632] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:18:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:05.760995 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2d2d8-3914-4826-b180-94f4ed705c12 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:05.760995 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2d2d8-3914-4826-b180-94f4ed705c12 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:05.761277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2d2d8-3914-4826-b180-94f4ed705c12 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:05.765413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 311/633] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:05.765413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2d2d8-3914-4826-b180-94f4ed705c12 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:05.793213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:05.829112 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 323/634] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:18:05.830805 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd54af5-eb90-4c6f-aad2-6fcbacd1abd5 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:05.875146 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2d2d8-3914-4826-b180-94f4ed705c12 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:05.898196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:05.912200 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee58554-4ef3-48f2-886e-86cc60423db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:05.912897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee58554-4ef3-48f2-886e-86cc60423db9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:05.913247 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee58554-4ef3-48f2-886e-86cc60423db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:05.913635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee58554-4ef3-48f2-886e-86cc60423db9 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:05.914394 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee58554-4ef3-48f2-886e-86cc60423db9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:05.914773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee58554-4ef3-48f2-886e-86cc60423db9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:05.916294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee58554-4ef3-48f2-886e-86cc60423db9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:05.931499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 312/635] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:05.932328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee58554-4ef3-48f2-886e-86cc60423db9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:05.957217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd54af5-eb90-4c6f-aad2-6fcbacd1abd5 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:06.013894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114dd64-9f32-4aca-a89c-ec5e99b93882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:06.015458 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114dd64-9f32-4aca-a89c-ec5e99b93882 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:06.016225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114dd64-9f32-4aca-a89c-ec5e99b93882 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:06.016697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114dd64-9f32-4aca-a89c-ec5e99b93882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:06.033735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:06.040586 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114dd64-9f32-4aca-a89c-ec5e99b93882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:06.042935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114dd64-9f32-4aca-a89c-ec5e99b93882 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:06.055158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee58554-4ef3-48f2-886e-86cc60423db9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:06.060120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-2114dd64-9f32-4aca-a89c-ec5e99b93882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:06.060120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:06.060120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:06.060120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:06.060120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:06.060120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:06.060120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:06.060120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:06.060120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:06.060120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:06.060120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:06.060120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:06.060120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:06.060120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:06.060120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:06.060120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:06.061078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:06.061078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:06.061078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:06.061078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:06.061078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:06.061078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:06.061078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:06.061078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:06.061078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:06.061078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:06.061078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:06.061078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:06.061078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:06.061078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:06.061078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:06.061078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:06.061078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:06.062417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:06.062417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:06.062417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:06.066361 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 324/636] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:06.067612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42e6b7-6308-488c-af35-734e6d6096d1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:06.067895 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42e6b7-6308-488c-af35-734e6d6096d1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:06.068161 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42e6b7-6308-488c-af35-734e6d6096d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:06.087640 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-fc42e6b7-6308-488c-af35-734e6d6096d1 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:06.088848 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fc42e6b7-6308-488c-af35-734e6d6096d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:06.095720 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781066d-ecce-4faa-a722-6b30c62cbb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:06.096770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781066d-ecce-4faa-a722-6b30c62cbb3b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:06.097124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781066d-ecce-4faa-a722-6b30c62cbb3b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:06.097560 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781066d-ecce-4faa-a722-6b30c62cbb3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:06.109117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781066d-ecce-4faa-a722-6b30c62cbb3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:06.111174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781066d-ecce-4faa-a722-6b30c62cbb3b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:06.128016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-5781066d-ecce-4faa-a722-6b30c62cbb3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:06.128016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:06.128016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:06.128016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:06.128016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:06.128016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:06.128016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:06.128016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:06.128016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:06.128016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:06.128016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:06.128016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:06.128016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:06.128016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:06.128016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:06.128016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:06.129100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:06.129100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:06.129100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:06.129100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:06.129100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:06.129100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:06.129100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:06.129100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:06.129100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:06.129100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:06.129100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:06.129100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:06.129100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:06.129100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:06.129100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:06.129100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:06.129100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:06.130264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:06.130264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:06.130264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:06.130264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 313/637] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:06.130264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781066d-ecce-4faa-a722-6b30c62cbb3b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:06.166150 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 325/638] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:18:06.166954 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42e6b7-6308-488c-af35-734e6d6096d1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:06.214554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:06.250109 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781066d-ecce-4faa-a722-6b30c62cbb3b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:06.289548 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42e6b7-6308-488c-af35-734e6d6096d1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:06.289849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075ac8c-e86b-49e3-b2ac-78906bb9eeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:06.290676 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ac8c-e86b-49e3-b2ac-78906bb9eeb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:06.291141 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ac8c-e86b-49e3-b2ac-78906bb9eeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:06.291415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ac8c-e86b-49e3-b2ac-78906bb9eeb2 None admin] PATH_INFO: `/v3/projects/03ca2c70c46a477494884c9997540861/users/dcb9791ea73d46b191ad9fc146297565/roles/8352f2960aa74837804150f4c8774dbc` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:06.301101 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:06.309382 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075ac8c-e86b-49e3-b2ac-78906bb9eeb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=03ca2c70c46a477494884c9997540861, user_id=dcb9791ea73d46b191ad9fc146297565, role_id=8352f2960aa74837804150f4c8774dbc)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:06.311080 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075ac8c-e86b-49e3-b2ac-78906bb9eeb2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:06.325208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 314/639] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:18:06 2022] PUT /identity/v3/projects/03ca2c70c46a477494884c9997540861/users/dcb9791ea73d46b191ad9fc146297565/roles/8352f2960aa74837804150f4c8774dbc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:18:06.326028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075ac8c-e86b-49e3-b2ac-78906bb9eeb2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:06.339669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b103513-b11f-433b-93de-3806c9625413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:06.340294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b103513-b11f-433b-93de-3806c9625413 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:06.340623 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b103513-b11f-433b-93de-3806c9625413 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:06.340829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b103513-b11f-433b-93de-3806c9625413 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:06.341681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b103513-b11f-433b-93de-3806c9625413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:06.342301 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b103513-b11f-433b-93de-3806c9625413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:06.343682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b103513-b11f-433b-93de-3806c9625413 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:06.381158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 326/640] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:06.382715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b103513-b11f-433b-93de-3806c9625413 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:06.448440 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075ac8c-e86b-49e3-b2ac-78906bb9eeb2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:06.494155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad435349-f076-4fea-a2af-53cc8feba339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:06.495048 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435349-f076-4fea-a2af-53cc8feba339 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:06.495540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435349-f076-4fea-a2af-53cc8feba339 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:06.495819 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435349-f076-4fea-a2af-53cc8feba339 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:06.508625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad435349-f076-4fea-a2af-53cc8feba339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:06.513685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-ad435349-f076-4fea-a2af-53cc8feba339 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:06.513685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:06.513685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:06.513685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:06.513685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:06.513685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:06.513685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:06.513685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:06.513685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:06.513685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:06.513685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:06.513685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:06.513685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:06.513685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:06.513685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:06.513685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:06.514904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:06.514904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:06.514904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:06.514904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:06.514904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:06.514904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:06.514904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:06.514904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:06.514904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:06.514904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:06.514904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:06.514904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:06.514904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:06.514904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:06.514904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:06.514904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:06.515842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:06.515842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:06.515842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:06.515842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:06.515842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:06.515842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:06.515842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:06.515842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:06.515842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:06.515842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:06.515842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:06.515842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:06.516587 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:06.516660 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 315/641] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:18:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:06.516660 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad435349-f076-4fea-a2af-53cc8feba339 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:06.527197 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b103513-b11f-433b-93de-3806c9625413 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:06.565621 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02700be-c10d-4d23-a7c5-52c3dae4d56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:06.566178 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02700be-c10d-4d23-a7c5-52c3dae4d56a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:06.566453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02700be-c10d-4d23-a7c5-52c3dae4d56a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:06.567140 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02700be-c10d-4d23-a7c5-52c3dae4d56a None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:06.567367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02700be-c10d-4d23-a7c5-52c3dae4d56a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:06.567664 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02700be-c10d-4d23-a7c5-52c3dae4d56a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:06.569175 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02700be-c10d-4d23-a7c5-52c3dae4d56a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:06.586012 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:06.586259 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 327/642] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:06.588244 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02700be-c10d-4d23-a7c5-52c3dae4d56a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:06.643281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad435349-f076-4fea-a2af-53cc8feba339 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:06.680902 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4622c0-5a4f-410f-af11-ab9ea1c00329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:06.681753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4622c0-5a4f-410f-af11-ab9ea1c00329 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:06.682088 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4622c0-5a4f-410f-af11-ab9ea1c00329 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:06.682548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4622c0-5a4f-410f-af11-ab9ea1c00329 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:06.691909 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4622c0-5a4f-410f-af11-ab9ea1c00329 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:06.694107 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4622c0-5a4f-410f-af11-ab9ea1c00329 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:06.697894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02700be-c10d-4d23-a7c5-52c3dae4d56a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:06.709024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-ba4622c0-5a4f-410f-af11-ab9ea1c00329 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:06.709024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:06.709024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:06.709024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:06.709024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:06.709024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:06.709024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:06.709024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:06.709024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:06.709024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:06.709024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:06.709024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:06.709024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:06.709024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:06.709024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:06.710069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:06.710069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:06.710069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:06.710069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:06.710069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:06.710069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:06.710069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:06.710069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:06.710069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:06.710069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:06.710069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:06.710069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:06.710069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:06.710069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:06.710069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:06.710069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:06.710069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:06.711007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:06.711007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:06.711007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:06.711007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:06.711007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:06.711007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:06.711007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:06.711007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:06.711007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 316/643] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:06.711007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4622c0-5a4f-410f-af11-ab9ea1c00329 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:06.740251 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58e5f8-9cfb-4c59-9e8f-57bc60436d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:06.741032 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58e5f8-9cfb-4c59-9e8f-57bc60436d9a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:06.741141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58e5f8-9cfb-4c59-9e8f-57bc60436d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:06.741437 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58e5f8-9cfb-4c59-9e8f-57bc60436d9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:06.753201 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58e5f8-9cfb-4c59-9e8f-57bc60436d9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:06.758019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-af58e5f8-9cfb-4c59-9e8f-57bc60436d9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:06.758019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:06.758019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:06.758019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:06.758019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:06.758019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:06.758019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:06.758019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:06.758019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:06.758019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:06.758019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:06.758019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:06.758019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:06.758019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:06.758019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:06.758019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:06.759113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:06.759113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:06.759113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:06.759113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:06.759113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:06.759113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:06.759113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:06.759113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:06.759113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:06.759113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:06.759113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:06.759113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:06.759113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:06.759113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:06.759113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:06.759113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:06.760018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:06.760018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:06.760018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:06.760018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:06.760018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:06.760018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:06.760018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:06.760018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:06.760018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:06.760018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:06.760018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:06.760018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:06.760018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 328/644] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:18:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:06.760018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58e5f8-9cfb-4c59-9e8f-57bc60436d9a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:06.784369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:06.827702 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4622c0-5a4f-410f-af11-ab9ea1c00329 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:06.838332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:06.866509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b828e-6bfc-4bea-9a68-4a2048991296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:06.867216 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b828e-6bfc-4bea-9a68-4a2048991296 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:06.867494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b828e-6bfc-4bea-9a68-4a2048991296 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:06.867760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b828e-6bfc-4bea-9a68-4a2048991296 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:06.868422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b828e-6bfc-4bea-9a68-4a2048991296 None admin] RBAC: Adding query filter params (name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:06.868802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b828e-6bfc-4bea-9a68-4a2048991296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:06.870252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b828e-6bfc-4bea-9a68-4a2048991296 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:06.884399 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 317/645] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:18:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:06.884592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58e5f8-9cfb-4c59-9e8f-57bc60436d9a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:06.884687 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b828e-6bfc-4bea-9a68-4a2048991296 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:06.923242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f457de-f073-4048-ad09-e4bdade0f69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:06.923870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f457de-f073-4048-ad09-e4bdade0f69d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:06.924148 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f457de-f073-4048-ad09-e4bdade0f69d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:06.924415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f457de-f073-4048-ad09-e4bdade0f69d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:06.933315 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f457de-f073-4048-ad09-e4bdade0f69d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:06.935334 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f457de-f073-4048-ad09-e4bdade0f69d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:06.947962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-61f457de-f073-4048-ad09-e4bdade0f69d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:18:06.947962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:06.947962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:06.947962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:06.947962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:06.947962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:06.947962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:06.947962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:06.947962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:06.947962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:06.947962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:06.947962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:06.947962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:06.947962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:06.947962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:06.947962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:06.949118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:06.950486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:06.950486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:06.950486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:06.950486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:06.950486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:06.950486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:06.950486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:06.950486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:06.950486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:18:06.950486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:06.955900 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 329/646] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:18:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:06.956791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f457de-f073-4048-ad09-e4bdade0f69d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:06.999043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b828e-6bfc-4bea-9a68-4a2048991296 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:07.034021 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8780b1-e893-47a7-9599-d95f03eb5f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:07.034797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8780b1-e893-47a7-9599-d95f03eb5f34 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:07.035080 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8780b1-e893-47a7-9599-d95f03eb5f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:07.036122 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8780b1-e893-47a7-9599-d95f03eb5f34 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:07.036834 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8780b1-e893-47a7-9599-d95f03eb5f34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:07.037142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8780b1-e893-47a7-9599-d95f03eb5f34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:07.038618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8780b1-e893-47a7-9599-d95f03eb5f34 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:07.042596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:07.053180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 318/647] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:07.053976 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8780b1-e893-47a7-9599-d95f03eb5f34 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:07.076855 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f457de-f073-4048-ad09-e4bdade0f69d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:07.088068 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:07.124955 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f013d0-d81e-4f17-846a-7e1e955e0f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:07.126511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f013d0-d81e-4f17-846a-7e1e955e0f89 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:07.127079 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f013d0-d81e-4f17-846a-7e1e955e0f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:07.127958 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f013d0-d81e-4f17-846a-7e1e955e0f89 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:07.129792 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f013d0-d81e-4f17-846a-7e1e955e0f89 None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:07.130103 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f013d0-d81e-4f17-846a-7e1e955e0f89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:07.131569 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f013d0-d81e-4f17-846a-7e1e955e0f89 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:07.145694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 330/648] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:18:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:07.145694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f013d0-d81e-4f17-846a-7e1e955e0f89 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:07.171353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8780b1-e893-47a7-9599-d95f03eb5f34 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:07.210364 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f2a2b-77e1-4514-b5e2-2e23cbd44b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:07.211223 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f2a2b-77e1-4514-b5e2-2e23cbd44b5a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:07.211674 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f2a2b-77e1-4514-b5e2-2e23cbd44b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:07.211921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f2a2b-77e1-4514-b5e2-2e23cbd44b5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:07.223185 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f2a2b-77e1-4514-b5e2-2e23cbd44b5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:07.224660 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f2a2b-77e1-4514-b5e2-2e23cbd44b5a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:07.240182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-144f2a2b-77e1-4514-b5e2-2e23cbd44b5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:07.240182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:07.240182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:07.240182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:07.240182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:07.240182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:07.240182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:07.240182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:07.240182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:07.240182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:07.240182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:07.240182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:07.240182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:07.240182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:07.240182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:07.240182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:07.241381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:07.241381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:07.241381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:07.241381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:07.241381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:07.241381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:07.241381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:07.241381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:07.241381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:07.241381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:07.241381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:07.241381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:07.241381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:07.241381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:07.241381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:07.241381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:07.241381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:07.242277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:07.242277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:07.242277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:07.242277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 319/649] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:07.242501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f2a2b-77e1-4514-b5e2-2e23cbd44b5a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:07.260401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f013d0-d81e-4f17-846a-7e1e955e0f89 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:07.297678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1f240-db14-4ace-b0dc-45e06237e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:07.298287 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1f240-db14-4ace-b0dc-45e06237e25f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:07.298562 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1f240-db14-4ace-b0dc-45e06237e25f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:07.298832 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1f240-db14-4ace-b0dc-45e06237e25f None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:07.299551 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1f240-db14-4ace-b0dc-45e06237e25f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:07.299850 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1f240-db14-4ace-b0dc-45e06237e25f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:07.301289 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1f240-db14-4ace-b0dc-45e06237e25f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:07.310446 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:07.328687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 331/650] 10.222.0.52 () {56 vars in 1137 bytes} [Mon Aug 29 20:18:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:07.328687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1f240-db14-4ace-b0dc-45e06237e25f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:07.347948 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:07.371214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f2a2b-77e1-4514-b5e2-2e23cbd44b5a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:07.411529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be47190-b8c3-4d51-ab52-1151ffa0b6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:07.412150 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be47190-b8c3-4d51-ab52-1151ffa0b6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:07.412398 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be47190-b8c3-4d51-ab52-1151ffa0b6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:07.413078 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be47190-b8c3-4d51-ab52-1151ffa0b6f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:07.414357 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be47190-b8c3-4d51-ab52-1151ffa0b6f5 None admin] RBAC: Adding query filter params (role.id=8352f2960aa74837804150f4c8774dbc, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=9c95d16fd4da4fa7987b893eae0b3ef5) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:07.414666 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be47190-b8c3-4d51-ab52-1151ffa0b6f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:07.416395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be47190-b8c3-4d51-ab52-1151ffa0b6f5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:07.424034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 320/651] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:18:07 2022] GET /identity/v3/role_assignments?user.id=9c95d16fd4da4fa7987b893eae0b3ef5&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=8352f2960aa74837804150f4c8774dbc => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:07.425612 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be47190-b8c3-4d51-ab52-1151ffa0b6f5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:07.449864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1f240-db14-4ace-b0dc-45e06237e25f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:07.503120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec615e-7b4c-4efd-b71a-5cea0294cb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:07.504167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec615e-7b4c-4efd-b71a-5cea0294cb52 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:07.504521 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec615e-7b4c-4efd-b71a-5cea0294cb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:07.504862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec615e-7b4c-4efd-b71a-5cea0294cb52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:07.520435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec615e-7b4c-4efd-b71a-5cea0294cb52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:07.522315 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec615e-7b4c-4efd-b71a-5cea0294cb52 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:07.547631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-f4ec615e-7b4c-4efd-b71a-5cea0294cb52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:07.547631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:07.547631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:07.547631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:07.547631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:07.547631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:07.547631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:07.547631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:07.547631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:07.547631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:07.547631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:07.547631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:07.547631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:07.547631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:07.547631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:07.547631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:07.548841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:07.548841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:07.548841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:07.548841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:07.548841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:07.548841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:07.548841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:07.548841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:07.548841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:07.548841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:07.548841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:07.548841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:07.548841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:07.548841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:07.548841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:07.548841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:07.548841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:07.549951 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:07.549951 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:07.549951 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:07.552217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 332/652] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:07.552217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec615e-7b4c-4efd-b71a-5cea0294cb52 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:07.573038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be47190-b8c3-4d51-ab52-1151ffa0b6f5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:07.625178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fba88-6b09-4f49-afe2-f8a95ffacf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:07.625845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fba88-6b09-4f49-afe2-f8a95ffacf06 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:07.626161 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fba88-6b09-4f49-afe2-f8a95ffacf06 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:07.626416 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fba88-6b09-4f49-afe2-f8a95ffacf06 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:07.627578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fba88-6b09-4f49-afe2-f8a95ffacf06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:07.627899 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fba88-6b09-4f49-afe2-f8a95ffacf06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:07.628584 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:07.630910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fba88-6b09-4f49-afe2-f8a95ffacf06 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:07.648355 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 321/653] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:07.649031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fba88-6b09-4f49-afe2-f8a95ffacf06 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:07.659477 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:07.695913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec615e-7b4c-4efd-b71a-5cea0294cb52 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:07.747134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423e3a5-616e-48d9-a22a-90163b7e8513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:07.748153 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423e3a5-616e-48d9-a22a-90163b7e8513 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:07.748524 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423e3a5-616e-48d9-a22a-90163b7e8513 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:07.748861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423e3a5-616e-48d9-a22a-90163b7e8513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:07.799505 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fba88-6b09-4f49-afe2-f8a95ffacf06 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:07.839242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423e3a5-616e-48d9-a22a-90163b7e8513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:07.841330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423e3a5-616e-48d9-a22a-90163b7e8513 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:07.853036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ae732-a179-4954-8245-ad90b46b5ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:07.853701 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ae732-a179-4954-8245-ad90b46b5ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:07.853978 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ae732-a179-4954-8245-ad90b46b5ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:07.854623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ae732-a179-4954-8245-ad90b46b5ef4 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:07.855271 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ae732-a179-4954-8245-ad90b46b5ef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:07.855570 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ae732-a179-4954-8245-ad90b46b5ef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:07.857613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ae732-a179-4954-8245-ad90b46b5ef4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:07.873461 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 322/654] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:07.874975 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ae732-a179-4954-8245-ad90b46b5ef4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:07.908999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:07.971472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 333/655] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:18:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:07.971871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:07.977592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423e3a5-616e-48d9-a22a-90163b7e8513 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:08.021577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ae732-a179-4954-8245-ad90b46b5ef4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:08.075109 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3a731-99c2-4f72-9122-e10ca3f928d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:08.076715 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3a731-99c2-4f72-9122-e10ca3f928d9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:08.077183 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3a731-99c2-4f72-9122-e10ca3f928d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:08.078054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3a731-99c2-4f72-9122-e10ca3f928d9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:08.090040 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3a731-99c2-4f72-9122-e10ca3f928d9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:08.092728 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3a731-99c2-4f72-9122-e10ca3f928d9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:08.104196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423e3a5-616e-48d9-a22a-90163b7e8513 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:08.110472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-d7d3a731-99c2-4f72-9122-e10ca3f928d9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:18:08.110472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:08.110472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:08.110472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:08.110472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:08.110472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:08.110472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:08.110472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:08.110472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:08.110472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:08.110472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:08.110472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:08.110472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:08.110472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:08.110472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:08.110472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:08.111457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:08.112417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:08.112417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:08.112417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:08.112417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:08.112417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:08.112417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:08.112417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:08.112417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:08.112417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:18:08.112417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:08.115770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 323/656] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:18:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:08.117413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3a731-99c2-4f72-9122-e10ca3f928d9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:08.147576 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f2c4a-c30c-4af0-96a2-909381008136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:08.148110 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2c4a-c30c-4af0-96a2-909381008136 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:08.148498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2c4a-c30c-4af0-96a2-909381008136 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:08.148857 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2c4a-c30c-4af0-96a2-909381008136 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:08.157646 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f2c4a-c30c-4af0-96a2-909381008136 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:08.159358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f2c4a-c30c-4af0-96a2-909381008136 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:08.173976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-7c2f2c4a-c30c-4af0-96a2-909381008136 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:18:08.173976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:08.173976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:08.173976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:08.173976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:08.173976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:08.173976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:08.173976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:08.173976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:08.173976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:08.173976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:08.173976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:08.173976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:08.173976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:08.173976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:08.173976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:08.174986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:08.175966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:08.175966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:08.175966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:08.175966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:08.175966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:08.175966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:08.175966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:08.175966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:08.175966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:18:08.175966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:08.175966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 334/657] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:18:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:08.176595 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f2c4a-c30c-4af0-96a2-909381008136 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:08.217780 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:08.257733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3a731-99c2-4f72-9122-e10ca3f928d9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:08.288077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:08.299559 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0f263-0437-4395-9f08-cdf5e4a4e413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:08.300520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0f263-0437-4395-9f08-cdf5e4a4e413 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:08.300995 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0f263-0437-4395-9f08-cdf5e4a4e413 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:08.301509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0f263-0437-4395-9f08-cdf5e4a4e413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:08.308335 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f2c4a-c30c-4af0-96a2-909381008136 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:08.314821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0f263-0437-4395-9f08-cdf5e4a4e413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:08.316958 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0f263-0437-4395-9f08-cdf5e4a4e413 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:08.335871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-a9b0f263-0437-4395-9f08-cdf5e4a4e413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:08.335871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:08.335871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:08.335871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:08.335871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:08.335871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:08.335871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:08.335871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:08.335871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:08.335871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:08.335871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:08.335871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:08.335871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:08.335871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:08.335871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:08.335871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:08.336823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:08.336823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:08.336823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:08.336823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:08.336823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:08.336823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:08.336823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:08.336823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:08.336823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:08.336823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:08.336823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:08.336823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:08.336823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:08.336823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:08.336823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:08.336823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:08.336823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:08.338128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:08.338128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:08.338128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:08.341507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 324/658] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:08.343453 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0f263-0437-4395-9f08-cdf5e4a4e413 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:08.356566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e1f8b-790f-4cf4-91f1-0842744f1bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:08.357353 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e1f8b-790f-4cf4-91f1-0842744f1bbd None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:08.357604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e1f8b-790f-4cf4-91f1-0842744f1bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:08.357955 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e1f8b-790f-4cf4-91f1-0842744f1bbd None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:08.358699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e1f8b-790f-4cf4-91f1-0842744f1bbd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:08.359037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e1f8b-790f-4cf4-91f1-0842744f1bbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:08.360503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e1f8b-790f-4cf4-91f1-0842744f1bbd None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:08.381636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 335/659] 10.222.0.52 () {56 vars in 1139 bytes} [Mon Aug 29 20:18:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:08.383933 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7eae8-a83d-47ec-85f6-9059588192b4 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:08.384992 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7eae8-a83d-47ec-85f6-9059588192b4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:08.385473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7eae8-a83d-47ec-85f6-9059588192b4 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:08.387214 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 336/660] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:08.388011 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7eae8-a83d-47ec-85f6-9059588192b4 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:08.470363 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:08.480522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0f263-0437-4395-9f08-cdf5e4a4e413 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:08.515366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7eae8-a83d-47ec-85f6-9059588192b4 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:08.519323 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3e19d-578a-4d35-a889-18942287004e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:08.520240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3e19d-578a-4d35-a889-18942287004e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:08.520438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3e19d-578a-4d35-a889-18942287004e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:08.520811 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3e19d-578a-4d35-a889-18942287004e None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:08.521756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3e19d-578a-4d35-a889-18942287004e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:08.522356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3e19d-578a-4d35-a889-18942287004e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:08.524428 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3e19d-578a-4d35-a889-18942287004e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:08.551053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 325/661] 10.222.0.52 () {56 vars in 1137 bytes} [Mon Aug 29 20:18:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:08.551053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3e19d-578a-4d35-a889-18942287004e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:08.563400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7c317-d856-4244-b6e1-5bb9e82dd6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:08.564114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7c317-d856-4244-b6e1-5bb9e82dd6ee None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:08.564341 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7c317-d856-4244-b6e1-5bb9e82dd6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:08.564624 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7c317-d856-4244-b6e1-5bb9e82dd6ee None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:08.565447 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7c317-d856-4244-b6e1-5bb9e82dd6ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:08.565757 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7c317-d856-4244-b6e1-5bb9e82dd6ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:08.567259 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7c317-d856-4244-b6e1-5bb9e82dd6ee None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:08.582309 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 337/662] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:08.583618 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9925cb-3609-400e-8e0f-9f3dd8e5224f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:08.583987 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9925cb-3609-400e-8e0f-9f3dd8e5224f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:08.584242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9925cb-3609-400e-8e0f-9f3dd8e5224f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:08.595221 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:08.606708 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-da9925cb-3609-400e-8e0f-9f3dd8e5224f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:08.607962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-da9925cb-3609-400e-8e0f-9f3dd8e5224f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:08.679049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3e19d-578a-4d35-a889-18942287004e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:08.690199 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 338/663] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:18:08.691263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9925cb-3609-400e-8e0f-9f3dd8e5224f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:08.731786 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae242b-d596-482e-96d5-efb26ab64c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:08.732765 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae242b-d596-482e-96d5-efb26ab64c33 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:08.733244 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae242b-d596-482e-96d5-efb26ab64c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:08.733599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae242b-d596-482e-96d5-efb26ab64c33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:08.767009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:08.830812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae242b-d596-482e-96d5-efb26ab64c33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:08.832677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae242b-d596-482e-96d5-efb26ab64c33 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:08.842152 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9925cb-3609-400e-8e0f-9f3dd8e5224f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:08.877063 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:08.906621 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0d0d3-61cd-4b80-8aa8-9ee12a90d7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:08.907988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0d0d3-61cd-4b80-8aa8-9ee12a90d7aa None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:08.908644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0d0d3-61cd-4b80-8aa8-9ee12a90d7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:08.909430 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0d0d3-61cd-4b80-8aa8-9ee12a90d7aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:08.972144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 326/664] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:18:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:08.972144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae242b-d596-482e-96d5-efb26ab64c33 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:09.010681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0d0d3-61cd-4b80-8aa8-9ee12a90d7aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:09.012445 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0d0d3-61cd-4b80-8aa8-9ee12a90d7aa None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:09.083174 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:09.086614 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae242b-d596-482e-96d5-efb26ab64c33 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:09.126605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d4a71-b501-4178-ac2b-e35f67beb52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:09.127921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d4a71-b501-4178-ac2b-e35f67beb52f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:09.128222 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d4a71-b501-4178-ac2b-e35f67beb52f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:09.128507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d4a71-b501-4178-ac2b-e35f67beb52f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:09.134948 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:09.141312 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d4a71-b501-4178-ac2b-e35f67beb52f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:09.146989 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 339/665] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:18:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:09.146989 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0d0d3-61cd-4b80-8aa8-9ee12a90d7aa None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:09.147253 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d4a71-b501-4178-ac2b-e35f67beb52f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:09.158256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-5c3d4a71-b501-4178-ac2b-e35f67beb52f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:09.158256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:09.158256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:09.158256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:09.158256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:09.158256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:09.158256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:09.158256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:09.158256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:09.158256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:09.158256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:09.158256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:09.158256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:09.158256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:09.158256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:09.159379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:09.159379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:09.159379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:09.159379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:09.159379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:09.159379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:09.159379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:09.159379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:09.159379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:09.159379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:09.159379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:09.159379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:09.159379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:09.159379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:09.159379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:09.159379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:09.159379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:09.165545 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:09.165545 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:09.165545 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:09.165545 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:09.165545 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:09.165545 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:09.165545 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:09.165545 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:09.165545 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 327/666] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:09.165545 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d4a71-b501-4178-ac2b-e35f67beb52f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:09.274573 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0d0d3-61cd-4b80-8aa8-9ee12a90d7aa None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:09.283038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d4a71-b501-4178-ac2b-e35f67beb52f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:09.313102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee5454-20e0-4b64-8200-f9f1bb8094c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:09.313771 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee5454-20e0-4b64-8200-f9f1bb8094c7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:09.314048 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee5454-20e0-4b64-8200-f9f1bb8094c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:09.314320 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee5454-20e0-4b64-8200-f9f1bb8094c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:09.325652 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f7c51-3bf0-4c03-a316-9f375308dcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:09.326433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f7c51-3bf0-4c03-a316-9f375308dcd0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:09.326715 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f7c51-3bf0-4c03-a316-9f375308dcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:09.326987 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f7c51-3bf0-4c03-a316-9f375308dcd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:09.327143 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee5454-20e0-4b64-8200-f9f1bb8094c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:09.335718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-f5ee5454-20e0-4b64-8200-f9f1bb8094c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:09.335718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:09.335718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:09.335718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:09.335718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:09.335718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:09.335718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:09.335718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:09.335718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:09.335718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:09.335718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:09.335718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:09.335718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:09.335718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:09.335718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:09.335718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:09.337669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:09.337669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:09.337669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:09.337669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:09.337669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:09.337669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:09.337669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:09.337669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:09.337669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:09.337669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:09.337669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:09.337669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:09.337669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:09.337669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:09.337669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:09.337669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:09.339080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:09.339080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:09.339080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:09.339080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:09.339080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:09.339080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:09.339080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:09.339080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:09.339080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:09.339080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:09.339080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:09.339080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:09.340669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 340/667] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:18:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:09.340852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee5454-20e0-4b64-8200-f9f1bb8094c7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:09.350973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f7c51-3bf0-4c03-a316-9f375308dcd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:09.352930 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f7c51-3bf0-4c03-a316-9f375308dcd0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:09.366412 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:09.372774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-ae2f7c51-3bf0-4c03-a316-9f375308dcd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:09.372774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:09.372774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:09.372774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:09.372774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:09.372774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:09.372774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:09.372774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:09.372774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:09.372774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:09.372774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:09.372774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:09.372774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:09.372774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:09.372774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:09.372774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:09.374076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:09.374076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:09.374076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:09.374076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:09.374076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:09.374076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:09.374076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:09.374076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:09.374076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:09.374076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:09.374076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:09.374076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:09.374076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:09.374076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:09.374076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:09.374076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:09.374076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:09.375254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:09.375254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:09.375254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:09.375658 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 328/668] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:09.382640 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f7c51-3bf0-4c03-a316-9f375308dcd0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:09.443206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:09.477536 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee5454-20e0-4b64-8200-f9f1bb8094c7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:09.504858 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f7c51-3bf0-4c03-a316-9f375308dcd0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:09.517773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88a787-de61-4f91-a153-7087f967a7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:09.518412 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88a787-de61-4f91-a153-7087f967a7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:09.518694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88a787-de61-4f91-a153-7087f967a7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:09.518961 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88a787-de61-4f91-a153-7087f967a7c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:09.529619 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88a787-de61-4f91-a153-7087f967a7c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:09.531099 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88a787-de61-4f91-a153-7087f967a7c1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:09.544551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da0236-886e-44fc-8626-5b634c2517be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:09.545167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da0236-886e-44fc-8626-5b634c2517be None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:09.545469 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da0236-886e-44fc-8626-5b634c2517be None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:09.545740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da0236-886e-44fc-8626-5b634c2517be None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:09.546437 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da0236-886e-44fc-8626-5b634c2517be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:09.546540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-1f88a787-de61-4f91-a153-7087f967a7c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:09.546540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:09.546540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:09.546540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:09.546540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:09.546540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:09.546540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:09.546540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:09.546540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:09.546540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:09.546540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:09.546540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:09.546540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:09.546540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:09.546540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:09.546540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:09.547610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:09.547610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:09.547610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:09.547610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:09.547610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:09.547610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:09.547610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:09.547610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:09.547610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:09.547610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:09.547610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:09.547610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:09.547610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:09.547610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:09.547610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:09.547610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:09.547610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:09.553570 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:09.553570 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:09.553570 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:09.553778 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da0236-886e-44fc-8626-5b634c2517be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:09.553878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 341/669] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:09.553960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da0236-886e-44fc-8626-5b634c2517be None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:09.554040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88a787-de61-4f91-a153-7087f967a7c1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:09.572224 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 329/670] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:09.572224 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da0236-886e-44fc-8626-5b634c2517be None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:09.642753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:09.684003 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88a787-de61-4f91-a153-7087f967a7c1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:09.697005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da0236-886e-44fc-8626-5b634c2517be None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:09.707341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:09.726110 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d2e23-0268-4da3-88ce-317a33c66113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:09.726989 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d2e23-0268-4da3-88ce-317a33c66113 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:09.727252 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d2e23-0268-4da3-88ce-317a33c66113 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:09.727540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d2e23-0268-4da3-88ce-317a33c66113 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:09.728188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d2e23-0268-4da3-88ce-317a33c66113 None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:09.728483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d2e23-0268-4da3-88ce-317a33c66113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:09.729894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d2e23-0268-4da3-88ce-317a33c66113 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:09.737386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94078c1a-9737-489d-9a4f-edec627f0b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:09.738362 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94078c1a-9737-489d-9a4f-edec627f0b45 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:09.738639 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94078c1a-9737-489d-9a4f-edec627f0b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:09.738911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94078c1a-9737-489d-9a4f-edec627f0b45 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:09.739563 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94078c1a-9737-489d-9a4f-edec627f0b45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:09.739865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94078c1a-9737-489d-9a4f-edec627f0b45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:09.740383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 342/671] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:18:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:09.741313 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d2e23-0268-4da3-88ce-317a33c66113 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:09.741511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94078c1a-9737-489d-9a4f-edec627f0b45 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:09.756875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 330/672] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:09.758027 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94078c1a-9737-489d-9a4f-edec627f0b45 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:09.855481 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d2e23-0268-4da3-88ce-317a33c66113 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:09.873431 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94078c1a-9737-489d-9a4f-edec627f0b45 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:09.890122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:09.899134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a7b0d-9435-4169-b1c1-49dcffe960bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:09.899794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a7b0d-9435-4169-b1c1-49dcffe960bd None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:09.900170 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a7b0d-9435-4169-b1c1-49dcffe960bd None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:09.900445 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a7b0d-9435-4169-b1c1-49dcffe960bd None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:09.901210 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a7b0d-9435-4169-b1c1-49dcffe960bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:09.901602 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a7b0d-9435-4169-b1c1-49dcffe960bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:09.903261 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a7b0d-9435-4169-b1c1-49dcffe960bd None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:09.917697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 343/673] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:09.919385 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb14cc5-210b-4be2-aa84-8b8d10a0c977 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:09.919672 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb14cc5-210b-4be2-aa84-8b8d10a0c977 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:09.919968 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb14cc5-210b-4be2-aa84-8b8d10a0c977 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:09.920798 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589faab-d987-4995-8ac4-1d2320364076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:09.921438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589faab-d987-4995-8ac4-1d2320364076 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:09.921810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 344/674] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:09.922530 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb14cc5-210b-4be2-aa84-8b8d10a0c977 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:09.925570 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589faab-d987-4995-8ac4-1d2320364076 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:09.925874 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589faab-d987-4995-8ac4-1d2320364076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:09.926626 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589faab-d987-4995-8ac4-1d2320364076 None admin] RBAC: Adding query filter params (role.id=8352f2960aa74837804150f4c8774dbc, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=960a2be5cb58461fb9fb8e99094398d6) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:09.926936 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589faab-d987-4995-8ac4-1d2320364076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:09.928387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589faab-d987-4995-8ac4-1d2320364076 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:09.934586 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 331/675] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:18:09 2022] GET /identity/v3/role_assignments?user.id=960a2be5cb58461fb9fb8e99094398d6&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=8352f2960aa74837804150f4c8774dbc => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:09.935466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589faab-d987-4995-8ac4-1d2320364076 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:09.980772 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:10.054583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb14cc5-210b-4be2-aa84-8b8d10a0c977 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:10.083100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589faab-d987-4995-8ac4-1d2320364076 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:10.107421 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019408e6-e4d4-45d8-ab27-b131a19a60b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:10.108281 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019408e6-e4d4-45d8-ab27-b131a19a60b7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:10.109326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019408e6-e4d4-45d8-ab27-b131a19a60b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:10.109456 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019408e6-e4d4-45d8-ab27-b131a19a60b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:10.121858 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019408e6-e4d4-45d8-ab27-b131a19a60b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:10.123983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019408e6-e4d4-45d8-ab27-b131a19a60b7 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:10.135642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d8d3e-502c-4cec-b57b-563de1bbda07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:10.136455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d8d3e-502c-4cec-b57b-563de1bbda07 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:10.136797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d8d3e-502c-4cec-b57b-563de1bbda07 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:10.137091 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d8d3e-502c-4cec-b57b-563de1bbda07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:10.143508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-019408e6-e4d4-45d8-ab27-b131a19a60b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:10.143508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:10.143508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:10.143508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:10.143508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:10.143508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:10.143508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:10.143508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:10.143508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:10.143508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:10.143508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:10.143508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:10.143508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:10.143508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:10.143508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:10.143508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:10.144984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:10.144984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:10.144984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:10.144984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:10.144984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:10.144984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:10.144984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:10.144984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:10.144984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:10.144984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:10.144984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:10.144984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:10.144984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:10.144984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:10.144984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:10.144984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:10.144984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:10.146259 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:10.146259 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:10.146259 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:10.146259 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 345/676] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:10.146259 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019408e6-e4d4-45d8-ab27-b131a19a60b7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:10.154834 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d8d3e-502c-4cec-b57b-563de1bbda07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:10.156565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d8d3e-502c-4cec-b57b-563de1bbda07 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:10.171749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-244d8d3e-502c-4cec-b57b-563de1bbda07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:10.171749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:10.171749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:10.171749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:10.171749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:10.171749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:10.171749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:10.171749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:10.171749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:10.171749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:10.171749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:10.171749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:10.171749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:10.171749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:10.171749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:10.172982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:10.172982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:10.172982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:10.172982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:10.172982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:10.172982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:10.172982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:10.172982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:10.172982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:10.172982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:10.172982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:10.172982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:10.172982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:10.172982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:10.172982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:10.172982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:10.172982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:10.174266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:10.174266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:10.174266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:10.174266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:10.174266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:10.174266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:10.174266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:10.174266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:10.181740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 332/677] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:10.183193 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d5946-897d-49b9-b273-83c04aa6217c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:10.183493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d5946-897d-49b9-b273-83c04aa6217c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:10.183762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d5946-897d-49b9-b273-83c04aa6217c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:10.205866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ef9d5946-897d-49b9-b273-83c04aa6217c None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:10.207118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ef9d5946-897d-49b9-b273-83c04aa6217c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:10.218485 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:10.297385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 333/678] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:18:10.297385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d5946-897d-49b9-b273-83c04aa6217c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:10.302729 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019408e6-e4d4-45d8-ab27-b131a19a60b7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:10.333238 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:10.363294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ec4d9-827c-41e0-bebd-e1de83cad457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:10.364093 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ec4d9-827c-41e0-bebd-e1de83cad457 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:10.364467 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ec4d9-827c-41e0-bebd-e1de83cad457 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:10.364883 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ec4d9-827c-41e0-bebd-e1de83cad457 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:10.373322 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ec4d9-827c-41e0-bebd-e1de83cad457 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:10.375350 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ec4d9-827c-41e0-bebd-e1de83cad457 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:10.388419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-165ec4d9-827c-41e0-bebd-e1de83cad457 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:10.388419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:10.388419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:10.388419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:10.388419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:10.388419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:10.388419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:10.388419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:10.388419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:10.388419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:10.388419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:10.388419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:10.388419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:10.388419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:10.388419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:10.389793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:10.389793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:10.389793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:10.389793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:10.389793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:10.389793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:10.389793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:10.389793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:10.389793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:10.389793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:10.389793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:10.389793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:10.389793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:10.389793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:10.389793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:10.389793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:10.389793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:10.391061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:10.391061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:10.391061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:10.391061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:10.391061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:10.391061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:10.391061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:10.391061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:10.397730 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 346/679] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:10.397730 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ec4d9-827c-41e0-bebd-e1de83cad457 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:10.460897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d5946-897d-49b9-b273-83c04aa6217c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:10.504395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb43e5-5d2c-4d9c-acd1-40e9d1f5fc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:10.505278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb43e5-5d2c-4d9c-acd1-40e9d1f5fc2d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:10.505746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb43e5-5d2c-4d9c-acd1-40e9d1f5fc2d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:10.506172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb43e5-5d2c-4d9c-acd1-40e9d1f5fc2d None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:10.507077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb43e5-5d2c-4d9c-acd1-40e9d1f5fc2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:10.507527 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb43e5-5d2c-4d9c-acd1-40e9d1f5fc2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:10.509170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb43e5-5d2c-4d9c-acd1-40e9d1f5fc2d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:10.510863 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ec4d9-827c-41e0-bebd-e1de83cad457 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:10.512608 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:10.525458 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 334/680] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:10.526615 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb43e5-5d2c-4d9c-acd1-40e9d1f5fc2d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:10.549403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd5786-cf28-4633-a96b-d9a7727c7a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:10.550155 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd5786-cf28-4633-a96b-d9a7727c7a9e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:10.550532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd5786-cf28-4633-a96b-d9a7727c7a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:10.550920 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd5786-cf28-4633-a96b-d9a7727c7a9e None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:10.551715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd5786-cf28-4633-a96b-d9a7727c7a9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:10.552117 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd5786-cf28-4633-a96b-d9a7727c7a9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:10.553694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd5786-cf28-4633-a96b-d9a7727c7a9e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:10.572041 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 347/681] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:10.573112 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd5786-cf28-4633-a96b-d9a7727c7a9e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:10.625174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:10.648439 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb43e5-5d2c-4d9c-acd1-40e9d1f5fc2d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:10.680342 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd5786-cf28-4633-a96b-d9a7727c7a9e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:10.692699 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5c9d0-940c-443f-94f4-351a2592b547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:10.693312 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5c9d0-940c-443f-94f4-351a2592b547 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:10.693621 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5c9d0-940c-443f-94f4-351a2592b547 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:10.693888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5c9d0-940c-443f-94f4-351a2592b547 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:10.694576 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5c9d0-940c-443f-94f4-351a2592b547 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:10.694877 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5c9d0-940c-443f-94f4-351a2592b547 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:10.696324 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5c9d0-940c-443f-94f4-351a2592b547 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:10.708896 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 335/682] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:10.709764 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5c9d0-940c-443f-94f4-351a2592b547 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:10.724436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dbfcc-bf0f-485b-8fef-049328e44113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:10.725393 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dbfcc-bf0f-485b-8fef-049328e44113 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:10.725393 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dbfcc-bf0f-485b-8fef-049328e44113 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:10.725664 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dbfcc-bf0f-485b-8fef-049328e44113 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:10.734519 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dbfcc-bf0f-485b-8fef-049328e44113 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:10.736104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dbfcc-bf0f-485b-8fef-049328e44113 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:10.748671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-fa6dbfcc-bf0f-485b-8fef-049328e44113 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:18:10.748671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:10.748671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:10.748671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:10.748671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:10.748671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:10.748671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:10.748671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:10.748671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:10.748671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:10.748671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:10.748671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:10.748671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:10.748671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:10.748671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:10.748671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:10.749817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:10.750789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:10.750789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:10.750789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:10.750789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:10.750789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:10.750789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:10.750789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:10.750789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:10.750789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:18:10.750789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:10.750789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 348/683] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:18:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:10.750789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dbfcc-bf0f-485b-8fef-049328e44113 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:10.789479 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:10.865797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5c9d0-940c-443f-94f4-351a2592b547 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:10.893068 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dbfcc-bf0f-485b-8fef-049328e44113 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:10.908100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a1584-761e-4064-9e2b-399a714001c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:10.908744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a1584-761e-4064-9e2b-399a714001c6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:10.909014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a1584-761e-4064-9e2b-399a714001c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:10.909485 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a1584-761e-4064-9e2b-399a714001c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:10.910033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a1584-761e-4064-9e2b-399a714001c6 None admin] RBAC: Adding query filter params (role.id=8352f2960aa74837804150f4c8774dbc, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=382b0ee3bd634cc8800f1769c91b7a8a) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:10.910553 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a1584-761e-4064-9e2b-399a714001c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:10.911809 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a1584-761e-4064-9e2b-399a714001c6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:10.921991 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 336/684] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:18:10 2022] GET /identity/v3/role_assignments?user.id=382b0ee3bd634cc8800f1769c91b7a8a&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=8352f2960aa74837804150f4c8774dbc => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:10.925687 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a1584-761e-4064-9e2b-399a714001c6 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:10.940225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571c7b2-5ffb-4b7f-9e14-685bd269eaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:10.940952 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571c7b2-5ffb-4b7f-9e14-685bd269eaed None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:10.941236 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571c7b2-5ffb-4b7f-9e14-685bd269eaed None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:10.941543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571c7b2-5ffb-4b7f-9e14-685bd269eaed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:10.950784 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:10.962632 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571c7b2-5ffb-4b7f-9e14-685bd269eaed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:10.971680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-4571c7b2-5ffb-4b7f-9e14-685bd269eaed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:18:10.971680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:10.971680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:10.971680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:10.971680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:10.971680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:10.971680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:10.971680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:10.971680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:10.971680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:10.971680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:10.971680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:10.971680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:10.971680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:10.971680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:10.971680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:10.972698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:10.972698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:10.972698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:10.972698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:10.972698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:10.972698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:10.972698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:10.972698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:10.972698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:10.972698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:10.972698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:10.972698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:10.972698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:10.972698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:10.972698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:10.972698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:10.973572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:10.973572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:10.973572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:10.973572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:10.973572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:10.973572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:10.973572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:10.973572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:10.973572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:10.973572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:10.973572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:18:10.973572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:10.977523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 349/685] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:18:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:10.978464 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571c7b2-5ffb-4b7f-9e14-685bd269eaed None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:11.100633 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a1584-761e-4064-9e2b-399a714001c6 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:11.101959 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:11.130644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571c7b2-5ffb-4b7f-9e14-685bd269eaed None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:11.160539 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bf4a0-a3bc-4612-9b2e-644b2e4b59d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:11.161321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bf4a0-a3bc-4612-9b2e-644b2e4b59d5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:11.161754 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bf4a0-a3bc-4612-9b2e-644b2e4b59d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:11.162026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bf4a0-a3bc-4612-9b2e-644b2e4b59d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:11.163020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bf4a0-a3bc-4612-9b2e-644b2e4b59d5 None admin] RBAC: Adding query filter params (role.id=8352f2960aa74837804150f4c8774dbc, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=47429aec6d8a4339b4ec0fb32b25e90b) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:11.163330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bf4a0-a3bc-4612-9b2e-644b2e4b59d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:11.166150 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bf4a0-a3bc-4612-9b2e-644b2e4b59d5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:11.178103 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 337/686] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:18:10 2022] GET /identity/v3/role_assignments?user.id=47429aec6d8a4339b4ec0fb32b25e90b&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=8352f2960aa74837804150f4c8774dbc => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:11.178301 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75553d7b-71e6-422e-be76-b6c158d1833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:11.178399 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bf4a0-a3bc-4612-9b2e-644b2e4b59d5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:11.178473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75553d7b-71e6-422e-be76-b6c158d1833b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:11.178473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75553d7b-71e6-422e-be76-b6c158d1833b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:11.178473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75553d7b-71e6-422e-be76-b6c158d1833b None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:11.178473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75553d7b-71e6-422e-be76-b6c158d1833b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:11.178473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75553d7b-71e6-422e-be76-b6c158d1833b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:11.179139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75553d7b-71e6-422e-be76-b6c158d1833b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:11.207615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 350/687] 10.222.0.52 () {56 vars in 1135 bytes} [Mon Aug 29 20:18:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:11.212782 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75553d7b-71e6-422e-be76-b6c158d1833b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:11.374450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:11.382478 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75553d7b-71e6-422e-be76-b6c158d1833b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:11.420098 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bf4a0-a3bc-4612-9b2e-644b2e4b59d5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:11.438153 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ec0cc-18ba-46aa-9601-0a0ef8a92383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:11.439356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ec0cc-18ba-46aa-9601-0a0ef8a92383 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:11.439852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ec0cc-18ba-46aa-9601-0a0ef8a92383 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:11.440618 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ec0cc-18ba-46aa-9601-0a0ef8a92383 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:11.460150 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:11.477307 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6e449-9ec1-4fd5-87c7-19c166832de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:11.478163 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6e449-9ec1-4fd5-87c7-19c166832de0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:11.478511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6e449-9ec1-4fd5-87c7-19c166832de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:11.478878 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6e449-9ec1-4fd5-87c7-19c166832de0 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:11.480126 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6e449-9ec1-4fd5-87c7-19c166832de0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:11.480487 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6e449-9ec1-4fd5-87c7-19c166832de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:11.482840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6e449-9ec1-4fd5-87c7-19c166832de0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:11.495891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 338/688] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:18:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:11.503190 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6e449-9ec1-4fd5-87c7-19c166832de0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:11.551827 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ec0cc-18ba-46aa-9601-0a0ef8a92383 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:11.553922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ec0cc-18ba-46aa-9601-0a0ef8a92383 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:11.632195 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6e449-9ec1-4fd5-87c7-19c166832de0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:11.707889 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:11.716115 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae89ee-944e-4508-8049-6492ee4818fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:11.717131 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae89ee-944e-4508-8049-6492ee4818fb None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:11.717425 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae89ee-944e-4508-8049-6492ee4818fb None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:11.717698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae89ee-944e-4508-8049-6492ee4818fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:11.741698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae89ee-944e-4508-8049-6492ee4818fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:11.743453 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae89ee-944e-4508-8049-6492ee4818fb None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:11.767524 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 351/689] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:18:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:11.770799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-e1ae89ee-944e-4508-8049-6492ee4818fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:11.770799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:11.770799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:11.770799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:11.770799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:11.770799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:11.770799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:11.770799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:11.770799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:11.770799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:11.770799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:11.770799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:11.770799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:11.770799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:11.770799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:11.770799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:11.772308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:11.772308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:11.772308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:11.772308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:11.772308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:11.772308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:11.772308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:11.772308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:11.772308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:11.772308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:11.772308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:11.772308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:11.772308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:11.772308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:11.772308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:11.772308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:11.772308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:11.774034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:11.774034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:11.774034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:11.774034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 339/690] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:11.776734 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ec0cc-18ba-46aa-9601-0a0ef8a92383 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:11.784593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae89ee-944e-4508-8049-6492ee4818fb None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:11.866078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:11.951769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae89ee-944e-4508-8049-6492ee4818fb None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:11.997654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ec0cc-18ba-46aa-9601-0a0ef8a92383 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:12.028733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd03d18-7f00-42ee-a353-29ff98539cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:12.029830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd03d18-7f00-42ee-a353-29ff98539cfd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:12.030340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd03d18-7f00-42ee-a353-29ff98539cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:12.030806 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd03d18-7f00-42ee-a353-29ff98539cfd None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:12.031659 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd03d18-7f00-42ee-a353-29ff98539cfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:12.032156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd03d18-7f00-42ee-a353-29ff98539cfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:12.033907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd03d18-7f00-42ee-a353-29ff98539cfd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:12.047692 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c47e3-3740-47f6-8fa9-98329fd94fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:12.047692 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c47e3-3740-47f6-8fa9-98329fd94fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:12.047692 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c47e3-3740-47f6-8fa9-98329fd94fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:12.047692 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c47e3-3740-47f6-8fa9-98329fd94fc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:12.054626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c47e3-3740-47f6-8fa9-98329fd94fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:12.056167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c47e3-3740-47f6-8fa9-98329fd94fc7 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:12.057750 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 340/691] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:12.064319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd03d18-7f00-42ee-a353-29ff98539cfd None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:12.085306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-685c47e3-3740-47f6-8fa9-98329fd94fc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:12.085306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:12.085306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:12.085306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:12.085306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:12.085306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:12.085306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:12.085306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:12.085306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:12.085306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:12.085306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:12.085306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:12.085306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:12.085306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:12.085306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:12.085306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:12.086984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:12.086984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:12.086984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:12.086984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:12.086984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:12.086984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:12.086984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:12.086984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:12.086984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:12.086984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:12.086984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:12.086984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:12.086984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:12.086984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:12.086984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:12.086984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:12.086984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:12.087861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:12.087861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:12.087861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:12.087861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 352/692] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:12.093445 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c47e3-3740-47f6-8fa9-98329fd94fc7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:12.147577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:12.208800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:12.222244 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c47e3-3740-47f6-8fa9-98329fd94fc7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:12.235535 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd03d18-7f00-42ee-a353-29ff98539cfd None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:12.267733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03b614-2e1a-4d4d-926d-58d7d414b6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:12.268352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03b614-2e1a-4d4d-926d-58d7d414b6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:12.268626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03b614-2e1a-4d4d-926d-58d7d414b6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:12.268890 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03b614-2e1a-4d4d-926d-58d7d414b6c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:12.269569 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03b614-2e1a-4d4d-926d-58d7d414b6c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:12.270299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03b614-2e1a-4d4d-926d-58d7d414b6c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:12.272163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03b614-2e1a-4d4d-926d-58d7d414b6c8 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:12.284119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85d477-aafc-4bde-83a3-879cba6ebdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:12.285556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85d477-aafc-4bde-83a3-879cba6ebdd8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:12.286254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85d477-aafc-4bde-83a3-879cba6ebdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:12.286683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85d477-aafc-4bde-83a3-879cba6ebdd8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:12.289431 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 353/693] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:12.290954 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ca5c7-459e-4940-87e1-c1fef0a3533f None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:12.291361 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ca5c7-459e-4940-87e1-c1fef0a3533f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:12.291775 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ca5c7-459e-4940-87e1-c1fef0a3533f None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:12.293129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 354/694] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:12.298892 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ca5c7-459e-4940-87e1-c1fef0a3533f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:12.300889 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85d477-aafc-4bde-83a3-879cba6ebdd8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:12.302789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85d477-aafc-4bde-83a3-879cba6ebdd8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:12.320690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-fc85d477-aafc-4bde-83a3-879cba6ebdd8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:18:12.320690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:12.320690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:12.320690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:12.320690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:12.320690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:12.320690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:12.320690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:12.320690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:12.320690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:12.320690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:12.320690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:12.320690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:12.320690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:12.320690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:12.320690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:12.321736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:12.323248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:12.323248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:12.323248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:12.323248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:12.323248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:12.323248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:12.323248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:12.323248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:12.323248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:18:12.323248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:12.323248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 341/695] 10.222.0.52 () {56 vars in 1093 bytes} [Mon Aug 29 20:18:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:12.323848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b85dcf-24ee-4c3a-beb7-9c474f8370f2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:12.323848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b85dcf-24ee-4c3a-beb7-9c474f8370f2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:12.323967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b85dcf-24ee-4c3a-beb7-9c474f8370f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:12.348123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-87b85dcf-24ee-4c3a-beb7-9c474f8370f2 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:12.349326 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-87b85dcf-24ee-4c3a-beb7-9c474f8370f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:12.439144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 342/696] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:18:12.440475 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b85dcf-24ee-4c3a-beb7-9c474f8370f2 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:12.452699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ca5c7-459e-4940-87e1-c1fef0a3533f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:12.485463 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:12.501456 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127d4ba-18a6-47a0-938d-7b50d57861fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:12.502438 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127d4ba-18a6-47a0-938d-7b50d57861fd None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:12.503395 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127d4ba-18a6-47a0-938d-7b50d57861fd None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:12.503883 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127d4ba-18a6-47a0-938d-7b50d57861fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:12.512003 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127d4ba-18a6-47a0-938d-7b50d57861fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:12.513971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127d4ba-18a6-47a0-938d-7b50d57861fd None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:12.528283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-7127d4ba-18a6-47a0-938d-7b50d57861fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:12.528283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:12.528283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:12.528283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:12.528283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:12.528283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:12.528283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:12.528283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:12.528283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:12.528283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:12.528283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:12.528283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:12.528283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:12.528283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:12.528283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:12.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:12.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:12.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:12.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:12.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:12.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:12.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:12.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:12.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:12.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:12.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:12.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:12.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:12.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:12.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:12.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:12.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:12.530228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:12.530228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:12.530228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:12.530228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:12.530228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:12.530228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:12.530228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:12.530228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:12.537630 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 355/697] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:12.539466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127d4ba-18a6-47a0-938d-7b50d57861fd None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:12.557875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:12.634421 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b85dcf-24ee-4c3a-beb7-9c474f8370f2 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:12.700716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0163f0-de13-4658-a73d-6def26851cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:12.701578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0163f0-de13-4658-a73d-6def26851cbe None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:12.701859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0163f0-de13-4658-a73d-6def26851cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:12.702176 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0163f0-de13-4658-a73d-6def26851cbe None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:12.702932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0163f0-de13-4658-a73d-6def26851cbe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:12.703225 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0163f0-de13-4658-a73d-6def26851cbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:12.704681 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0163f0-de13-4658-a73d-6def26851cbe None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:12.715414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127d4ba-18a6-47a0-938d-7b50d57861fd None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:12.724912 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 343/698] 10.222.0.52 () {56 vars in 1133 bytes} [Mon Aug 29 20:18:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:12.734211 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0163f0-de13-4658-a73d-6def26851cbe None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:12.773971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b21e5-4c90-4fab-8b8e-58461d6d463c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:12.774519 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b21e5-4c90-4fab-8b8e-58461d6d463c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:12.774794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b21e5-4c90-4fab-8b8e-58461d6d463c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:12.775062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b21e5-4c90-4fab-8b8e-58461d6d463c None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:12.775757 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b21e5-4c90-4fab-8b8e-58461d6d463c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:12.776170 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b21e5-4c90-4fab-8b8e-58461d6d463c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:12.777760 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b21e5-4c90-4fab-8b8e-58461d6d463c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:12.791851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 356/699] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:12.792731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b21e5-4c90-4fab-8b8e-58461d6d463c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:12.867397 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:12.878933 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0163f0-de13-4658-a73d-6def26851cbe None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:12.885746 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:12.920111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8629704-97af-46a7-8969-368f96575283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:12.921146 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8629704-97af-46a7-8969-368f96575283 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:12.921278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b21e5-4c90-4fab-8b8e-58461d6d463c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:12.922859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8629704-97af-46a7-8969-368f96575283 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:12.923356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8629704-97af-46a7-8969-368f96575283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:12.957170 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c90067-5ade-4699-ac62-4ce0cd607b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:12.957839 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c90067-5ade-4699-ac62-4ce0cd607b28 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:12.958202 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c90067-5ade-4699-ac62-4ce0cd607b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:12.958379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c90067-5ade-4699-ac62-4ce0cd607b28 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:12.958958 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c90067-5ade-4699-ac62-4ce0cd607b28 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:12.960331 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c90067-5ade-4699-ac62-4ce0cd607b28 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:12.971713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-b1c90067-5ade-4699-ac62-4ce0cd607b28 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:18:12.971713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:12.971713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:12.971713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:12.971713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:12.971713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:12.971713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:12.971713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:12.971713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:18:12.971713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:12.971713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:12.971713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:12.971713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:12.971713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:12.971713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:12.971713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:12.971713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:12.972953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:12.972953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:12.972953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:12.972953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:12.972953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:12.972953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:12.972953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:12.972953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:12.972953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:12.972953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:12.972953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:12.972953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:12.972953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:12.972953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:12.972953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:12.972953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:12.974406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:12.974406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:12.974406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:12.974406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:12.974406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:12.974406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:12.974406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:12.974406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:12.974406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:12.974406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:12.974406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:12.974406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:12.974406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:18:12.974406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:12.974406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 357/700] 10.222.0.52 () {56 vars in 1129 bytes} [Mon Aug 29 20:18:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:12.975279 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c90067-5ade-4699-ac62-4ce0cd607b28 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:13.008329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8629704-97af-46a7-8969-368f96575283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:13.010404 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8629704-97af-46a7-8969-368f96575283 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:13.084565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c90067-5ade-4699-ac62-4ce0cd607b28 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:13.118470 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:13.120745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb40cec-5715-4433-8a15-9cf8142fbe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:13.121600 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb40cec-5715-4433-8a15-9cf8142fbe05 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.121879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb40cec-5715-4433-8a15-9cf8142fbe05 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.122148 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb40cec-5715-4433-8a15-9cf8142fbe05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.122957 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb40cec-5715-4433-8a15-9cf8142fbe05 None admin] RBAC: Adding query filter params (role.id=8352f2960aa74837804150f4c8774dbc, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=dcb9791ea73d46b191ad9fc146297565) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:13.123685 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb40cec-5715-4433-8a15-9cf8142fbe05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:13.125259 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb40cec-5715-4433-8a15-9cf8142fbe05 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:13.129891 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:13.133236 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 358/701] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:18:12 2022] GET /identity/v3/role_assignments?user.id=dcb9791ea73d46b191ad9fc146297565&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=8352f2960aa74837804150f4c8774dbc => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:13.134555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb40cec-5715-4433-8a15-9cf8142fbe05 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:13.144170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 344/702] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 20:18:13.150126 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8629704-97af-46a7-8969-368f96575283 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:13.253935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb40cec-5715-4433-8a15-9cf8142fbe05 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:13.292806 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65751f81-6c93-4d1e-b6ea-64ed0399f717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:13.293470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65751f81-6c93-4d1e-b6ea-64ed0399f717 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.293861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65751f81-6c93-4d1e-b6ea-64ed0399f717 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.294332 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65751f81-6c93-4d1e-b6ea-64ed0399f717 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.294941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65751f81-6c93-4d1e-b6ea-64ed0399f717 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:13.295243 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65751f81-6c93-4d1e-b6ea-64ed0399f717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:13.296857 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65751f81-6c93-4d1e-b6ea-64ed0399f717 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:13.302655 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 359/703] 10.222.0.52 () {56 vars in 1124 bytes} [Mon Aug 29 20:18:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:13.304213 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65e0db-ee28-4f06-b1e7-55adcad24c9f None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.304499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65e0db-ee28-4f06-b1e7-55adcad24c9f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.304769 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65e0db-ee28-4f06-b1e7-55adcad24c9f None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.306431 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 360/704] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:13.307774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65e0db-ee28-4f06-b1e7-55adcad24c9f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:13.308080 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8629704-97af-46a7-8969-368f96575283 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:13.366395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f41be-5a0c-4761-bacf-5574c16b9cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:13.367608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f41be-5a0c-4761-bacf-5574c16b9cbe None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.367884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f41be-5a0c-4761-bacf-5574c16b9cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.368301 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f41be-5a0c-4761-bacf-5574c16b9cbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.381735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f41be-5a0c-4761-bacf-5574c16b9cbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:13.383214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f41be-5a0c-4761-bacf-5574c16b9cbe None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:13.384601 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:13.400354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-595f41be-5a0c-4761-bacf-5574c16b9cbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:13.400354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:13.400354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:13.400354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:13.400354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:13.400354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:13.400354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:13.400354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:13.400354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:13.400354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:13.400354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:13.400354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:13.400354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:13.400354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:13.400354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:13.400354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:13.401340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:13.401340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:13.401340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:13.401340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:13.401340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:13.401340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:13.401340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:13.401340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:13.401340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:13.401340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:13.401340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:13.401340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:13.401340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:13.401340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:13.401340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:13.401340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:13.401340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:13.402344 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:13.402344 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:13.402344 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:13.402344 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 345/705] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:13.403317 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210ca46-da00-44e6-b866-4ad53b9093c7 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.403317 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210ca46-da00-44e6-b866-4ad53b9093c7 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.403608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210ca46-da00-44e6-b866-4ad53b9093c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.433023 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c210ca46-da00-44e6-b866-4ad53b9093c7 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:13.434261 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c210ca46-da00-44e6-b866-4ad53b9093c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:13.444286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65e0db-ee28-4f06-b1e7-55adcad24c9f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:13.485931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:13.488995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2841ac-0f8c-4b6f-86ea-d3b23a2b70f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:13.489722 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2841ac-0f8c-4b6f-86ea-d3b23a2b70f0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.490235 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2841ac-0f8c-4b6f-86ea-d3b23a2b70f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.490427 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2841ac-0f8c-4b6f-86ea-d3b23a2b70f0 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.491124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2841ac-0f8c-4b6f-86ea-d3b23a2b70f0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:13.491430 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2841ac-0f8c-4b6f-86ea-d3b23a2b70f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:13.492816 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2841ac-0f8c-4b6f-86ea-d3b23a2b70f0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:13.500170 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 361/706] 10.222.0.52 () {56 vars in 1124 bytes} [Mon Aug 29 20:18:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:13.501091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2841ac-0f8c-4b6f-86ea-d3b23a2b70f0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:13.522377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 346/707] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:18:13.666626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2841ac-0f8c-4b6f-86ea-d3b23a2b70f0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:13.695794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:13.704266 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c5578-14a5-46e2-ac0c-6f6caeebeee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:13.704921 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5578-14a5-46e2-ac0c-6f6caeebeee7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.705195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5578-14a5-46e2-ac0c-6f6caeebeee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.705492 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5578-14a5-46e2-ac0c-6f6caeebeee7 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.706128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c5578-14a5-46e2-ac0c-6f6caeebeee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:13.706465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c5578-14a5-46e2-ac0c-6f6caeebeee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:13.707845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c5578-14a5-46e2-ac0c-6f6caeebeee7 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:13.721414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 362/708] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:13.726571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210ca46-da00-44e6-b866-4ad53b9093c7 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:13.830300 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057baf0-8ad6-4026-aa4f-1c56a8f6e7d3 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.831106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057baf0-8ad6-4026-aa4f-1c56a8f6e7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.831602 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057baf0-8ad6-4026-aa4f-1c56a8f6e7d3 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.833416 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 363/709] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:18:13.838449 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a81639-f8dc-4bd3-ad67-fb11f2969a5f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.839043 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a81639-f8dc-4bd3-ad67-fb11f2969a5f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.839510 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a81639-f8dc-4bd3-ad67-fb11f2969a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.850111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210ca46-da00-44e6-b866-4ad53b9093c7 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:13.870997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a5a81639-f8dc-4bd3-ad67-fb11f2969a5f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:13.872797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a5a81639-f8dc-4bd3-ad67-fb11f2969a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:13.887828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf15ea3-8a2d-403a-aced-aec33f5e39aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:13.888368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf15ea3-8a2d-403a-aced-aec33f5e39aa None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.888646 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf15ea3-8a2d-403a-aced-aec33f5e39aa None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.888910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf15ea3-8a2d-403a-aced-aec33f5e39aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.898418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf15ea3-8a2d-403a-aced-aec33f5e39aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:13.898418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf15ea3-8a2d-403a-aced-aec33f5e39aa None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:13.911755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-bbf15ea3-8a2d-403a-aced-aec33f5e39aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:13.911755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:13.911755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:13.911755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:13.911755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:13.911755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:13.911755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:13.911755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:13.911755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:13.911755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:13.911755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:13.911755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:13.911755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:13.911755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:13.911755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:13.912689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:13.912689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:13.912689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:13.912689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:13.912689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:13.912689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:13.912689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:13.912689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:13.912689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:13.912689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:13.912689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:13.912689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:13.912689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:13.912689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:13.912689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:13.912689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:13.912689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:13.914026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:13.914026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:13.914026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:13.914026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:13.914026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:13.914026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:13.914026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:13.914026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:13.914026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 347/710] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:13.918092 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf15ea3-8a2d-403a-aced-aec33f5e39aa None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:13.955815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:13.965758 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 364/711] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:18:13.967081 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a81639-f8dc-4bd3-ad67-fb11f2969a5f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:14.086346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf15ea3-8a2d-403a-aced-aec33f5e39aa None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:14.158602 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecd811-d569-41df-a06b-64769c2010c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:14.159581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecd811-d569-41df-a06b-64769c2010c0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:14.159905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecd811-d569-41df-a06b-64769c2010c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:14.160205 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecd811-d569-41df-a06b-64769c2010c0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:14.160802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ecd811-d569-41df-a06b-64769c2010c0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:14.163769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ecd811-d569-41df-a06b-64769c2010c0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:14.168304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a81639-f8dc-4bd3-ad67-fb11f2969a5f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:14.176517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-42ecd811-d569-41df-a06b-64769c2010c0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:18:14.176517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:14.176517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:14.176517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:14.176517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:14.176517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:14.176517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:14.176517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:14.176517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:18:14.176517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:14.176517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:14.176517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:14.176517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:14.176517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:14.176517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:14.176517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:14.176517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:14.177637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:14.177637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:14.177637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:14.177637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:14.177637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:14.177637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:14.177637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:14.177637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:14.177637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:14.177637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:14.177637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:14.177637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:14.177637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:14.177637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:14.177637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:14.177637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:14.180047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:14.180047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:14.180047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:14.180047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:14.180047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:14.180047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:14.180047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:14.180047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:14.180047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:14.180047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:14.180047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:14.180047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:14.180047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:18:14.180047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:14.180047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 348/712] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:13 2022] GET /identity/v3/services/network => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:14.184275 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecd811-d569-41df-a06b-64769c2010c0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:14.215985 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:14.263539 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd3ffe-5169-4d52-b063-376068c6c867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:14.264160 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd3ffe-5169-4d52-b063-376068c6c867 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:14.264437 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd3ffe-5169-4d52-b063-376068c6c867 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:14.264712 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd3ffe-5169-4d52-b063-376068c6c867 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:14.265459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd3ffe-5169-4d52-b063-376068c6c867 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:14.265769 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd3ffe-5169-4d52-b063-376068c6c867 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:14.267224 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd3ffe-5169-4d52-b063-376068c6c867 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:14.290884 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 365/713] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:14.294376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:14.296445 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd3ffe-5169-4d52-b063-376068c6c867 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:14.300602 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecd811-d569-41df-a06b-64769c2010c0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:14.347450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4969f-3aaf-42e3-a80c-8d71dd148fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:14.348572 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4969f-3aaf-42e3-a80c-8d71dd148fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:14.349040 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4969f-3aaf-42e3-a80c-8d71dd148fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:14.349549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4969f-3aaf-42e3-a80c-8d71dd148fa4 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:14.353392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4969f-3aaf-42e3-a80c-8d71dd148fa4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:14.353934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4969f-3aaf-42e3-a80c-8d71dd148fa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:14.356299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4969f-3aaf-42e3-a80c-8d71dd148fa4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:14.362383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 349/714] 10.222.0.52 () {56 vars in 1112 bytes} [Mon Aug 29 20:18:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:14.363672 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4969f-3aaf-42e3-a80c-8d71dd148fa4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:14.429604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd3ffe-5169-4d52-b063-376068c6c867 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:14.475051 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56670dbf-8679-4c0e-806d-8f663cb7a6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:14.475720 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56670dbf-8679-4c0e-806d-8f663cb7a6dc None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:14.476006 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56670dbf-8679-4c0e-806d-8f663cb7a6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:14.476448 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56670dbf-8679-4c0e-806d-8f663cb7a6dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:14.477583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56670dbf-8679-4c0e-806d-8f663cb7a6dc None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=9c95d16fd4da4fa7987b893eae0b3ef5) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:14.477899 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56670dbf-8679-4c0e-806d-8f663cb7a6dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:14.479655 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56670dbf-8679-4c0e-806d-8f663cb7a6dc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:14.487831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 366/715] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:18:14 2022] GET /identity/v3/role_assignments?user.id=9c95d16fd4da4fa7987b893eae0b3ef5&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:14.488736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56670dbf-8679-4c0e-806d-8f663cb7a6dc None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:14.488960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4969f-3aaf-42e3-a80c-8d71dd148fa4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:14.541760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c69778-a990-4300-a14b-85f5d344146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:14.542456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c69778-a990-4300-a14b-85f5d344146a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:14.542734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c69778-a990-4300-a14b-85f5d344146a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:14.543009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c69778-a990-4300-a14b-85f5d344146a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:14.549200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:14.561060 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c69778-a990-4300-a14b-85f5d344146a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:14.562895 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c69778-a990-4300-a14b-85f5d344146a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:14.583243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-c1c69778-a990-4300-a14b-85f5d344146a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:14.583243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:14.583243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:14.583243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:14.583243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:14.583243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:14.583243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:14.583243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:14.583243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:14.583243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:14.583243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:14.583243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:14.583243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:14.583243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:14.583243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:14.583243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:14.584427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:14.584427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:14.584427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:14.584427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:14.584427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:14.584427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:14.584427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:14.584427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:14.584427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:14.584427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:14.584427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:14.584427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:14.584427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:14.584427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:14.584427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:14.584427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:14.584427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:14.586550 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:14.586550 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:14.586550 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:14.586550 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 350/716] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:14.591059 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c69778-a990-4300-a14b-85f5d344146a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:14.611806 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:14.699349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56670dbf-8679-4c0e-806d-8f663cb7a6dc None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:14.752677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c69778-a990-4300-a14b-85f5d344146a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:14.758898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1aed4-a805-49a2-baf0-9e15b090fdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:14.759537 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1aed4-a805-49a2-baf0-9e15b090fdb9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:14.759816 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1aed4-a805-49a2-baf0-9e15b090fdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:14.760089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1aed4-a805-49a2-baf0-9e15b090fdb9 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:14.760745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1aed4-a805-49a2-baf0-9e15b090fdb9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:14.761052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1aed4-a805-49a2-baf0-9e15b090fdb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:14.763751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1aed4-a805-49a2-baf0-9e15b090fdb9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:14.770980 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 367/717] 10.222.0.52 () {56 vars in 1112 bytes} [Mon Aug 29 20:18:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:14.826243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61e3ee-d41e-4874-a050-aa4e10b3721e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:14.826964 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61e3ee-d41e-4874-a050-aa4e10b3721e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:14.827135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61e3ee-d41e-4874-a050-aa4e10b3721e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:14.827409 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61e3ee-d41e-4874-a050-aa4e10b3721e None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:14.828070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61e3ee-d41e-4874-a050-aa4e10b3721e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:14.828370 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61e3ee-d41e-4874-a050-aa4e10b3721e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:14.829836 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61e3ee-d41e-4874-a050-aa4e10b3721e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:14.853054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 351/718] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:14.858946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1aed4-a805-49a2-baf0-9e15b090fdb9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:15.011536 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1aed4-a805-49a2-baf0-9e15b090fdb9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:15.024142 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:15.065112 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9469575-14e8-4089-b890-48a021d8395c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:15.065761 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9469575-14e8-4089-b890-48a021d8395c None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:15.066045 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9469575-14e8-4089-b890-48a021d8395c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:15.066316 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9469575-14e8-4089-b890-48a021d8395c None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:15.066996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9469575-14e8-4089-b890-48a021d8395c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:15.068472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9469575-14e8-4089-b890-48a021d8395c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:15.102483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 368/719] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:18:14 2022] POST /identity/v3/users => generated 254 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:18:15.503256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18418b8-f685-4445-9d39-5bb16a32a30c None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:15.503966 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18418b8-f685-4445-9d39-5bb16a32a30c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:15.503966 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18418b8-f685-4445-9d39-5bb16a32a30c None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:15.505332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 352/720] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:15.511036 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cb8c2-387f-431a-a1be-5a83fb660b51 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:15.511319 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cb8c2-387f-431a-a1be-5a83fb660b51 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:15.511591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cb8c2-387f-431a-a1be-5a83fb660b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:15.536650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-874cb8c2-387f-431a-a1be-5a83fb660b51 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:15.537907 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-874cb8c2-387f-431a-a1be-5a83fb660b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:15.620770 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 369/721] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:18:15.933096 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49384c8d-bc4b-4741-ba2d-d082ace59460 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:15.933779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49384c8d-bc4b-4741-ba2d-d082ace59460 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:15.934278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49384c8d-bc4b-4741-ba2d-d082ace59460 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:15.936249 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 353/722] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:15.942458 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215fbc3-233c-405a-9b90-34f40ca90668 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:15.943015 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215fbc3-233c-405a-9b90-34f40ca90668 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:15.943617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215fbc3-233c-405a-9b90-34f40ca90668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:15.967232 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7215fbc3-233c-405a-9b90-34f40ca90668 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:15.969071 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7215fbc3-233c-405a-9b90-34f40ca90668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:16.021961 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49384c8d-bc4b-4741-ba2d-d082ace59460 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:16.067664 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 370/723] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:18:16.104198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:16.132521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49384c8d-bc4b-4741-ba2d-d082ace59460 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:16.174683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6b1e4-08a7-45bb-bd82-0f84b81820ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:16.175330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6b1e4-08a7-45bb-bd82-0f84b81820ad None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:16.175609 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6b1e4-08a7-45bb-bd82-0f84b81820ad None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:16.175882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6b1e4-08a7-45bb-bd82-0f84b81820ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:16.196256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6b1e4-08a7-45bb-bd82-0f84b81820ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:16.203117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-cbb6b1e4-08a7-45bb-bd82-0f84b81820ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:18:16.203117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:16.203117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:16.203117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:16.203117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:16.203117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:16.203117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:16.203117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:16.203117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:16.203117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:16.203117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:16.203117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:16.203117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:16.203117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:16.203117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:16.203117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:16.204070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:16.204070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:16.204070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:16.204070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:16.204070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:16.204070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:16.204070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:16.204070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:16.204070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:16.204070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:16.204070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:16.204070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:16.204070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:16.204070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:16.204070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:16.204070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:16.205340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:16.205340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:16.205340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:16.205340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:16.205340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:16.205340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:16.205340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:16.205340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:16.205340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:16.205340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:16.205340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:18:16.205340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:16.205340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 354/724] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:18:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:16.213134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215fbc3-233c-405a-9b90-34f40ca90668 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:16.255155 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:16.367008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6b1e4-08a7-45bb-bd82-0f84b81820ad None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:16.373545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215fbc3-233c-405a-9b90-34f40ca90668 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:16.454782 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ce8a0-3b77-4ac4-ab98-33a498bd95d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:16.455330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ce8a0-3b77-4ac4-ab98-33a498bd95d0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:16.455611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ce8a0-3b77-4ac4-ab98-33a498bd95d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:16.455881 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ce8a0-3b77-4ac4-ab98-33a498bd95d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:16.456568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ce8a0-3b77-4ac4-ab98-33a498bd95d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:16.456872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ce8a0-3b77-4ac4-ab98-33a498bd95d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:16.458472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ce8a0-3b77-4ac4-ab98-33a498bd95d0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:16.482020 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 371/725] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:18:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:16.487044 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ce8a0-3b77-4ac4-ab98-33a498bd95d0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:16.536383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6b1e4-08a7-45bb-bd82-0f84b81820ad None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:16.615351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47b2c3-0924-4d21-953d-83eed1592a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:16.616107 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47b2c3-0924-4d21-953d-83eed1592a79 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:16.616407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47b2c3-0924-4d21-953d-83eed1592a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:16.617045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47b2c3-0924-4d21-953d-83eed1592a79 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:16.619833 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47b2c3-0924-4d21-953d-83eed1592a79 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:16.621588 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47b2c3-0924-4d21-953d-83eed1592a79 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:16.626682 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:16.655108 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 355/726] 10.222.0.52 () {60 vars in 1141 bytes} [Mon Aug 29 20:18:16 2022] POST /identity/v3/services => generated 251 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:18:16.712213 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ce8a0-3b77-4ac4-ab98-33a498bd95d0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:16.714114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:16.798786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c47230-c293-44d2-8040-f8987c945f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:16.799474 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c47230-c293-44d2-8040-f8987c945f9f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:16.799755 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c47230-c293-44d2-8040-f8987c945f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:16.800028 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c47230-c293-44d2-8040-f8987c945f9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:16.800875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06ccf5-f9f1-4048-b325-da6c4c58f27e None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:16.801397 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06ccf5-f9f1-4048-b325-da6c4c58f27e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:16.801870 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06ccf5-f9f1-4048-b325-da6c4c58f27e None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:16.803788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 356/727] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:18:16.809830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896e8a0-ccd2-4c65-9cb3-7087464b2c6a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:16.810484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896e8a0-ccd2-4c65-9cb3-7087464b2c6a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:16.810953 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896e8a0-ccd2-4c65-9cb3-7087464b2c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:16.817054 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c47230-c293-44d2-8040-f8987c945f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:16.818658 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c47230-c293-44d2-8040-f8987c945f9f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:16.831683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1896e8a0-ccd2-4c65-9cb3-7087464b2c6a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:16.833294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1896e8a0-ccd2-4c65-9cb3-7087464b2c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:16.848062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-79c47230-c293-44d2-8040-f8987c945f9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:16.848062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:16.848062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:16.848062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:16.848062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:16.848062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:16.848062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:16.848062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:16.848062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:16.848062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:16.848062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:16.848062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:16.848062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:16.848062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:16.848062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:16.848062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:16.849216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:16.849216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:16.849216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:16.849216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:16.849216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:16.849216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:16.849216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:16.849216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:16.849216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:16.849216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:16.849216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:16.849216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:16.849216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:16.849216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:16.849216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:16.849216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:16.849216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:16.850273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:16.850273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:16.850273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:16.850273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 372/728] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:16.854075 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c47230-c293-44d2-8040-f8987c945f9f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:16.933141 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 357/729] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:18:17.010839 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c47230-c293-44d2-8040-f8987c945f9f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:17.043510 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:17.049289 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ec410-a97b-4f29-8a70-231fe8e2430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:17.049960 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ec410-a97b-4f29-8a70-231fe8e2430a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:17.050524 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ec410-a97b-4f29-8a70-231fe8e2430a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:17.051151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ec410-a97b-4f29-8a70-231fe8e2430a None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:17.051861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ec410-a97b-4f29-8a70-231fe8e2430a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:17.052169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ec410-a97b-4f29-8a70-231fe8e2430a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:17.053844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ec410-a97b-4f29-8a70-231fe8e2430a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:17.069735 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 373/730] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:17.075679 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896e8a0-ccd2-4c65-9cb3-7087464b2c6a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:17.209412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896e8a0-ccd2-4c65-9cb3-7087464b2c6a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:17.244860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:17.269764 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f3029-5abc-4b2e-b7be-cb0cb9aac3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:17.270760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f3029-5abc-4b2e-b7be-cb0cb9aac3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:17.271260 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f3029-5abc-4b2e-b7be-cb0cb9aac3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:17.271745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f3029-5abc-4b2e-b7be-cb0cb9aac3f8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:17.287504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ec410-a97b-4f29-8a70-231fe8e2430a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:17.294233 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f3029-5abc-4b2e-b7be-cb0cb9aac3f8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:17.297031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f3029-5abc-4b2e-b7be-cb0cb9aac3f8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:17.325931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-dc8f3029-5abc-4b2e-b7be-cb0cb9aac3f8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:18:17.325931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:17.325931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:17.325931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:17.325931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:17.325931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:17.325931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:17.325931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:17.325931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:17.325931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:17.325931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:17.325931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:17.325931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:17.325931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:17.325931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:17.325931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:17.326979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:17.328227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:17.328227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:17.328227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:17.328227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:17.328227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:17.328227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:17.328227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:17.328227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:17.328227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:18:17.328227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:17.328227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 358/731] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:18:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:17.336191 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f3029-5abc-4b2e-b7be-cb0cb9aac3f8 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:17.465767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ec410-a97b-4f29-8a70-231fe8e2430a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:17.530757 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70846b02-a172-4fb3-b31d-9cd7331c4cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:17.531431 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70846b02-a172-4fb3-b31d-9cd7331c4cfb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:17.531716 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70846b02-a172-4fb3-b31d-9cd7331c4cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:17.532094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70846b02-a172-4fb3-b31d-9cd7331c4cfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:17.535181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f3029-5abc-4b2e-b7be-cb0cb9aac3f8 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:17.543815 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70846b02-a172-4fb3-b31d-9cd7331c4cfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:17.549371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-70846b02-a172-4fb3-b31d-9cd7331c4cfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:18:17.549371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:17.549371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:17.549371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:17.549371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:17.549371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:17.549371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:17.549371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:17.549371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:17.549371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:17.549371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:17.549371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:17.549371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:17.549371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:17.549371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:17.549371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:17.550325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:17.550325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:17.550325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:17.550325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:17.550325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:17.550325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:17.550325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:17.550325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:17.550325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:17.550325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:17.550325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:17.550325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:17.550325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:17.550325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:17.550325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:17.550325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:17.551185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:17.551185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:17.551185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:17.551185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:17.551185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:17.551185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:17.551185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:17.551185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:17.551185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:17.551185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:17.551185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:18:17.551185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:17.551185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 374/732] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:18:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:17.552359 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab16ca9-b033-4f65-829b-53feb7d77a53 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:17.552519 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab16ca9-b033-4f65-829b-53feb7d77a53 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:17.552850 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab16ca9-b033-4f65-829b-53feb7d77a53 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:17.558383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 375/733] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:17.559180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab16ca9-b033-4f65-829b-53feb7d77a53 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:17.581861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21123691-0ded-4901-95ad-0b49ac394981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:17.582530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21123691-0ded-4901-95ad-0b49ac394981 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:17.582757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21123691-0ded-4901-95ad-0b49ac394981 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:17.583099 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21123691-0ded-4901-95ad-0b49ac394981 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:17.583838 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21123691-0ded-4901-95ad-0b49ac394981 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:17.584142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21123691-0ded-4901-95ad-0b49ac394981 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:17.585723 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21123691-0ded-4901-95ad-0b49ac394981 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:17.612349 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 359/734] 10.222.0.52 () {56 vars in 1135 bytes} [Mon Aug 29 20:18:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:17.612349 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b9b93-f6d4-4c0a-b863-867ee846719b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:17.612349 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b9b93-f6d4-4c0a-b863-867ee846719b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:17.612349 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b9b93-f6d4-4c0a-b863-867ee846719b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:17.630726 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c44b9b93-f6d4-4c0a-b863-867ee846719b None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:17.632025 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c44b9b93-f6d4-4c0a-b863-867ee846719b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:17.637271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:17.682521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:17.700411 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab16ca9-b033-4f65-829b-53feb7d77a53 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:17.733660 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 360/735] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:18:17.734671 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b9b93-f6d4-4c0a-b863-867ee846719b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:17.748606 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7766d8-c6fb-40de-932b-d8ea9708cd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:17.750179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7766d8-c6fb-40de-932b-d8ea9708cd9e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:17.750821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7766d8-c6fb-40de-932b-d8ea9708cd9e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:17.751440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7766d8-c6fb-40de-932b-d8ea9708cd9e None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:17.754247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7766d8-c6fb-40de-932b-d8ea9708cd9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:17.754840 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7766d8-c6fb-40de-932b-d8ea9708cd9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:17.756472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7766d8-c6fb-40de-932b-d8ea9708cd9e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:17.781570 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 376/736] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:18:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:17.782554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7766d8-c6fb-40de-932b-d8ea9708cd9e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:17.915650 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b9b93-f6d4-4c0a-b863-867ee846719b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:17.963365 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed17c48-f2c7-4106-9659-3da414e7d23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:17.964382 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed17c48-f2c7-4106-9659-3da414e7d23c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:17.964865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed17c48-f2c7-4106-9659-3da414e7d23c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:17.965331 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed17c48-f2c7-4106-9659-3da414e7d23c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:17.982340 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7766d8-c6fb-40de-932b-d8ea9708cd9e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:18.012469 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:18.044097 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:18.056437 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6adca-0c34-42fc-be25-887192dd791b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:18.058136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6adca-0c34-42fc-be25-887192dd791b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:18.058425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6adca-0c34-42fc-be25-887192dd791b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:18.058710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6adca-0c34-42fc-be25-887192dd791b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:18.071584 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6adca-0c34-42fc-be25-887192dd791b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:18.073287 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6adca-0c34-42fc-be25-887192dd791b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:18.086725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed17c48-f2c7-4106-9659-3da414e7d23c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:18.088194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed17c48-f2c7-4106-9659-3da414e7d23c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:18.088522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-fbc6adca-0c34-42fc-be25-887192dd791b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:18.088522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:18.088522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:18.088522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:18.088522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:18.088522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:18.088522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:18.088522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:18.088522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:18.088522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:18.088522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:18.088522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:18.088522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:18.088522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:18.088522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:18.088522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:18.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:18.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:18.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:18.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:18.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:18.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:18.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:18.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:18.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:18.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:18.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:18.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:18.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:18.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:18.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:18.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:18.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:18.090467 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:18.090467 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:18.090467 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:18.090467 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 377/737] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:18.091303 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6adca-0c34-42fc-be25-887192dd791b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:18.204468 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6adca-0c34-42fc-be25-887192dd791b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:18.228448 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 361/738] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:18:17 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:18:18.228448 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cb026-3277-40a2-8810-459fa5f4db3f None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:18.228448 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cb026-3277-40a2-8810-459fa5f4db3f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:18.228448 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cb026-3277-40a2-8810-459fa5f4db3f None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:18.229995 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 362/739] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:18.231329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cb026-3277-40a2-8810-459fa5f4db3f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:18.250098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ace4fb-4eb6-4c36-81e8-9ab294d6727b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:18.251127 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace4fb-4eb6-4c36-81e8-9ab294d6727b None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:18.251596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace4fb-4eb6-4c36-81e8-9ab294d6727b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:18.252095 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace4fb-4eb6-4c36-81e8-9ab294d6727b None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:18.253274 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ace4fb-4eb6-4c36-81e8-9ab294d6727b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:18.255909 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ace4fb-4eb6-4c36-81e8-9ab294d6727b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:18.278011 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 378/740] 10.222.0.52 () {60 vars in 1141 bytes} [Mon Aug 29 20:18:18 2022] POST /identity/v3/services => generated 240 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:18:18.279372 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ace4fb-4eb6-4c36-81e8-9ab294d6727b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:18.325917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:18.342328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:18.396033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cb026-3277-40a2-8810-459fa5f4db3f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:18.428281 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ace4fb-4eb6-4c36-81e8-9ab294d6727b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:18.438047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1ac92-0ab7-4d39-8636-80364faa11e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:18.439015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ac92-0ab7-4d39-8636-80364faa11e1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:18.439603 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ac92-0ab7-4d39-8636-80364faa11e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:18.440148 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ac92-0ab7-4d39-8636-80364faa11e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:18.440985 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1ac92-0ab7-4d39-8636-80364faa11e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:18.441288 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1ac92-0ab7-4d39-8636-80364faa11e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:18.442952 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1ac92-0ab7-4d39-8636-80364faa11e1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:18.459129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 363/741] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:18.460065 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c280550-1784-4867-b609-6e16e5622f49 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:18.460358 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c280550-1784-4867-b609-6e16e5622f49 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:18.460633 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c280550-1784-4867-b609-6e16e5622f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:18.479125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a6789-6d57-4de5-aa27-64a4b2343676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:18.479826 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a6789-6d57-4de5-aa27-64a4b2343676 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:18.480104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a6789-6d57-4de5-aa27-64a4b2343676 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:18.480374 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a6789-6d57-4de5-aa27-64a4b2343676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:18.484389 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3c280550-1784-4867-b609-6e16e5622f49 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:18.485109 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3c280550-1784-4867-b609-6e16e5622f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:18.494467 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a6789-6d57-4de5-aa27-64a4b2343676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:18.496361 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a6789-6d57-4de5-aa27-64a4b2343676 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:18.514000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-fa6a6789-6d57-4de5-aa27-64a4b2343676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:18.514000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:18.514000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:18.514000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:18.514000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:18.514000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:18.514000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:18.514000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:18.514000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:18.514000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:18.514000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:18.514000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:18.514000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:18.514000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:18.514000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:18.514000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:18.515130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:18.515130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:18.515130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:18.515130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:18.515130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:18.515130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:18.515130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:18.515130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:18.515130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:18.515130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:18.515130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:18.515130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:18.515130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:18.515130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:18.515130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:18.515130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:18.515130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:18.516136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:18.516136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:18.516136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:18.517520 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 379/742] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:18.518668 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a6789-6d57-4de5-aa27-64a4b2343676 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:18.582437 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 364/743] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:18.585848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c280550-1784-4867-b609-6e16e5622f49 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:18.659134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:18.706687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a6789-6d57-4de5-aa27-64a4b2343676 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:18.708630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:18.760320 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c280550-1784-4867-b609-6e16e5622f49 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:18.773000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb7305-a5f0-4223-bee0-80e2a10458c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:18.773707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb7305-a5f0-4223-bee0-80e2a10458c7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:18.773986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb7305-a5f0-4223-bee0-80e2a10458c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:18.774254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb7305-a5f0-4223-bee0-80e2a10458c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:18.785933 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb7305-a5f0-4223-bee0-80e2a10458c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:18.787431 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb7305-a5f0-4223-bee0-80e2a10458c7 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:18.800606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e7604-3ec3-4033-aa96-e29674036954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:18.801501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e7604-3ec3-4033-aa96-e29674036954 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:18.801927 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e7604-3ec3-4033-aa96-e29674036954 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:18.802368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e7604-3ec3-4033-aa96-e29674036954 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:18.803165 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e7604-3ec3-4033-aa96-e29674036954 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:18.803629 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e7604-3ec3-4033-aa96-e29674036954 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:18.805166 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e7604-3ec3-4033-aa96-e29674036954 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:18.813102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-b8eb7305-a5f0-4223-bee0-80e2a10458c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:18:18.813102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:18.813102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:18.813102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:18.813102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:18.813102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:18.813102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:18.813102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:18.813102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:18.813102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:18.813102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:18.813102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:18.813102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:18.813102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:18.813102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:18.813102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:18.814357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:18.815383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:18.815383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:18.815383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:18.815383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:18.815383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:18.815383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:18.815383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:18.815383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:18.815383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:18:18.815383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:18.815383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 380/744] 10.222.0.52 () {56 vars in 1093 bytes} [Mon Aug 29 20:18:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:18.820575 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb7305-a5f0-4223-bee0-80e2a10458c7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:18.822064 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 365/745] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:18.827728 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e7604-3ec3-4033-aa96-e29674036954 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:18.987581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e7604-3ec3-4033-aa96-e29674036954 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:19.008627 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:19.031365 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915b752-3474-4d10-acc7-ff4ec26353e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:19.032375 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915b752-3474-4d10-acc7-ff4ec26353e2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:19.032735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915b752-3474-4d10-acc7-ff4ec26353e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:19.033178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915b752-3474-4d10-acc7-ff4ec26353e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:19.039333 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb7305-a5f0-4223-bee0-80e2a10458c7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:19.042796 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915b752-3474-4d10-acc7-ff4ec26353e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:19.044459 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915b752-3474-4d10-acc7-ff4ec26353e2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:19.058277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-2915b752-3474-4d10-acc7-ff4ec26353e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:19.058277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:19.058277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:19.058277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:19.058277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:19.058277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:19.058277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:19.058277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:19.058277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:19.058277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:19.058277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:19.058277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:19.058277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:19.058277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:19.058277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:19.059736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:19.059736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:19.059736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:19.059736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:19.059736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:19.059736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:19.059736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:19.059736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:19.059736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:19.059736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:19.059736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:19.059736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:19.059736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:19.059736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:19.059736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:19.059736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:19.059736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:19.060792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:19.060792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:19.060792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:19.060792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:19.060792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:19.060792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:19.060792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:19.060792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:19.060792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 366/746] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:19.067150 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915b752-3474-4d10-acc7-ff4ec26353e2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:19.084385 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbc07d-ccdd-46cc-ac9f-bb0b3280847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:19.085102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbc07d-ccdd-46cc-ac9f-bb0b3280847a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:19.085402 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbc07d-ccdd-46cc-ac9f-bb0b3280847a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:19.085692 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbc07d-ccdd-46cc-ac9f-bb0b3280847a None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:19.086442 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbc07d-ccdd-46cc-ac9f-bb0b3280847a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:19.086739 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbc07d-ccdd-46cc-ac9f-bb0b3280847a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:19.088480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbc07d-ccdd-46cc-ac9f-bb0b3280847a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:19.099836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:19.117440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 381/747] 10.222.0.52 () {56 vars in 1133 bytes} [Mon Aug 29 20:18:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:19.118470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbc07d-ccdd-46cc-ac9f-bb0b3280847a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:19.191610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915b752-3474-4d10-acc7-ff4ec26353e2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:19.233774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751720ab-170f-4842-80a0-ef87c099dfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:19.234117 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbc07d-ccdd-46cc-ac9f-bb0b3280847a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:19.234908 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751720ab-170f-4842-80a0-ef87c099dfba None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:19.235351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751720ab-170f-4842-80a0-ef87c099dfba None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:19.236032 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751720ab-170f-4842-80a0-ef87c099dfba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:19.252609 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751720ab-170f-4842-80a0-ef87c099dfba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:19.259388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-751720ab-170f-4842-80a0-ef87c099dfba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:19.259388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:19.259388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:19.259388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:19.259388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:19.259388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:19.259388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:19.259388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:19.259388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:19.259388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:19.259388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:19.259388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:19.259388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:19.259388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:19.259388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:19.259388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:19.260406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:19.260406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:19.260406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:19.260406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:19.260406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:19.260406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:19.260406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:19.260406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:19.260406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:19.260406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:19.260406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:19.260406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:19.260406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:19.260406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:19.260406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:19.260406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:19.261219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:19.261219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:19.261219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:19.261219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:19.261219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:19.261219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:19.261219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:19.261219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:19.261219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:19.261219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:19.261219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:19.261219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:19.263208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 367/748] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:18:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:19.264108 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751720ab-170f-4842-80a0-ef87c099dfba None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:19.284921 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6563c-7a2c-4850-9168-d8bf878ce5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:19.285597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6563c-7a2c-4850-9168-d8bf878ce5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:19.285888 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6563c-7a2c-4850-9168-d8bf878ce5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:19.286116 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6563c-7a2c-4850-9168-d8bf878ce5d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:19.286817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6563c-7a2c-4850-9168-d8bf878ce5d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:19.287112 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6563c-7a2c-4850-9168-d8bf878ce5d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:19.288577 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6563c-7a2c-4850-9168-d8bf878ce5d6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:19.306106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 382/749] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:19.307473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754c2fd-e597-41cf-8f70-690d38498ff1 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:19.307754 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754c2fd-e597-41cf-8f70-690d38498ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:19.308017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754c2fd-e597-41cf-8f70-690d38498ff1 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:19.309449 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 383/750] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:19.313562 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754c2fd-e597-41cf-8f70-690d38498ff1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:19.319071 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:19.385252 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:19.395738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751720ab-170f-4842-80a0-ef87c099dfba None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:19.445790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85378e4-dca3-42c6-8a68-44cbe455779c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:19.446188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754c2fd-e597-41cf-8f70-690d38498ff1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:19.446794 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85378e4-dca3-42c6-8a68-44cbe455779c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:19.447137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85378e4-dca3-42c6-8a68-44cbe455779c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:19.447474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85378e4-dca3-42c6-8a68-44cbe455779c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:19.465070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85378e4-dca3-42c6-8a68-44cbe455779c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:19.466974 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85378e4-dca3-42c6-8a68-44cbe455779c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:19.483552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-b85378e4-dca3-42c6-8a68-44cbe455779c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:19.483552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:19.483552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:19.483552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:19.483552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:19.483552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:19.483552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:19.483552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:19.483552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:19.483552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:19.483552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:19.483552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:19.483552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:19.483552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:19.483552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:19.483552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:19.484593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:19.484593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:19.484593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:19.484593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:19.484593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:19.484593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:19.484593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:19.484593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:19.484593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:19.484593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:19.484593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:19.484593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:19.484593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:19.484593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:19.484593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:19.484593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:19.484593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:19.485738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:19.485738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:19.485738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:19.485738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 368/751] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:19.485738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85378e4-dca3-42c6-8a68-44cbe455779c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:19.493733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab3b19-eafb-4d85-aafd-b836d5e4f53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:19.494356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab3b19-eafb-4d85-aafd-b836d5e4f53e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:19.494632 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab3b19-eafb-4d85-aafd-b836d5e4f53e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:19.494894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab3b19-eafb-4d85-aafd-b836d5e4f53e None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:19.495559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab3b19-eafb-4d85-aafd-b836d5e4f53e None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:19.495855 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab3b19-eafb-4d85-aafd-b836d5e4f53e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:19.497989 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab3b19-eafb-4d85-aafd-b836d5e4f53e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:19.511834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 384/752] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:18:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:19.511834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780c013-b4a9-448f-a3d2-c13dfba4e360 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:19.511834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780c013-b4a9-448f-a3d2-c13dfba4e360 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:19.511834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780c013-b4a9-448f-a3d2-c13dfba4e360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:19.530168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e780c013-b4a9-448f-a3d2-c13dfba4e360 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:19.531403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e780c013-b4a9-448f-a3d2-c13dfba4e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:19.604773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:19.613564 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 385/753] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:19.613564 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780c013-b4a9-448f-a3d2-c13dfba4e360 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:19.624000 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85378e4-dca3-42c6-8a68-44cbe455779c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:19.665089 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5252e86-9523-4239-bc3c-a369fa63ca2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:19.666045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5252e86-9523-4239-bc3c-a369fa63ca2c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:19.666506 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5252e86-9523-4239-bc3c-a369fa63ca2c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:19.666956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5252e86-9523-4239-bc3c-a369fa63ca2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:19.668056 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5252e86-9523-4239-bc3c-a369fa63ca2c None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=dcb9791ea73d46b191ad9fc146297565) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:19.668700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5252e86-9523-4239-bc3c-a369fa63ca2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:19.670436 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5252e86-9523-4239-bc3c-a369fa63ca2c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:19.676250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:19.679379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 369/754] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:18:19 2022] GET /identity/v3/role_assignments?user.id=dcb9791ea73d46b191ad9fc146297565&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:19.680460 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5252e86-9523-4239-bc3c-a369fa63ca2c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:19.807640 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780c013-b4a9-448f-a3d2-c13dfba4e360 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:19.878370 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5252e86-9523-4239-bc3c-a369fa63ca2c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:19.902074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd36df-2c06-49fa-af78-f7b8b348e431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:19.902891 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd36df-2c06-49fa-af78-f7b8b348e431 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:19.903213 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd36df-2c06-49fa-af78-f7b8b348e431 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:19.903666 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd36df-2c06-49fa-af78-f7b8b348e431 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:19.904334 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd36df-2c06-49fa-af78-f7b8b348e431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:19.904634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd36df-2c06-49fa-af78-f7b8b348e431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:19.906218 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd36df-2c06-49fa-af78-f7b8b348e431 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:19.922514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 386/755] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:19.923452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd36df-2c06-49fa-af78-f7b8b348e431 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:19.940827 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1d16b-a491-4611-9d1b-09e9a51bd049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:19.941520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1d16b-a491-4611-9d1b-09e9a51bd049 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:19.941797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1d16b-a491-4611-9d1b-09e9a51bd049 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:19.942065 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1d16b-a491-4611-9d1b-09e9a51bd049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:19.959997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1d16b-a491-4611-9d1b-09e9a51bd049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:19.962043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1d16b-a491-4611-9d1b-09e9a51bd049 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:19.982356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-f1f1d16b-a491-4611-9d1b-09e9a51bd049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:19.982356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:19.982356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:19.982356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:19.982356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:19.982356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:19.982356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:19.982356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:19.982356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:19.982356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:19.982356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:19.982356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:19.982356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:19.982356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:19.982356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:19.982356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:19.983443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:19.983443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:19.983443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:19.983443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:19.983443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:19.983443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:19.983443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:19.983443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:19.983443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:19.983443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:19.983443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:19.983443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:19.983443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:19.983443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:19.983443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:19.983443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:19.983443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:19.984399 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:19.984399 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:19.984399 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:19.986859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 370/756] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:19.988234 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1d16b-a491-4611-9d1b-09e9a51bd049 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:19.999941 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:20.062545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd36df-2c06-49fa-af78-f7b8b348e431 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:20.075981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:20.105127 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f864b3-d588-4a97-9225-064790013b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:20.106002 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f864b3-d588-4a97-9225-064790013b4a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:20.106408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f864b3-d588-4a97-9225-064790013b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:20.106795 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f864b3-d588-4a97-9225-064790013b4a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:20.107413 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f864b3-d588-4a97-9225-064790013b4a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:20.108969 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f864b3-d588-4a97-9225-064790013b4a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:20.119157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-13f864b3-d588-4a97-9225-064790013b4a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:18:20.119157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:20.119157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:20.119157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:20.119157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:20.119157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:20.119157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:20.119157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:20.119157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:18:20.119157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:20.119157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:20.119157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:20.119157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:20.119157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:20.119157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:20.119157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:20.119157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:20.120182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:20.120182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:20.120182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:20.120182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:20.120182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:20.120182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:20.120182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:20.120182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:20.120182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:20.120182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:20.120182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:20.120182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:20.120182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:20.120182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:20.120182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:20.120182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:20.127061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:20.127061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:20.127061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:20.127061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:20.127061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:20.127061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:20.127061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:20.127061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:20.127061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:20.127061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:20.127061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:20.127061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:20.127061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:18:20.127061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:20.127061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 387/757] 10.222.0.52 () {56 vars in 1129 bytes} [Mon Aug 29 20:18:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:20.127964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f864b3-d588-4a97-9225-064790013b4a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:20.130227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1d16b-a491-4611-9d1b-09e9a51bd049 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:20.178735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d05fa5-bf10-4c65-9d56-10bc4fcaf212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:20.180035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d05fa5-bf10-4c65-9d56-10bc4fcaf212 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:20.180526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d05fa5-bf10-4c65-9d56-10bc4fcaf212 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:20.180810 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d05fa5-bf10-4c65-9d56-10bc4fcaf212 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:20.191814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d05fa5-bf10-4c65-9d56-10bc4fcaf212 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:20.194108 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d05fa5-bf10-4c65-9d56-10bc4fcaf212 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:20.211449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-93d05fa5-bf10-4c65-9d56-10bc4fcaf212 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:20.211449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:20.211449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:20.211449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:20.211449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:20.211449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:20.211449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:20.211449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:20.211449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:20.211449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:20.211449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:20.211449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:20.211449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:20.211449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:20.211449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:20.212491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:20.212491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:20.212491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:20.212491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:20.212491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:20.212491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:20.212491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:20.212491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:20.212491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:20.212491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:20.212491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:20.212491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:20.212491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:20.212491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:20.212491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:20.212491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:20.212491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:20.213706 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:20.213706 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:20.213706 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:20.213706 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:20.213706 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:20.213706 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:20.213706 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:20.213706 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:20.217501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 371/758] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:20.219358 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d05fa5-bf10-4c65-9d56-10bc4fcaf212 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:20.278405 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f864b3-d588-4a97-9225-064790013b4a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:20.314703 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:20.328516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03d96c-4bc9-4d83-aae6-d73759944b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:20.329139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03d96c-4bc9-4d83-aae6-d73759944b23 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:20.329446 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03d96c-4bc9-4d83-aae6-d73759944b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:20.329723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03d96c-4bc9-4d83-aae6-d73759944b23 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:20.330381 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03d96c-4bc9-4d83-aae6-d73759944b23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:20.330739 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03d96c-4bc9-4d83-aae6-d73759944b23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:20.333603 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03d96c-4bc9-4d83-aae6-d73759944b23 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:20.357807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 388/759] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:20.359202 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03d96c-4bc9-4d83-aae6-d73759944b23 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:20.384612 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d05fa5-bf10-4c65-9d56-10bc4fcaf212 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:20.393815 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:20.429543 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e378e-529b-40f8-98c3-48acbbbbca27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:20.430688 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e378e-529b-40f8-98c3-48acbbbbca27 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:20.431491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e378e-529b-40f8-98c3-48acbbbbca27 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:20.432273 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e378e-529b-40f8-98c3-48acbbbbca27 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:20.433535 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e378e-529b-40f8-98c3-48acbbbbca27 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:20.434786 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e378e-529b-40f8-98c3-48acbbbbca27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:20.436537 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e378e-529b-40f8-98c3-48acbbbbca27 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:20.441979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 372/760] 10.222.0.52 () {56 vars in 1124 bytes} [Mon Aug 29 20:18:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:20.443050 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e378e-529b-40f8-98c3-48acbbbbca27 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:20.478021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03d96c-4bc9-4d83-aae6-d73759944b23 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:20.514955 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc4df7-3c99-4f00-aa07-9eb0341525c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:20.515603 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc4df7-3c99-4f00-aa07-9eb0341525c8 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:20.515884 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc4df7-3c99-4f00-aa07-9eb0341525c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:20.516155 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc4df7-3c99-4f00-aa07-9eb0341525c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:20.516855 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc4df7-3c99-4f00-aa07-9eb0341525c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:20.517152 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc4df7-3c99-4f00-aa07-9eb0341525c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:20.518661 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc4df7-3c99-4f00-aa07-9eb0341525c8 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:20.536522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 389/761] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:20.536522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44facc2-4e83-4161-8e4b-6ff453fbdfb4 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:20.536522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44facc2-4e83-4161-8e4b-6ff453fbdfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:20.536522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44facc2-4e83-4161-8e4b-6ff453fbdfb4 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:20.536522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 390/762] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:20.536522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44facc2-4e83-4161-8e4b-6ff453fbdfb4 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:20.566846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e378e-529b-40f8-98c3-48acbbbbca27 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:20.599085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:20.606572 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795c0ae-3309-4427-8f40-583fd4664869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:20.607392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795c0ae-3309-4427-8f40-583fd4664869 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:20.607511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795c0ae-3309-4427-8f40-583fd4664869 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:20.607750 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795c0ae-3309-4427-8f40-583fd4664869 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:20.616463 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795c0ae-3309-4427-8f40-583fd4664869 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:20.617980 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795c0ae-3309-4427-8f40-583fd4664869 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:20.630792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-a795c0ae-3309-4427-8f40-583fd4664869 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:18:20.630792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:20.630792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:20.630792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:20.630792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:20.630792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:20.630792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:20.630792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:20.630792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:20.630792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:20.630792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:20.630792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:20.630792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:20.630792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:20.630792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:20.630792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:20.631832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:20.632816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:20.632816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:20.632816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:20.632816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:20.632816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:20.632816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:20.632816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:20.632816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:20.632816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:18:20.632816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:20.632816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 373/763] 10.222.0.52 () {56 vars in 1117 bytes} [Mon Aug 29 20:18:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:20.632816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795c0ae-3309-4427-8f40-583fd4664869 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:20.646419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:20.658802 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44facc2-4e83-4161-8e4b-6ff453fbdfb4 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:20.696425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6951a-2757-420a-9427-dfee80d08d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:20.697042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6951a-2757-420a-9427-dfee80d08d7a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:20.697332 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6951a-2757-420a-9427-dfee80d08d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:20.697633 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6951a-2757-420a-9427-dfee80d08d7a None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:20.698269 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6951a-2757-420a-9427-dfee80d08d7a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:20.698574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6951a-2757-420a-9427-dfee80d08d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:20.699949 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6951a-2757-420a-9427-dfee80d08d7a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:20.705021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 391/764] 10.222.0.52 () {56 vars in 1124 bytes} [Mon Aug 29 20:18:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:20.706249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f543ec9-69c7-4ab1-b8a7-d22fb912f4e2 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:20.706533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f543ec9-69c7-4ab1-b8a7-d22fb912f4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:20.706806 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f543ec9-69c7-4ab1-b8a7-d22fb912f4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:20.728423 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3f543ec9-69c7-4ab1-b8a7-d22fb912f4e2 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:20.730676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3f543ec9-69c7-4ab1-b8a7-d22fb912f4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:20.754763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795c0ae-3309-4427-8f40-583fd4664869 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:20.794647 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7dcbc-efa2-4a71-914b-04b3718b9683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:20.795323 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7dcbc-efa2-4a71-914b-04b3718b9683 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:20.795611 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7dcbc-efa2-4a71-914b-04b3718b9683 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:20.795884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7dcbc-efa2-4a71-914b-04b3718b9683 None admin] PATH_INFO: `/v3/projects/03ca2c70c46a477494884c9997540861/users/9c95d16fd4da4fa7987b893eae0b3ef5/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:20.797883 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7dcbc-efa2-4a71-914b-04b3718b9683 None admin] RBAC: Authorizing `identity:create_grant(project_id=03ca2c70c46a477494884c9997540861, user_id=9c95d16fd4da4fa7987b893eae0b3ef5, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:20.799365 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7dcbc-efa2-4a71-914b-04b3718b9683 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:20.810521 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 392/765] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:20.811965 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f543ec9-69c7-4ab1-b8a7-d22fb912f4e2 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:20.837740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 374/766] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:18:20 2022] PUT /identity/v3/projects/03ca2c70c46a477494884c9997540861/users/9c95d16fd4da4fa7987b893eae0b3ef5/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:18:20.840219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7dcbc-efa2-4a71-914b-04b3718b9683 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:20.995583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:21.006862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:21.018010 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f543ec9-69c7-4ab1-b8a7-d22fb912f4e2 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:21.057454 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ede96-6ce9-4fd4-9f24-669c5f0f38d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:21.058627 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ede96-6ce9-4fd4-9f24-669c5f0f38d8 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:21.059215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ede96-6ce9-4fd4-9f24-669c5f0f38d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:21.059785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ede96-6ce9-4fd4-9f24-669c5f0f38d8 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:21.061076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ede96-6ce9-4fd4-9f24-669c5f0f38d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:21.062362 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ede96-6ce9-4fd4-9f24-669c5f0f38d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:21.065850 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ede96-6ce9-4fd4-9f24-669c5f0f38d8 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:21.090809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 393/767] 10.222.0.52 () {56 vars in 1149 bytes} [Mon Aug 29 20:18:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:21.096957 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ede96-6ce9-4fd4-9f24-669c5f0f38d8 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:21.118408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7dcbc-efa2-4a71-914b-04b3718b9683 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:21.164018 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ebabb-36d7-4741-8e33-0cd184002087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:21.164640 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ebabb-36d7-4741-8e33-0cd184002087 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:21.164919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ebabb-36d7-4741-8e33-0cd184002087 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:21.165202 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ebabb-36d7-4741-8e33-0cd184002087 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:21.167519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ebabb-36d7-4741-8e33-0cd184002087 None admin] RBAC: Adding query filter params (interface=public, service_id=ecdde1ecf8514cef94beb9d8db2add5e, region_id=RegionOne) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:21.167714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ebabb-36d7-4741-8e33-0cd184002087 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:21.170403 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ebabb-36d7-4741-8e33-0cd184002087 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:21.181510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 375/768] 10.222.0.52 () {56 vars in 1251 bytes} [Mon Aug 29 20:18:20 2022] GET /identity/v3/endpoints?service_id=ecdde1ecf8514cef94beb9d8db2add5e&interface=public®ion_id=RegionOne => generated 194 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:21.186737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ebabb-36d7-4741-8e33-0cd184002087 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:21.236648 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ede96-6ce9-4fd4-9f24-669c5f0f38d8 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:21.288845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d056cdf-ecc7-4a30-87bb-037e8883ea2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:21.290347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d056cdf-ecc7-4a30-87bb-037e8883ea2f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:21.290710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d056cdf-ecc7-4a30-87bb-037e8883ea2f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:21.291342 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d056cdf-ecc7-4a30-87bb-037e8883ea2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:21.318914 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:21.326616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ebabb-36d7-4741-8e33-0cd184002087 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:21.342984 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:21.368983 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce95ac-b5f8-4955-9916-7ebf7a308a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:21.370031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce95ac-b5f8-4955-9916-7ebf7a308a8a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:21.370564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce95ac-b5f8-4955-9916-7ebf7a308a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:21.370970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce95ac-b5f8-4955-9916-7ebf7a308a8a None admin] PATH_INFO: `/v3/services/network` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:21.371694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce95ac-b5f8-4955-9916-7ebf7a308a8a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:21.373264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce95ac-b5f8-4955-9916-7ebf7a308a8a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:21.383753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-cfce95ac-b5f8-4955-9916-7ebf7a308a8a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:18:21.383753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:21.383753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:21.383753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:21.383753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:21.383753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:21.383753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:21.383753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:21.383753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:18:21.383753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:21.383753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:21.383753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:21.383753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:21.383753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:21.383753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:21.383753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:21.383753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:21.384828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:21.384828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:21.384828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:21.384828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:21.384828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:21.384828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:21.384828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:21.384828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:21.384828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:21.384828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:21.384828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:21.384828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:21.384828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:21.384828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:21.384828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:21.384828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:21.385692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:21.385692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:21.385692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:21.385692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:21.385692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:21.385692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:21.385692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:21.385692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:21.385692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:21.385692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:21.385692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:21.385692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:21.385692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:18:21.385692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:21.388526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 376/769] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:21 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:21.389519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce95ac-b5f8-4955-9916-7ebf7a308a8a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:21.430996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d056cdf-ecc7-4a30-87bb-037e8883ea2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:21.432621 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d056cdf-ecc7-4a30-87bb-037e8883ea2f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:21.521524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce95ac-b5f8-4955-9916-7ebf7a308a8a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:21.559567 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df7087-56d3-4d23-b3fd-7dc9915f9664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:21.560308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df7087-56d3-4d23-b3fd-7dc9915f9664 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:21.560655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df7087-56d3-4d23-b3fd-7dc9915f9664 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:21.561038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df7087-56d3-4d23-b3fd-7dc9915f9664 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:21.561760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df7087-56d3-4d23-b3fd-7dc9915f9664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:21.562586 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 394/770] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:18:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 20:18:21.563649 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d056cdf-ecc7-4a30-87bb-037e8883ea2f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:21.568268 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df7087-56d3-4d23-b3fd-7dc9915f9664 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:21.579165 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 377/771] 10.222.0.52 () {56 vars in 1087 bytes} [Mon Aug 29 20:18:21 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:21.579165 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df7087-56d3-4d23-b3fd-7dc9915f9664 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:21.676984 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:21.678879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:21.773961 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d056cdf-ecc7-4a30-87bb-037e8883ea2f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:21.782464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df7087-56d3-4d23-b3fd-7dc9915f9664 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:21.815786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e1d97-f1a8-4419-a07e-eb60bc911e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:21.816479 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e1d97-f1a8-4419-a07e-eb60bc911e81 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:21.816775 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e1d97-f1a8-4419-a07e-eb60bc911e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:21.817039 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e1d97-f1a8-4419-a07e-eb60bc911e81 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:21.817830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e1d97-f1a8-4419-a07e-eb60bc911e81 None admin] RBAC: Adding query filter params (name=network) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:21.818770 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e1d97-f1a8-4419-a07e-eb60bc911e81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:21.819547 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e1d97-f1a8-4419-a07e-eb60bc911e81 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:21.824535 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c8104-223d-4702-9918-a63f9c0f3e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:21.824691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 395/772] 10.222.0.52 () {56 vars in 1112 bytes} [Mon Aug 29 20:18:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:21.825520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c8104-223d-4702-9918-a63f9c0f3e8e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:21.825628 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c8104-223d-4702-9918-a63f9c0f3e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:21.825884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c8104-223d-4702-9918-a63f9c0f3e8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:21.826057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95128c62-2bc8-4ac2-bb59-a7888f37cf44 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:21.826401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95128c62-2bc8-4ac2-bb59-a7888f37cf44 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:21.826624 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95128c62-2bc8-4ac2-bb59-a7888f37cf44 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:21.828111 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 396/773] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:21.833819 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95128c62-2bc8-4ac2-bb59-a7888f37cf44 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:21.842672 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c8104-223d-4702-9918-a63f9c0f3e8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:21.844588 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c8104-223d-4702-9918-a63f9c0f3e8e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:21.861517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-c98c8104-223d-4702-9918-a63f9c0f3e8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:21.861517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:21.861517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:21.861517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:21.861517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:21.861517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:21.861517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:21.861517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:21.861517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:21.861517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:21.861517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:21.861517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:21.861517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:21.861517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:21.861517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:21.861517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:21.862520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:21.862520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:21.862520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:21.862520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:21.862520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:21.862520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:21.862520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:21.862520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:21.862520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:21.862520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:21.862520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:21.862520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:21.862520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:21.862520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:21.862520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:21.862520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:21.862520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:21.863414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:21.863414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:21.863414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:21.863414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 378/774] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:21.864241 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87d80d-c235-4253-801e-78e87489ae59 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:21.866779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87d80d-c235-4253-801e-78e87489ae59 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:21.866779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87d80d-c235-4253-801e-78e87489ae59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:21.883398 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-8a87d80d-c235-4253-801e-78e87489ae59 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:21.884710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8a87d80d-c235-4253-801e-78e87489ae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:21.952190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95128c62-2bc8-4ac2-bb59-a7888f37cf44 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:21.963308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:21.966999 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 379/775] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:21.968108 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87d80d-c235-4253-801e-78e87489ae59 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:21.998358 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:22.011666 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3f776-c324-4633-ac8a-0d4c478478a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:22.012557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3f776-c324-4633-ac8a-0d4c478478a2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:22.013717 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3f776-c324-4633-ac8a-0d4c478478a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:22.014164 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3f776-c324-4633-ac8a-0d4c478478a2 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:22.014973 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3f776-c324-4633-ac8a-0d4c478478a2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:22.015401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3f776-c324-4633-ac8a-0d4c478478a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:22.016949 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3f776-c324-4633-ac8a-0d4c478478a2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:22.025457 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 397/776] 10.222.0.52 () {56 vars in 1112 bytes} [Mon Aug 29 20:18:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:22.037035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3f776-c324-4633-ac8a-0d4c478478a2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:22.143500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87d80d-c235-4253-801e-78e87489ae59 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:22.227044 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3f776-c324-4633-ac8a-0d4c478478a2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:22.230946 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85d1a3-504b-45a7-9a0d-4cc739409965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:22.231618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85d1a3-504b-45a7-9a0d-4cc739409965 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:22.231890 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85d1a3-504b-45a7-9a0d-4cc739409965 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:22.232155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85d1a3-504b-45a7-9a0d-4cc739409965 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:22.232803 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85d1a3-504b-45a7-9a0d-4cc739409965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:22.233098 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85d1a3-504b-45a7-9a0d-4cc739409965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:22.234524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85d1a3-504b-45a7-9a0d-4cc739409965 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:22.254178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 380/777] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:22.259410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85d1a3-504b-45a7-9a0d-4cc739409965 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:22.302511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9079413-b9f5-4fe0-bcf1-8546eb8a7766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:22.303183 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9079413-b9f5-4fe0-bcf1-8546eb8a7766 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:22.303462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9079413-b9f5-4fe0-bcf1-8546eb8a7766 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:22.304851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9079413-b9f5-4fe0-bcf1-8546eb8a7766 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:22.306264 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9079413-b9f5-4fe0-bcf1-8546eb8a7766 None admin] RBAC: Adding query filter params (interface=public, service_id=9880b2e6bc4b461f966cc8d930325db8, region_id=RegionOne) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:22.306575 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9079413-b9f5-4fe0-bcf1-8546eb8a7766 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:22.308541 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9079413-b9f5-4fe0-bcf1-8546eb8a7766 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:22.325226 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 398/778] 10.222.0.52 () {56 vars in 1251 bytes} [Mon Aug 29 20:18:22 2022] GET /identity/v3/endpoints?service_id=9880b2e6bc4b461f966cc8d930325db8&interface=public®ion_id=RegionOne => generated 194 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:22.335901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9079413-b9f5-4fe0-bcf1-8546eb8a7766 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:22.377393 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:22.387392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:22.404673 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85d1a3-504b-45a7-9a0d-4cc739409965 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:22.440229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c19a8b-68c3-485c-939e-170673d823f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:22.441158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c19a8b-68c3-485c-939e-170673d823f4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:22.441684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c19a8b-68c3-485c-939e-170673d823f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:22.442095 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c19a8b-68c3-485c-939e-170673d823f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:22.449874 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c19a8b-68c3-485c-939e-170673d823f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:22.451804 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c19a8b-68c3-485c-939e-170673d823f4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:22.454792 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9079413-b9f5-4fe0-bcf1-8546eb8a7766 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:22.464292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-c1c19a8b-68c3-485c-939e-170673d823f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:22.464292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:22.464292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:22.464292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:22.464292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:22.464292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:22.464292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:22.464292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:22.464292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:22.464292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:22.464292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:22.464292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:22.464292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:22.464292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:22.464292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:22.465383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:22.465383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:22.465383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:22.465383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:22.465383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:22.465383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:22.465383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:22.465383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:22.465383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:22.465383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:22.465383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:22.465383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:22.465383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:22.465383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:22.465383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:22.465383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:22.465383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:22.466814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:22.466814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:22.466814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:22.466814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:22.466814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:22.466814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:22.466814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:22.466814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:22.468987 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 381/779] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:22.470148 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c19a8b-68c3-485c-939e-170673d823f4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:22.493432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3b107-80d0-41a4-ae33-9445d2201d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:22.494104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3b107-80d0-41a4-ae33-9445d2201d41 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:22.494380 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3b107-80d0-41a4-ae33-9445d2201d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:22.494646 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3b107-80d0-41a4-ae33-9445d2201d41 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:22.495258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3b107-80d0-41a4-ae33-9445d2201d41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:22.496753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3b107-80d0-41a4-ae33-9445d2201d41 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:22.503098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 399/780] 10.222.0.52 () {56 vars in 1087 bytes} [Mon Aug 29 20:18:22 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:22.504078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3b107-80d0-41a4-ae33-9445d2201d41 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:22.584544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c19a8b-68c3-485c-939e-170673d823f4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:22.616590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:22.619661 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3b107-80d0-41a4-ae33-9445d2201d41 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:22.626820 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dab977-820e-4519-a16f-c598700f28fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:22.627821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dab977-820e-4519-a16f-c598700f28fd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:22.628268 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dab977-820e-4519-a16f-c598700f28fd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:22.628705 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dab977-820e-4519-a16f-c598700f28fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:22.641150 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dab977-820e-4519-a16f-c598700f28fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:22.647139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-f0dab977-820e-4519-a16f-c598700f28fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:18:22.647139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:22.647139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:22.647139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:22.647139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:22.647139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:22.647139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:22.647139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:22.647139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:22.647139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:22.647139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:22.647139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:22.647139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:22.647139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:22.647139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:22.647139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:22.648142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:22.648142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:22.648142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:22.648142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:22.648142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:22.648142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:22.648142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:22.648142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:22.648142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:22.648142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:22.648142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:22.648142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:22.648142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:22.648142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:22.648142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:22.648142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:22.648970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:22.648970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:22.648970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:22.648970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:22.648970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:22.648970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:22.648970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:22.648970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:22.648970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:22.648970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:22.648970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:18:22.648970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:22.651912 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 382/781] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:18:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:22.663260 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dab977-820e-4519-a16f-c598700f28fd None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:22.665169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9a555-a3f4-4482-adac-ddc1060cf3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:22.665831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9a555-a3f4-4482-adac-ddc1060cf3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:22.666106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9a555-a3f4-4482-adac-ddc1060cf3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:22.666374 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9a555-a3f4-4482-adac-ddc1060cf3e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:22.667076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9a555-a3f4-4482-adac-ddc1060cf3e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:22.667375 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9a555-a3f4-4482-adac-ddc1060cf3e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:22.668979 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9a555-a3f4-4482-adac-ddc1060cf3e3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:22.670281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:22.684785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 400/782] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:22.690719 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9a555-a3f4-4482-adac-ddc1060cf3e3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:22.810828 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9a555-a3f4-4482-adac-ddc1060cf3e3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:22.846360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dab977-820e-4519-a16f-c598700f28fd None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:22.852928 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e5c66-49ce-4db1-97c8-9c13df9313da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:22.854288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e5c66-49ce-4db1-97c8-9c13df9313da None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:22.854763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e5c66-49ce-4db1-97c8-9c13df9313da None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:22.855275 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e5c66-49ce-4db1-97c8-9c13df9313da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:22.857172 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e5c66-49ce-4db1-97c8-9c13df9313da None admin] RBAC: Adding query filter params (role.id=8352f2960aa74837804150f4c8774dbc, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=0327aa38835f41a7a82802f9cad2e6d2) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:22.857719 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e5c66-49ce-4db1-97c8-9c13df9313da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:22.859581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e5c66-49ce-4db1-97c8-9c13df9313da None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:22.867292 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 401/783] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:18:22 2022] GET /identity/v3/role_assignments?user.id=0327aa38835f41a7a82802f9cad2e6d2&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=8352f2960aa74837804150f4c8774dbc => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:22.886496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f61ec-b1f3-4b94-b19d-3c68416f8024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:22.887139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f61ec-b1f3-4b94-b19d-3c68416f8024 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:22.887447 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f61ec-b1f3-4b94-b19d-3c68416f8024 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:22.887728 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f61ec-b1f3-4b94-b19d-3c68416f8024 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:22.888406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f61ec-b1f3-4b94-b19d-3c68416f8024 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:22.888709 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f61ec-b1f3-4b94-b19d-3c68416f8024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:22.890138 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f61ec-b1f3-4b94-b19d-3c68416f8024 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:22.900426 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 383/784] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:18:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:22.906746 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e5c66-49ce-4db1-97c8-9c13df9313da None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:22.939081 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:23.029600 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e5c66-49ce-4db1-97c8-9c13df9313da None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:23.065982 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd623907-2285-4150-820e-a5295ea13941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:23.066541 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd623907-2285-4150-820e-a5295ea13941 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:23.066816 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd623907-2285-4150-820e-a5295ea13941 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:23.067082 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd623907-2285-4150-820e-a5295ea13941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:23.080176 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd623907-2285-4150-820e-a5295ea13941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:23.081799 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd623907-2285-4150-820e-a5295ea13941 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:23.097948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-cd623907-2285-4150-820e-a5295ea13941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:23.097948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:23.097948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:23.097948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:23.097948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:23.097948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:23.097948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:23.097948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:23.097948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:23.097948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:23.097948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:23.097948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:23.097948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:23.097948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:23.097948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:23.097948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:23.098924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:23.098924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:23.098924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:23.098924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:23.098924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:23.098924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:23.098924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:23.098924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:23.098924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:23.098924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:23.098924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:23.098924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:23.098924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:23.098924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:23.098924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:23.098924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:23.098924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:23.099793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:23.099793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:23.099793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:23.103880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 402/785] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:23.105334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f61ec-b1f3-4b94-b19d-3c68416f8024 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:23.188418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:23.203115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cd9d4-df46-4e0f-a52b-04b3771ba04b None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:23.203434 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cd9d4-df46-4e0f-a52b-04b3771ba04b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:23.203659 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cd9d4-df46-4e0f-a52b-04b3771ba04b None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:23.205000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 403/786] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:18:23.213214 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde32749-2fcd-40d0-be53-e6f9b014ffca None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:23.213542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde32749-2fcd-40d0-be53-e6f9b014ffca None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:23.213824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde32749-2fcd-40d0-be53-e6f9b014ffca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:23.238062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f61ec-b1f3-4b94-b19d-3c68416f8024 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:23.250503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-dde32749-2fcd-40d0-be53-e6f9b014ffca None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:23.251738 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-dde32749-2fcd-40d0-be53-e6f9b014ffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:23.307227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0208cf5-1240-4bf9-be7a-1714520840ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:23.307848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0208cf5-1240-4bf9-be7a-1714520840ff None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:23.308140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0208cf5-1240-4bf9-be7a-1714520840ff None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:23.308392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0208cf5-1240-4bf9-be7a-1714520840ff None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:23.309046 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0208cf5-1240-4bf9-be7a-1714520840ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:23.309393 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0208cf5-1240-4bf9-be7a-1714520840ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:23.310791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0208cf5-1240-4bf9-be7a-1714520840ff None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:23.345225 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 384/787] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:23.351044 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0208cf5-1240-4bf9-be7a-1714520840ff None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:23.388742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 404/788] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:23.493784 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0208cf5-1240-4bf9-be7a-1714520840ff None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:23.651291 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:23.661186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374ecc3-2e01-422f-a0b9-bda9e7a23c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:23.661867 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374ecc3-2e01-422f-a0b9-bda9e7a23c3f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:23.662143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374ecc3-2e01-422f-a0b9-bda9e7a23c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:23.662412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374ecc3-2e01-422f-a0b9-bda9e7a23c3f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:23.675944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374ecc3-2e01-422f-a0b9-bda9e7a23c3f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:23.677468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374ecc3-2e01-422f-a0b9-bda9e7a23c3f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:23.690776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-c374ecc3-2e01-422f-a0b9-bda9e7a23c3f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:18:23.690776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:23.690776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:23.690776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:23.690776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:23.690776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:23.690776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:23.690776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:23.690776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:23.690776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:23.690776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:23.690776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:23.690776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:23.690776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:23.690776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:23.690776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:23.691797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:23.693352 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:23.693352 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:23.693352 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:23.693352 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:23.693352 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:23.693352 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:23.693352 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:23.693352 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:23.693352 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:18:23.693352 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:23.693352 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 385/789] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:18:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:23.697959 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde32749-2fcd-40d0-be53-e6f9b014ffca None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:23.710233 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:23.710514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374ecc3-2e01-422f-a0b9-bda9e7a23c3f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:23.846093 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde32749-2fcd-40d0-be53-e6f9b014ffca None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:23.876449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374ecc3-2e01-422f-a0b9-bda9e7a23c3f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:23.883931 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff94169-3788-4301-a4c9-bd76cb1dc268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:23.884648 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff94169-3788-4301-a4c9-bd76cb1dc268 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:23.884950 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff94169-3788-4301-a4c9-bd76cb1dc268 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:23.885287 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff94169-3788-4301-a4c9-bd76cb1dc268 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:23.886062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff94169-3788-4301-a4c9-bd76cb1dc268 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:23.886359 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff94169-3788-4301-a4c9-bd76cb1dc268 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:23.888050 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff94169-3788-4301-a4c9-bd76cb1dc268 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:23.907711 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 405/790] 10.222.0.52 () {56 vars in 1135 bytes} [Mon Aug 29 20:18:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:23.909007 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1896e-ca17-4bae-97df-6153b851ff91 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:23.909292 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1896e-ca17-4bae-97df-6153b851ff91 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:23.909600 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1896e-ca17-4bae-97df-6153b851ff91 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:23.910970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 406/791] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:23.915722 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1896e-ca17-4bae-97df-6153b851ff91 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:23.919497 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82739c-ec5c-4b1e-a2a2-d5870d3b3101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:23.920155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82739c-ec5c-4b1e-a2a2-d5870d3b3101 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:23.920435 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82739c-ec5c-4b1e-a2a2-d5870d3b3101 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:23.920705 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82739c-ec5c-4b1e-a2a2-d5870d3b3101 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:23.932672 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82739c-ec5c-4b1e-a2a2-d5870d3b3101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:23.937894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-8b82739c-ec5c-4b1e-a2a2-d5870d3b3101 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:18:23.937894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:23.937894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:23.937894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:23.937894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:23.937894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:23.937894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:23.937894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:23.937894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:23.937894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:23.937894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:23.937894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:23.937894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:23.937894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:23.937894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:23.937894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:23.938876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:23.938876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:23.938876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:23.938876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:23.938876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:23.938876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:23.938876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:23.938876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:23.938876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:23.938876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:23.938876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:23.938876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:23.938876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:23.938876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:23.938876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:23.938876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:23.939733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:23.939733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:23.939733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:23.939733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:23.939733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:23.939733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:23.939733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:23.939733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:23.939733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:23.939733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:23.939733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:18:23.939733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:23.939733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 386/792] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:18:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:23.940898 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaceb76-a7e8-4bb4-870e-57be464ca4c4 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:23.941050 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaceb76-a7e8-4bb4-870e-57be464ca4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:23.945382 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaceb76-a7e8-4bb4-870e-57be464ca4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:23.961284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ebaceb76-a7e8-4bb4-870e-57be464ca4c4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:23.962606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ebaceb76-a7e8-4bb4-870e-57be464ca4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:23.988786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:24.016229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:24.031883 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1896e-ca17-4bae-97df-6153b851ff91 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:24.056364 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 387/793] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:24.057690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaceb76-a7e8-4bb4-870e-57be464ca4c4 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:24.085764 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b23de-d435-4cf0-b741-63a619c0d489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:24.086409 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b23de-d435-4cf0-b741-63a619c0d489 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:24.086683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b23de-d435-4cf0-b741-63a619c0d489 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:24.086952 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b23de-d435-4cf0-b741-63a619c0d489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:24.105689 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b23de-d435-4cf0-b741-63a619c0d489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:24.108002 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b23de-d435-4cf0-b741-63a619c0d489 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:24.141981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-b52b23de-d435-4cf0-b741-63a619c0d489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:24.141981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:24.141981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:24.141981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:24.141981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:24.141981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:24.141981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:24.141981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:24.141981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:24.141981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:24.141981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:24.141981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:24.141981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:24.141981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:24.141981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:24.141981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:24.143000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:24.143000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:24.143000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:24.143000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:24.143000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:24.143000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:24.143000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:24.143000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:24.143000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:24.143000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:24.143000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:24.143000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:24.143000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:24.143000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:24.143000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:24.143000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:24.143000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:24.144589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:24.144589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:24.144589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:24.144589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 407/794] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:24.148979 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b23de-d435-4cf0-b741-63a619c0d489 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:24.270628 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaceb76-a7e8-4bb4-870e-57be464ca4c4 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:24.320853 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b23de-d435-4cf0-b741-63a619c0d489 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:24.343640 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce228302-645f-477b-87f8-98679af77ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:24.346974 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce228302-645f-477b-87f8-98679af77ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:24.346974 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce228302-645f-477b-87f8-98679af77ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:24.346974 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce228302-645f-477b-87f8-98679af77ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:24.346974 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce228302-645f-477b-87f8-98679af77ec8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:24.346974 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce228302-645f-477b-87f8-98679af77ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:24.347615 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce228302-645f-477b-87f8-98679af77ec8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:24.358882 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:24.371735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 388/795] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:18:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:24.378405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce228302-645f-477b-87f8-98679af77ec8 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:24.385679 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b851a13-d12a-450e-be40-de6b56153bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:24.386297 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b851a13-d12a-450e-be40-de6b56153bcc None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:24.391481 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b851a13-d12a-450e-be40-de6b56153bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:24.391899 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b851a13-d12a-450e-be40-de6b56153bcc None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:24.392652 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b851a13-d12a-450e-be40-de6b56153bcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:24.393073 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b851a13-d12a-450e-be40-de6b56153bcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:24.394724 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b851a13-d12a-450e-be40-de6b56153bcc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:24.411253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 408/796] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:24.412357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b851a13-d12a-450e-be40-de6b56153bcc None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:24.426334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:24.495412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce228302-645f-477b-87f8-98679af77ec8 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:24.518173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b851a13-d12a-450e-be40-de6b56153bcc None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:24.534242 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0627fe-01d9-4344-9e42-6354ad11e6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:24.534812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0627fe-01d9-4344-9e42-6354ad11e6fd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:24.535090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0627fe-01d9-4344-9e42-6354ad11e6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:24.535362 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0627fe-01d9-4344-9e42-6354ad11e6fd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:24.536058 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0627fe-01d9-4344-9e42-6354ad11e6fd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:24.537580 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0627fe-01d9-4344-9e42-6354ad11e6fd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:24.547564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-4b0627fe-01d9-4344-9e42-6354ad11e6fd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:18:24.547564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:24.547564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:24.547564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:24.547564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:24.547564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:24.547564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:24.547564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:24.547564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:18:24.547564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:24.547564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:24.547564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:24.547564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:24.547564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:24.547564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:24.547564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:24.547564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:24.548593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:24.548593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:24.548593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:24.548593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:24.548593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:24.548593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:24.548593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:24.548593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:24.548593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:24.548593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:24.548593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:24.548593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:24.548593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:24.548593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:24.548593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:24.548593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:24.549865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:24.549865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:24.549865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:24.549865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:24.549865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:24.549865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:24.549865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:24.549865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:24.549865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:24.549865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:24.549865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:24.549865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:24.549865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:18:24.549865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:24.549865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 389/797] 10.222.0.52 () {56 vars in 1129 bytes} [Mon Aug 29 20:18:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:24.550666 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0627fe-01d9-4344-9e42-6354ad11e6fd None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:24.554009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84e6ec-11e6-46e1-8433-253bb36cb5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:24.554703 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84e6ec-11e6-46e1-8433-253bb36cb5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:24.554983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84e6ec-11e6-46e1-8433-253bb36cb5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:24.555249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84e6ec-11e6-46e1-8433-253bb36cb5f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:24.566627 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84e6ec-11e6-46e1-8433-253bb36cb5f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:24.568095 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84e6ec-11e6-46e1-8433-253bb36cb5f6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:24.584338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-fa84e6ec-11e6-46e1-8433-253bb36cb5f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:24.584338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:24.584338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:24.584338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:24.584338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:24.584338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:24.584338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:24.584338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:24.584338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:24.584338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:24.584338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:24.584338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:24.584338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:24.584338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:24.584338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:24.584338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:24.586937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:24.586937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:24.586937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:24.586937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:24.586937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:24.586937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:24.586937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:24.586937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:24.586937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:24.586937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:24.586937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:24.586937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:24.586937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:24.586937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:24.586937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:24.586937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:24.586937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:24.589016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:24.589016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:24.589016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:24.597634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 409/798] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:24.597634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84e6ec-11e6-46e1-8433-253bb36cb5f6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:24.622169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:24.668245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0627fe-01d9-4344-9e42-6354ad11e6fd None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:24.670120 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:24.698624 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84e6ec-11e6-46e1-8433-253bb36cb5f6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:24.709189 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5c498-35a1-412a-b3ee-825d74357608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:24.709959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c498-35a1-412a-b3ee-825d74357608 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:24.710240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c498-35a1-412a-b3ee-825d74357608 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:24.710498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c498-35a1-412a-b3ee-825d74357608 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:24.719302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5c498-35a1-412a-b3ee-825d74357608 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:24.720787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5c498-35a1-412a-b3ee-825d74357608 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:24.734315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-57b5c498-35a1-412a-b3ee-825d74357608 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:24.734315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:24.734315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:24.734315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:24.734315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:24.734315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:24.734315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:24.734315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:24.734315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:24.734315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:24.734315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:24.734315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:24.734315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:24.734315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:24.734315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:24.736387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:24.736387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:24.736387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:24.736387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:24.736387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:24.736387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:24.736387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:24.736387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:24.736387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:24.736387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:24.736387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:24.736387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:24.736387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:24.736387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:24.736387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:24.736387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:24.736387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:24.738655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:24.738655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:24.738655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:24.738655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:24.738655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:24.738655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:24.738655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:24.738655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:24.739993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48196032-ec06-43c2-8826-2b5eafb37f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:24.739993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48196032-ec06-43c2-8826-2b5eafb37f7f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:24.739993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48196032-ec06-43c2-8826-2b5eafb37f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:24.739993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48196032-ec06-43c2-8826-2b5eafb37f7f None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:24.740737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48196032-ec06-43c2-8826-2b5eafb37f7f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:24.740737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48196032-ec06-43c2-8826-2b5eafb37f7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:24.748076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 390/799] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:24.748247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48196032-ec06-43c2-8826-2b5eafb37f7f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:24.748368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5c498-35a1-412a-b3ee-825d74357608 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:24.748493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 410/800] 10.222.0.52 () {56 vars in 1124 bytes} [Mon Aug 29 20:18:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:24.748675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48196032-ec06-43c2-8826-2b5eafb37f7f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:24.851262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:24.860462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48196032-ec06-43c2-8826-2b5eafb37f7f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:24.861899 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5c498-35a1-412a-b3ee-825d74357608 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:24.895912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec43e41-0eec-43a1-9053-f9664690291d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:24.896707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec43e41-0eec-43a1-9053-f9664690291d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:24.897131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec43e41-0eec-43a1-9053-f9664690291d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:24.905395 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec43e41-0eec-43a1-9053-f9664690291d None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:24.905395 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec43e41-0eec-43a1-9053-f9664690291d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:24.905395 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec43e41-0eec-43a1-9053-f9664690291d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:24.905395 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec43e41-0eec-43a1-9053-f9664690291d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:24.906667 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3c591-5a91-4c16-afc9-8772e14c7374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:24.907918 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3c591-5a91-4c16-afc9-8772e14c7374 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:24.908347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3c591-5a91-4c16-afc9-8772e14c7374 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:24.908814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3c591-5a91-4c16-afc9-8772e14c7374 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:24.909643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3c591-5a91-4c16-afc9-8772e14c7374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:24.910092 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3c591-5a91-4c16-afc9-8772e14c7374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:24.911653 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3c591-5a91-4c16-afc9-8772e14c7374 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:24.923211 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 411/801] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:24.923211 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec43e41-0eec-43a1-9053-f9664690291d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:24.931172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 391/802] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:24.932394 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3c591-5a91-4c16-afc9-8772e14c7374 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:24.959771 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:25.048639 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec43e41-0eec-43a1-9053-f9664690291d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:25.080553 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3c591-5a91-4c16-afc9-8772e14c7374 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:25.127144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f42d0-e202-4cb4-a09e-c4e89fdee329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:25.127738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f42d0-e202-4cb4-a09e-c4e89fdee329 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:25.128012 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f42d0-e202-4cb4-a09e-c4e89fdee329 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:25.128281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f42d0-e202-4cb4-a09e-c4e89fdee329 None admin] PATH_INFO: `/v3/projects/03ca2c70c46a477494884c9997540861/users/dcb9791ea73d46b191ad9fc146297565/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:25.130788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f42d0-e202-4cb4-a09e-c4e89fdee329 None admin] RBAC: Authorizing `identity:create_grant(project_id=03ca2c70c46a477494884c9997540861, user_id=dcb9791ea73d46b191ad9fc146297565, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:25.132284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f42d0-e202-4cb4-a09e-c4e89fdee329 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:25.148227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 392/803] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:18:24 2022] PUT /identity/v3/projects/03ca2c70c46a477494884c9997540861/users/dcb9791ea73d46b191ad9fc146297565/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:18:25.150702 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f42d0-e202-4cb4-a09e-c4e89fdee329 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:25.214700 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199533d3-fe70-4299-860b-0d7e3d6d1370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:25.215418 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199533d3-fe70-4299-860b-0d7e3d6d1370 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:25.215717 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199533d3-fe70-4299-860b-0d7e3d6d1370 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:25.216304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199533d3-fe70-4299-860b-0d7e3d6d1370 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:25.217041 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199533d3-fe70-4299-860b-0d7e3d6d1370 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:25.217348 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199533d3-fe70-4299-860b-0d7e3d6d1370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:25.218838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199533d3-fe70-4299-860b-0d7e3d6d1370 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:25.229676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 412/804] 10.222.0.52 () {56 vars in 1124 bytes} [Mon Aug 29 20:18:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:25.229676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30fee6-022c-44e0-ae88-a5df21d99525 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:25.229676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30fee6-022c-44e0-ae88-a5df21d99525 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:25.229676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30fee6-022c-44e0-ae88-a5df21d99525 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:25.229676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 413/805] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:25.229676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249964bf-b84f-4e74-b388-79de1bc70ed2 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:25.230185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249964bf-b84f-4e74-b388-79de1bc70ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:25.230185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249964bf-b84f-4e74-b388-79de1bc70ed2 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:25.233533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 414/806] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:25.235179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249964bf-b84f-4e74-b388-79de1bc70ed2 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:25.260013 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:25.269127 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:25.294517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f42d0-e202-4cb4-a09e-c4e89fdee329 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:25.344480 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730cc39-30b5-417b-965e-2a9a53928ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:25.345121 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730cc39-30b5-417b-965e-2a9a53928ebd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:25.345479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730cc39-30b5-417b-965e-2a9a53928ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:25.345712 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730cc39-30b5-417b-965e-2a9a53928ebd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:25.354907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730cc39-30b5-417b-965e-2a9a53928ebd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:25.356505 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730cc39-30b5-417b-965e-2a9a53928ebd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:25.369882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-7730cc39-30b5-417b-965e-2a9a53928ebd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:18:25.369882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:25.369882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:25.369882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:25.369882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:25.369882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:25.369882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:25.369882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:25.369882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:25.369882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:25.369882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:25.369882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:25.369882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:25.369882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:25.369882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:25.369882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:25.370887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:25.372038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:25.372038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:25.372038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:25.372038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:25.372038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:25.372038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:25.372038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:25.372038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:25.372038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:18:25.372038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:25.372715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249964bf-b84f-4e74-b388-79de1bc70ed2 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:25.372797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 393/807] 10.222.0.52 () {56 vars in 1093 bytes} [Mon Aug 29 20:18:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:25.372797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74225cc-2c27-4ade-ad30-69d038d2fe0f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:25.372797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74225cc-2c27-4ade-ad30-69d038d2fe0f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:25.377758 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74225cc-2c27-4ade-ad30-69d038d2fe0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:25.396117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b74225cc-2c27-4ade-ad30-69d038d2fe0f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:25.397327 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b74225cc-2c27-4ade-ad30-69d038d2fe0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:25.413905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605b47f-cbe4-404e-a10c-ef761e1dabbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:25.414517 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605b47f-cbe4-404e-a10c-ef761e1dabbd None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:25.414790 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605b47f-cbe4-404e-a10c-ef761e1dabbd None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:25.415052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605b47f-cbe4-404e-a10c-ef761e1dabbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:25.415716 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605b47f-cbe4-404e-a10c-ef761e1dabbd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:25.417094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605b47f-cbe4-404e-a10c-ef761e1dabbd None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:25.453724 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 415/808] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:18:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:18:25.455199 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def54b26-1569-4aae-bc03-d0a0379e8860 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:25.455484 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def54b26-1569-4aae-bc03-d0a0379e8860 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:25.455755 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def54b26-1569-4aae-bc03-d0a0379e8860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:25.491152 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-def54b26-1569-4aae-bc03-d0a0379e8860 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:25.492455 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-def54b26-1569-4aae-bc03-d0a0379e8860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:25.493411 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 394/809] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:25.494351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74225cc-2c27-4ade-ad30-69d038d2fe0f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:25.617416 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:25.635222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 416/810] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:25.659656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74225cc-2c27-4ade-ad30-69d038d2fe0f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:25.705296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c95edd-7097-4420-be42-a73f5000ba20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:25.705959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c95edd-7097-4420-be42-a73f5000ba20 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:25.706230 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c95edd-7097-4420-be42-a73f5000ba20 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:25.706489 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c95edd-7097-4420-be42-a73f5000ba20 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:25.707228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c95edd-7097-4420-be42-a73f5000ba20 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:25.707523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c95edd-7097-4420-be42-a73f5000ba20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:25.709013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c95edd-7097-4420-be42-a73f5000ba20 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:25.729346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 395/811] 10.222.0.52 () {56 vars in 1133 bytes} [Mon Aug 29 20:18:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:25.735398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def54b26-1569-4aae-bc03-d0a0379e8860 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:25.738049 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:25.792146 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c95edd-7097-4420-be42-a73f5000ba20 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:25.869818 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def54b26-1569-4aae-bc03-d0a0379e8860 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:25.910286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60bd2b-bf58-4927-b284-3156dcffc351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:25.912239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60bd2b-bf58-4927-b284-3156dcffc351 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:25.912353 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60bd2b-bf58-4927-b284-3156dcffc351 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:25.912532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60bd2b-bf58-4927-b284-3156dcffc351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:25.944234 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c95edd-7097-4420-be42-a73f5000ba20 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:25.975138 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:25.985600 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0048a-7df0-41ca-9aca-6911dd6f790c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:25.986246 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0048a-7df0-41ca-9aca-6911dd6f790c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:25.986518 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0048a-7df0-41ca-9aca-6911dd6f790c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:25.986783 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0048a-7df0-41ca-9aca-6911dd6f790c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:25.998182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0048a-7df0-41ca-9aca-6911dd6f790c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:26.003446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-0fb0048a-7df0-41ca-9aca-6911dd6f790c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:26.003446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:26.003446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:26.003446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:26.003446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:26.003446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:26.003446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:26.003446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:26.003446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:26.003446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:26.003446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:26.003446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:26.003446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:26.003446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:26.003446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:26.003446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:26.004498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:26.004498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:26.004498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:26.004498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:26.004498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:26.004498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:26.004498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:26.004498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:26.004498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:26.004498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:26.004498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:26.004498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:26.004498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:26.004498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:26.004498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:26.004498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:26.005376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:26.005376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:26.005376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:26.005376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:26.005376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:26.005376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:26.005376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:26.005376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:26.005376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:26.005376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:26.005376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:26.005376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:26.005376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 396/812] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:18:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:26.006125 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0048a-7df0-41ca-9aca-6911dd6f790c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:26.008474 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60bd2b-bf58-4927-b284-3156dcffc351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:26.011144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60bd2b-bf58-4927-b284-3156dcffc351 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:26.013210 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:26.126467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0048a-7df0-41ca-9aca-6911dd6f790c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:26.161725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 417/813] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:18:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:18:26.162630 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60bd2b-bf58-4927-b284-3156dcffc351 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:26.169788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e16de4-cdc4-4786-9e8e-352e82397519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:26.170441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e16de4-cdc4-4786-9e8e-352e82397519 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:26.170717 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e16de4-cdc4-4786-9e8e-352e82397519 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:26.170990 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e16de4-cdc4-4786-9e8e-352e82397519 None admin] PATH_INFO: `/v3/services/network` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:26.171652 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e16de4-cdc4-4786-9e8e-352e82397519 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:26.173590 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e16de4-cdc4-4786-9e8e-352e82397519 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:26.187737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-f3e16de4-cdc4-4786-9e8e-352e82397519 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:18:26.187737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:26.187737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:26.187737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:26.187737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:26.187737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:26.187737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:26.187737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:26.187737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:18:26.187737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:26.187737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:26.187737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:26.187737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:26.187737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:26.187737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:26.187737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:26.187737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:26.191008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:26.191008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:26.191008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:26.191008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:26.191008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:26.191008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:26.191008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:26.191008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:26.191008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:26.191008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:26.191008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:26.191008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:26.191008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:26.191008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:26.191008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:26.191008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:26.193747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:26.193747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:26.193747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:26.193747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:26.193747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:26.193747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:26.193747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:26.193747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:26.193747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:26.193747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:26.193747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:26.193747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:26.193747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:18:26.193747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:26.205643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 397/814] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:26 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:26.205643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e16de4-cdc4-4786-9e8e-352e82397519 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:26.256960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:26.293213 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60bd2b-bf58-4927-b284-3156dcffc351 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:26.295244 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:26.314287 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e16de4-cdc4-4786-9e8e-352e82397519 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:26.336046 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfeec1-a7ed-47e1-8401-de8a77488ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:26.336656 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfeec1-a7ed-47e1-8401-de8a77488ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:26.336928 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfeec1-a7ed-47e1-8401-de8a77488ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:26.337195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfeec1-a7ed-47e1-8401-de8a77488ef1 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:26.338004 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfeec1-a7ed-47e1-8401-de8a77488ef1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:26.338365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfeec1-a7ed-47e1-8401-de8a77488ef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:26.340009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfeec1-a7ed-47e1-8401-de8a77488ef1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:26.349718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 418/815] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:18:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:26.350903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfeec1-a7ed-47e1-8401-de8a77488ef1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:26.361149 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c719c5a-9aec-48f5-8aec-500c8891bdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:26.362134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c719c5a-9aec-48f5-8aec-500c8891bdd7 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:26.362609 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c719c5a-9aec-48f5-8aec-500c8891bdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:26.363106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c719c5a-9aec-48f5-8aec-500c8891bdd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:26.376180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c719c5a-9aec-48f5-8aec-500c8891bdd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:26.378152 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c719c5a-9aec-48f5-8aec-500c8891bdd7 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:26.394360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-4c719c5a-9aec-48f5-8aec-500c8891bdd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:26.394360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:26.394360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:26.394360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:26.394360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:26.394360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:26.394360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:26.394360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:26.394360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:26.394360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:26.394360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:26.394360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:26.394360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:26.394360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:26.394360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:26.394360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:26.395348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:26.395348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:26.395348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:26.395348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:26.395348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:26.395348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:26.395348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:26.395348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:26.395348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:26.395348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:26.395348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:26.395348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:26.395348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:26.395348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:26.395348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:26.395348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:26.395348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:26.396235 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:26.396235 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:26.396235 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:26.398642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 398/816] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:26.399811 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c719c5a-9aec-48f5-8aec-500c8891bdd7 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:26.463383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfeec1-a7ed-47e1-8401-de8a77488ef1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:26.500351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ba302-0a21-49a7-a5d4-575e5a3df855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:26.500999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ba302-0a21-49a7-a5d4-575e5a3df855 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:26.501286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ba302-0a21-49a7-a5d4-575e5a3df855 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:26.501574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ba302-0a21-49a7-a5d4-575e5a3df855 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:26.502311 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ba302-0a21-49a7-a5d4-575e5a3df855 None admin] RBAC: Adding query filter params (name=network) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:26.502524 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ba302-0a21-49a7-a5d4-575e5a3df855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:26.504089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ba302-0a21-49a7-a5d4-575e5a3df855 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:26.514341 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 419/817] 10.222.0.52 () {56 vars in 1112 bytes} [Mon Aug 29 20:18:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:26.514341 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ba302-0a21-49a7-a5d4-575e5a3df855 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:26.519820 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c719c5a-9aec-48f5-8aec-500c8891bdd7 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:26.521872 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:26.544868 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:26.565691 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f382727-2bd0-411a-afed-6a5155f64f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:26.566700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f382727-2bd0-411a-afed-6a5155f64f99 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:26.567253 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f382727-2bd0-411a-afed-6a5155f64f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:26.567733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f382727-2bd0-411a-afed-6a5155f64f99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:26.580467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f382727-2bd0-411a-afed-6a5155f64f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:26.582391 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f382727-2bd0-411a-afed-6a5155f64f99 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:26.599116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-3f382727-2bd0-411a-afed-6a5155f64f99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:26.599116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:26.599116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:26.599116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:26.599116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:26.599116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:26.599116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:26.599116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:26.599116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:26.599116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:26.599116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:26.599116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:26.599116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:26.599116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:26.599116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:26.599116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:26.600129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:26.600129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:26.600129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:26.600129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:26.600129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:26.600129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:26.600129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:26.600129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:26.600129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:26.600129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:26.600129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:26.600129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:26.600129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:26.600129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:26.600129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:26.600129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:26.600129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:26.601022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:26.601022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:26.601022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:26.602974 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 399/818] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:26.604111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f382727-2bd0-411a-afed-6a5155f64f99 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:26.630763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ba302-0a21-49a7-a5d4-575e5a3df855 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:26.668017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d72aee-9c40-46ae-9cec-baf38ba0dc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:26.668684 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d72aee-9c40-46ae-9cec-baf38ba0dc93 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:26.668973 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d72aee-9c40-46ae-9cec-baf38ba0dc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:26.669268 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d72aee-9c40-46ae-9cec-baf38ba0dc93 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:26.669942 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d72aee-9c40-46ae-9cec-baf38ba0dc93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:26.670238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d72aee-9c40-46ae-9cec-baf38ba0dc93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:26.672005 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d72aee-9c40-46ae-9cec-baf38ba0dc93 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:26.690534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 420/819] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:26.691517 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d72aee-9c40-46ae-9cec-baf38ba0dc93 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:26.722143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f382727-2bd0-411a-afed-6a5155f64f99 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:26.762902 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2acad-e467-4ae3-b343-d01dc29a23f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:26.763941 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2acad-e467-4ae3-b343-d01dc29a23f0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:26.764430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2acad-e467-4ae3-b343-d01dc29a23f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:26.764999 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2acad-e467-4ae3-b343-d01dc29a23f0 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:26.765957 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2acad-e467-4ae3-b343-d01dc29a23f0 None admin] RBAC: Adding query filter params (type=network) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:26.766499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2acad-e467-4ae3-b343-d01dc29a23f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:26.768147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2acad-e467-4ae3-b343-d01dc29a23f0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:26.780212 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 400/820] 10.222.0.52 () {56 vars in 1112 bytes} [Mon Aug 29 20:18:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:26.781663 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2acad-e467-4ae3-b343-d01dc29a23f0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:26.789373 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:26.803541 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d72aee-9c40-46ae-9cec-baf38ba0dc93 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:26.806997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:26.845258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262af15b-1a93-4fa5-ab1e-7f6bac04ab98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:26.845915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262af15b-1a93-4fa5-ab1e-7f6bac04ab98 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:26.846188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262af15b-1a93-4fa5-ab1e-7f6bac04ab98 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:26.846453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262af15b-1a93-4fa5-ab1e-7f6bac04ab98 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:26.847102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262af15b-1a93-4fa5-ab1e-7f6bac04ab98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:26.847396 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262af15b-1a93-4fa5-ab1e-7f6bac04ab98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:26.848972 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262af15b-1a93-4fa5-ab1e-7f6bac04ab98 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:26.866670 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 421/821] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:26.867974 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262af15b-1a93-4fa5-ab1e-7f6bac04ab98 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:26.904594 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2acad-e467-4ae3-b343-d01dc29a23f0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:26.949607 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be81ca1-ef1e-4e15-8d60-25cc72c4ec5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:26.951173 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be81ca1-ef1e-4e15-8d60-25cc72c4ec5a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:26.951655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be81ca1-ef1e-4e15-8d60-25cc72c4ec5a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:26.952146 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be81ca1-ef1e-4e15-8d60-25cc72c4ec5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:26.960030 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be81ca1-ef1e-4e15-8d60-25cc72c4ec5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:26.961999 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be81ca1-ef1e-4e15-8d60-25cc72c4ec5a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:26.975923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-2be81ca1-ef1e-4e15-8d60-25cc72c4ec5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:26.975923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:26.975923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:26.975923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:26.975923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:26.975923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:26.975923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:26.975923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:26.975923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:26.975923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:26.975923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:26.975923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:26.975923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:26.975923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:26.975923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:26.976864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:26.976864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:26.976864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:26.976864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:26.976864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:26.976864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:26.976864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:26.976864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:26.976864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:26.976864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:26.976864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:26.976864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:26.976864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:26.976864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:26.976864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:26.976864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:26.976864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:26.977801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:26.977801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:26.977801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:26.977801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:26.977801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:26.977801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:26.977801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:26.977801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:26.980066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 401/822] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:26.981167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be81ca1-ef1e-4e15-8d60-25cc72c4ec5a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:26.987073 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262af15b-1a93-4fa5-ab1e-7f6bac04ab98 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:27.024368 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a2226-c34b-4269-94f6-fc73cfb33cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:27.024979 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a2226-c34b-4269-94f6-fc73cfb33cf7 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:27.025253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a2226-c34b-4269-94f6-fc73cfb33cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:27.025543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a2226-c34b-4269-94f6-fc73cfb33cf7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:27.026209 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a2226-c34b-4269-94f6-fc73cfb33cf7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:27.027646 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a2226-c34b-4269-94f6-fc73cfb33cf7 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:27.057319 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 422/823] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:18:26 2022] POST /identity/v3/endpoints => generated 337 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:18:27.057319 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a2226-c34b-4269-94f6-fc73cfb33cf7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:27.058853 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:27.113680 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:27.156866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be81ca1-ef1e-4e15-8d60-25cc72c4ec5a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:27.209345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a2226-c34b-4269-94f6-fc73cfb33cf7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:27.210003 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef55d9-d001-47d8-80fd-8f655867539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:27.210901 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef55d9-d001-47d8-80fd-8f655867539a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:27.211380 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef55d9-d001-47d8-80fd-8f655867539a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:27.211850 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef55d9-d001-47d8-80fd-8f655867539a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:27.222558 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef55d9-d001-47d8-80fd-8f655867539a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:27.224507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef55d9-d001-47d8-80fd-8f655867539a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:27.240305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-b0ef55d9-d001-47d8-80fd-8f655867539a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:18:27.240305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:27.240305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:27.240305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:27.240305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:27.240305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:27.240305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:27.240305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:27.240305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:27.240305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:27.240305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:27.240305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:27.240305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:27.240305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:27.240305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:27.240305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:27.241278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:27.242616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:27.242616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:27.242616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:27.242616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:27.242616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:27.242616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:27.242616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:27.242616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:27.242616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:18:27.242616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:27.245244 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 402/824] 10.222.0.52 () {56 vars in 1117 bytes} [Mon Aug 29 20:18:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:27.246922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afa397-6295-47ed-847c-67ccffc94b37 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:27.247404 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afa397-6295-47ed-847c-67ccffc94b37 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:27.247825 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afa397-6295-47ed-847c-67ccffc94b37 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:27.250815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 403/825] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:27.252910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afa397-6295-47ed-847c-67ccffc94b37 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:27.254027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b49f6-0a25-4dce-8877-e2757d607906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:27.255020 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b49f6-0a25-4dce-8877-e2757d607906 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:27.255394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b49f6-0a25-4dce-8877-e2757d607906 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:27.255757 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b49f6-0a25-4dce-8877-e2757d607906 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:27.257350 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b49f6-0a25-4dce-8877-e2757d607906 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:27.257885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b49f6-0a25-4dce-8877-e2757d607906 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:27.260622 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b49f6-0a25-4dce-8877-e2757d607906 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:27.280205 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 423/826] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:27.281840 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa8cac-f60d-4b42-a433-cca65521ffad None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:27.282289 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa8cac-f60d-4b42-a433-cca65521ffad None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:27.282720 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa8cac-f60d-4b42-a433-cca65521ffad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:27.305328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-dbfa8cac-f60d-4b42-a433-cca65521ffad None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:27.306588 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-dbfa8cac-f60d-4b42-a433-cca65521ffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:27.380732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:27.388366 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afa397-6295-47ed-847c-67ccffc94b37 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:27.399457 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 424/827] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:27.400234 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa8cac-f60d-4b42-a433-cca65521ffad None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:27.432031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351f12a-527a-4f11-8c8a-9d497edb7003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:27.433185 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351f12a-527a-4f11-8c8a-9d497edb7003 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:27.433848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351f12a-527a-4f11-8c8a-9d497edb7003 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:27.434514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351f12a-527a-4f11-8c8a-9d497edb7003 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:27.435456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351f12a-527a-4f11-8c8a-9d497edb7003 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:27.436874 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351f12a-527a-4f11-8c8a-9d497edb7003 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:27.438795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351f12a-527a-4f11-8c8a-9d497edb7003 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:27.461116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:27.465413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 404/828] 10.222.0.52 () {56 vars in 1149 bytes} [Mon Aug 29 20:18:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:27.470838 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351f12a-527a-4f11-8c8a-9d497edb7003 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:27.518056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa8cac-f60d-4b42-a433-cca65521ffad None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:27.556540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeb8e7-009e-471d-a9ee-9c8d51eb7b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:27.557215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeb8e7-009e-471d-a9ee-9c8d51eb7b50 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:27.557551 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeb8e7-009e-471d-a9ee-9c8d51eb7b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:27.557823 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeb8e7-009e-471d-a9ee-9c8d51eb7b50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:27.558609 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeb8e7-009e-471d-a9ee-9c8d51eb7b50 None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=9c95d16fd4da4fa7987b893eae0b3ef5) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:27.558922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeb8e7-009e-471d-a9ee-9c8d51eb7b50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:27.560407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeb8e7-009e-471d-a9ee-9c8d51eb7b50 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:27.568771 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 425/829] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:18:27 2022] GET /identity/v3/role_assignments?user.id=9c95d16fd4da4fa7987b893eae0b3ef5&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:27.590389 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351f12a-527a-4f11-8c8a-9d497edb7003 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:27.640310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1fab6-d578-44fa-9597-15975f8c0ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:27.641093 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1fab6-d578-44fa-9597-15975f8c0ddd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:27.641568 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1fab6-d578-44fa-9597-15975f8c0ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:27.641847 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1fab6-d578-44fa-9597-15975f8c0ddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:27.658830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1fab6-d578-44fa-9597-15975f8c0ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:27.660431 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1fab6-d578-44fa-9597-15975f8c0ddd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:27.678284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-53c1fab6-d578-44fa-9597-15975f8c0ddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:27.678284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:27.678284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:27.678284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:27.678284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:27.678284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:27.678284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:27.678284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:27.678284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:27.678284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:27.678284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:27.678284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:27.678284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:27.678284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:27.678284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:27.678284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:27.679413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:27.679413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:27.679413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:27.679413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:27.679413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:27.679413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:27.679413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:27.679413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:27.679413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:27.679413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:27.679413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:27.679413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:27.679413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:27.679413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:27.679413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:27.679413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:27.679413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:27.680274 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:27.680274 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:27.680274 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:27.680274 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 405/830] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:27.686551 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeb8e7-009e-471d-a9ee-9c8d51eb7b50 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:27.701575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1fab6-d578-44fa-9597-15975f8c0ddd None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:27.755352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:27.759472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:27.823522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeb8e7-009e-471d-a9ee-9c8d51eb7b50 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:27.831696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1fab6-d578-44fa-9597-15975f8c0ddd None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:27.861867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078aec4-33a0-4a5f-a166-afb3ea8149e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:27.862465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078aec4-33a0-4a5f-a166-afb3ea8149e8 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:27.862745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078aec4-33a0-4a5f-a166-afb3ea8149e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:27.863030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078aec4-33a0-4a5f-a166-afb3ea8149e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:27.863652 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078aec4-33a0-4a5f-a166-afb3ea8149e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:27.863951 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078aec4-33a0-4a5f-a166-afb3ea8149e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:27.865400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078aec4-33a0-4a5f-a166-afb3ea8149e8 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:27.870996 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ce5d0-999f-44d3-94b9-07abdab75495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:27.871775 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ce5d0-999f-44d3-94b9-07abdab75495 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:27.872154 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ce5d0-999f-44d3-94b9-07abdab75495 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:27.872566 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ce5d0-999f-44d3-94b9-07abdab75495 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:27.880559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 426/831] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:27.883427 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d12f2-f852-4d24-b028-f73653a48314 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:27.884056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d12f2-f852-4d24-b028-f73653a48314 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:27.884723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d12f2-f852-4d24-b028-f73653a48314 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:27.886796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 427/832] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:27.887877 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d12f2-f852-4d24-b028-f73653a48314 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:27.895395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ce5d0-999f-44d3-94b9-07abdab75495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:27.901415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-755ce5d0-999f-44d3-94b9-07abdab75495 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:18:27.901415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:27.901415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:27.901415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:27.901415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:27.901415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:27.901415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:27.901415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:27.901415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:27.901415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:27.901415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:27.901415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:27.901415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:27.901415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:27.901415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:27.901415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:27.902381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:27.902381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:27.902381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:27.902381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:27.902381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:27.902381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:27.902381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:27.902381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:27.902381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:27.902381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:27.902381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:27.902381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:27.902381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:27.902381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:27.902381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:27.902381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:27.903374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:27.903374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:27.903374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:27.903374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:27.903374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:27.903374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:27.903374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:27.903374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:27.903374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:27.903374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:27.903374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:18:27.903374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:27.903374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 406/833] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:18:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:27.905214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b42b43-25cf-438c-a562-94f505821476 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:27.905214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b42b43-25cf-438c-a562-94f505821476 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:27.905214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b42b43-25cf-438c-a562-94f505821476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:27.925266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-78b42b43-25cf-438c-a562-94f505821476 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:27.926740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-78b42b43-25cf-438c-a562-94f505821476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:28.013381 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d12f2-f852-4d24-b028-f73653a48314 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:28.022645 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 407/834] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:28.024134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b42b43-25cf-438c-a562-94f505821476 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:28.042606 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:28.070130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3a8df-eb8d-45de-ba8e-6c0f49823b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:28.071113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3a8df-eb8d-45de-ba8e-6c0f49823b32 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:28.071580 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3a8df-eb8d-45de-ba8e-6c0f49823b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:28.072340 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3a8df-eb8d-45de-ba8e-6c0f49823b32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:28.077212 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:28.083314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3a8df-eb8d-45de-ba8e-6c0f49823b32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:28.086602 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3a8df-eb8d-45de-ba8e-6c0f49823b32 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:28.103756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-70b3a8df-eb8d-45de-ba8e-6c0f49823b32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:28.103756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:28.103756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:28.103756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:28.103756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:28.103756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:28.103756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:28.103756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:28.103756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:28.103756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:28.103756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:28.103756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:28.103756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:28.103756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:28.103756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:28.104800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:28.104800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:28.104800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:28.104800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:28.104800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:28.104800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:28.104800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:28.104800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:28.104800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:28.104800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:28.104800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:28.104800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:28.104800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:28.104800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:28.104800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:28.104800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:28.104800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:28.105845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:28.105845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:28.105845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:28.105845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:28.105845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:28.105845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:28.105845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:28.105845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:28.109723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 428/835] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:28.112479 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3a8df-eb8d-45de-ba8e-6c0f49823b32 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:28.172357 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b42b43-25cf-438c-a562-94f505821476 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:28.217379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11191172-e698-4d3f-9040-3c6de0362c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:28.218196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191172-e698-4d3f-9040-3c6de0362c04 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:28.218444 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191172-e698-4d3f-9040-3c6de0362c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:28.218779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191172-e698-4d3f-9040-3c6de0362c04 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:28.219615 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11191172-e698-4d3f-9040-3c6de0362c04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:28.220283 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11191172-e698-4d3f-9040-3c6de0362c04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:28.221521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11191172-e698-4d3f-9040-3c6de0362c04 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:28.240856 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 408/836] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:18:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:28.243523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11191172-e698-4d3f-9040-3c6de0362c04 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:28.249496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3a8df-eb8d-45de-ba8e-6c0f49823b32 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:28.287850 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a205c0-55db-4c62-af5a-4bae623741a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:28.288637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a205c0-55db-4c62-af5a-4bae623741a5 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:28.289011 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a205c0-55db-4c62-af5a-4bae623741a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:28.289514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a205c0-55db-4c62-af5a-4bae623741a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:28.290571 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a205c0-55db-4c62-af5a-4bae623741a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:28.291068 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a205c0-55db-4c62-af5a-4bae623741a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:28.293504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a205c0-55db-4c62-af5a-4bae623741a5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:28.311398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 429/837] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:28.312483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a205c0-55db-4c62-af5a-4bae623741a5 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:28.358485 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:28.369458 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:28.376017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11191172-e698-4d3f-9040-3c6de0362c04 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:28.411519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc21e73-f338-4c03-bf2b-b7206c5e9705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:28.412188 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc21e73-f338-4c03-bf2b-b7206c5e9705 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:28.412461 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc21e73-f338-4c03-bf2b-b7206c5e9705 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:28.412726 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc21e73-f338-4c03-bf2b-b7206c5e9705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:28.424049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc21e73-f338-4c03-bf2b-b7206c5e9705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:28.425543 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc21e73-f338-4c03-bf2b-b7206c5e9705 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:28.432906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a205c0-55db-4c62-af5a-4bae623741a5 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:28.439956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-8cc21e73-f338-4c03-bf2b-b7206c5e9705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:28.439956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:28.439956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:28.439956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:28.439956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:28.439956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:28.439956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:28.439956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:28.439956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:28.439956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:28.439956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:28.439956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:28.439956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:28.439956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:28.439956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:28.439956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:28.441005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:28.441005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:28.441005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:28.441005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:28.441005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:28.441005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:28.441005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:28.441005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:28.441005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:28.441005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:28.441005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:28.441005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:28.441005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:28.441005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:28.441005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:28.441005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:28.441005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:28.442757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:28.442757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:28.442757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:28.442757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 409/838] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:28.442757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc21e73-f338-4c03-bf2b-b7206c5e9705 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:28.476490 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d48aa4-b6e6-42c3-8465-2fd8d57103b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:28.477312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d48aa4-b6e6-42c3-8465-2fd8d57103b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:28.477706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d48aa4-b6e6-42c3-8465-2fd8d57103b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:28.477972 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d48aa4-b6e6-42c3-8465-2fd8d57103b8 None admin] PATH_INFO: `/v3/projects/03ca2c70c46a477494884c9997540861/users/0327aa38835f41a7a82802f9cad2e6d2/roles/8352f2960aa74837804150f4c8774dbc` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:28.497649 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d48aa4-b6e6-42c3-8465-2fd8d57103b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=03ca2c70c46a477494884c9997540861, user_id=0327aa38835f41a7a82802f9cad2e6d2, role_id=8352f2960aa74837804150f4c8774dbc)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:28.499631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d48aa4-b6e6-42c3-8465-2fd8d57103b8 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:28.514564 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 430/839] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:18:28 2022] PUT /identity/v3/projects/03ca2c70c46a477494884c9997540861/users/0327aa38835f41a7a82802f9cad2e6d2/roles/8352f2960aa74837804150f4c8774dbc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:18:28.515766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d48aa4-b6e6-42c3-8465-2fd8d57103b8 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:28.583425 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc21e73-f338-4c03-bf2b-b7206c5e9705 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:28.623702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:28.640448 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8aa36-5e0d-4c53-ac6a-5dd8a92b1fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:28.641108 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8aa36-5e0d-4c53-ac6a-5dd8a92b1fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:28.641412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8aa36-5e0d-4c53-ac6a-5dd8a92b1fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:28.641768 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8aa36-5e0d-4c53-ac6a-5dd8a92b1fc0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:28.642505 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8aa36-5e0d-4c53-ac6a-5dd8a92b1fc0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:28.644041 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8aa36-5e0d-4c53-ac6a-5dd8a92b1fc0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:28.649221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d48aa4-b6e6-42c3-8465-2fd8d57103b8 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:28.654494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-39d8aa36-5e0d-4c53-ac6a-5dd8a92b1fc0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:18:28.654494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:28.654494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:28.654494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:28.654494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:28.654494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:28.654494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:28.654494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:28.654494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:18:28.654494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:28.654494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:28.654494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:28.654494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:28.654494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:28.654494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:28.654494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:28.654494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:28.655605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:28.655605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:28.655605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:28.655605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:28.655605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:28.655605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:28.655605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:28.655605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:28.655605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:28.655605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:28.655605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:28.655605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:28.655605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:28.655605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:28.655605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:28.655605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:28.656433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:28.656433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:28.656433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:28.656433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:28.656433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:28.656433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:28.656433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:28.656433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:28.656433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:28.656433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:28.656433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:28.656433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:28.656433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:18:28.656433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:28.656433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 410/840] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:18:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:28.666521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8aa36-5e0d-4c53-ac6a-5dd8a92b1fc0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:28.688461 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:28.703159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f9e88-b9ee-488f-b440-f55a14cecdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:28.703777 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f9e88-b9ee-488f-b440-f55a14cecdf9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:28.704052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f9e88-b9ee-488f-b440-f55a14cecdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:28.704318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f9e88-b9ee-488f-b440-f55a14cecdf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:28.704967 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f9e88-b9ee-488f-b440-f55a14cecdf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:28.705259 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f9e88-b9ee-488f-b440-f55a14cecdf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:28.706698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f9e88-b9ee-488f-b440-f55a14cecdf9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:28.722317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 431/841] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:28.727493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f9e88-b9ee-488f-b440-f55a14cecdf9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:28.790306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8aa36-5e0d-4c53-ac6a-5dd8a92b1fc0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:28.832598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e54b75-3af7-4e0c-9b1a-10e4d9049b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:28.833555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54b75-3af7-4e0c-9b1a-10e4d9049b9f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:28.833831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54b75-3af7-4e0c-9b1a-10e4d9049b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:28.834096 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54b75-3af7-4e0c-9b1a-10e4d9049b9f None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:28.834731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e54b75-3af7-4e0c-9b1a-10e4d9049b9f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:28.835019 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e54b75-3af7-4e0c-9b1a-10e4d9049b9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:28.836420 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e54b75-3af7-4e0c-9b1a-10e4d9049b9f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:28.842864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 411/842] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:18:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:28.849332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e54b75-3af7-4e0c-9b1a-10e4d9049b9f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:28.876053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f9e88-b9ee-488f-b440-f55a14cecdf9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:28.925704 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00be34-3688-451c-97a5-ed6546f78ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:28.926793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00be34-3688-451c-97a5-ed6546f78ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:28.927274 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00be34-3688-451c-97a5-ed6546f78ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:28.927740 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00be34-3688-451c-97a5-ed6546f78ed1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:28.937566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00be34-3688-451c-97a5-ed6546f78ed1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:28.939504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00be34-3688-451c-97a5-ed6546f78ed1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:28.952472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-dc00be34-3688-451c-97a5-ed6546f78ed1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:18:28.952472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:28.952472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:28.952472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:28.952472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:28.952472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:28.952472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:28.952472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:28.952472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:28.952472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:28.952472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:28.952472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:28.952472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:28.952472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:28.952472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:28.952472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:28.953504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:28.954635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:28.954635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:28.954635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:28.954635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:28.954635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:28.954635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:28.954635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:28.954635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:28.954635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:18:28.954635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:28.955295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:28.956967 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 432/843] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:18:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:28.965485 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00be34-3688-451c-97a5-ed6546f78ed1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:28.979138 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e54b75-3af7-4e0c-9b1a-10e4d9049b9f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:28.979543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:29.020094 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76056cf-a544-47c3-b410-e82ef4c5d454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:29.020883 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76056cf-a544-47c3-b410-e82ef4c5d454 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:29.021247 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76056cf-a544-47c3-b410-e82ef4c5d454 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:29.021635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76056cf-a544-47c3-b410-e82ef4c5d454 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:29.022382 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76056cf-a544-47c3-b410-e82ef4c5d454 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:29.022779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76056cf-a544-47c3-b410-e82ef4c5d454 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:29.024244 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76056cf-a544-47c3-b410-e82ef4c5d454 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:29.029890 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 412/844] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:18:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:29.117611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00be34-3688-451c-97a5-ed6546f78ed1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:29.162373 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3285348-42fd-4009-bafd-e87ac572f108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:29.162912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3285348-42fd-4009-bafd-e87ac572f108 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:29.163187 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3285348-42fd-4009-bafd-e87ac572f108 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:29.163451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3285348-42fd-4009-bafd-e87ac572f108 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:29.164200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3285348-42fd-4009-bafd-e87ac572f108 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:29.164496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3285348-42fd-4009-bafd-e87ac572f108 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:29.166338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3285348-42fd-4009-bafd-e87ac572f108 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:29.187450 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 433/845] 10.222.0.52 () {56 vars in 1135 bytes} [Mon Aug 29 20:18:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:29.193192 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76056cf-a544-47c3-b410-e82ef4c5d454 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:29.304321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76056cf-a544-47c3-b410-e82ef4c5d454 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:29.360096 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fcf83-d597-4a7a-ac2a-5bb3942f1344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:29.361124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fcf83-d597-4a7a-ac2a-5bb3942f1344 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:29.361630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fcf83-d597-4a7a-ac2a-5bb3942f1344 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:29.362081 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fcf83-d597-4a7a-ac2a-5bb3942f1344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:29.381538 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:29.485389 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fcf83-d597-4a7a-ac2a-5bb3942f1344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:29.488051 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fcf83-d597-4a7a-ac2a-5bb3942f1344 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:29.596459 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 413/846] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:18:29 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:18:29.605437 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3285348-42fd-4009-bafd-e87ac572f108 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:29.723035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e51ce-89f5-4ea7-bccc-e38fe96b180e None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:29.723522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e51ce-89f5-4ea7-bccc-e38fe96b180e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:29.723932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e51ce-89f5-4ea7-bccc-e38fe96b180e None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:29.724334 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:29.726875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 414/847] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:29.736311 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5785874-9cb9-435d-b0fd-9cb3f7eb5925 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:29.736311 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5785874-9cb9-435d-b0fd-9cb3f7eb5925 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:29.736683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5785874-9cb9-435d-b0fd-9cb3f7eb5925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:29.765518 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f5785874-9cb9-435d-b0fd-9cb3f7eb5925 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:29.766915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3285348-42fd-4009-bafd-e87ac572f108 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:29.767479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f5785874-9cb9-435d-b0fd-9cb3f7eb5925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:29.805807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7d289-cb5d-4ae9-94a4-1c5fab4eec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:29.806891 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7d289-cb5d-4ae9-94a4-1c5fab4eec29 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:29.807416 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7d289-cb5d-4ae9-94a4-1c5fab4eec29 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:29.807894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7d289-cb5d-4ae9-94a4-1c5fab4eec29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:29.820380 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7d289-cb5d-4ae9-94a4-1c5fab4eec29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:29.822404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7d289-cb5d-4ae9-94a4-1c5fab4eec29 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:29.832001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:29.839165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-9ed7d289-cb5d-4ae9-94a4-1c5fab4eec29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:29.839165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:29.839165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:29.839165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:29.839165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:29.839165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:29.839165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:29.839165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:29.839165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:29.839165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:29.839165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:29.839165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:29.839165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:29.839165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:29.839165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:29.839165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:29.840138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:29.840138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:29.840138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:29.840138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:29.840138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:29.840138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:29.840138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:29.840138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:29.840138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:29.840138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:29.840138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:29.840138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:29.840138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:29.840138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:29.840138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:29.840138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:29.840138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:29.841333 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:29.841333 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:29.841333 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:29.843529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 434/848] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:29.854413 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7d289-cb5d-4ae9-94a4-1c5fab4eec29 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:29.885798 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 415/849] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:29.961182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7d289-cb5d-4ae9-94a4-1c5fab4eec29 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:29.976492 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:29.998737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cdd14-81d2-4553-9e39-a283b7b2c5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:29.999263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cdd14-81d2-4553-9e39-a283b7b2c5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:29.999536 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cdd14-81d2-4553-9e39-a283b7b2c5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:29.999946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cdd14-81d2-4553-9e39-a283b7b2c5d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:30.000614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cdd14-81d2-4553-9e39-a283b7b2c5d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:30.000909 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cdd14-81d2-4553-9e39-a283b7b2c5d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:30.002375 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cdd14-81d2-4553-9e39-a283b7b2c5d5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:30.015297 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 435/850] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:30.020790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5785874-9cb9-435d-b0fd-9cb3f7eb5925 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:30.129118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5785874-9cb9-435d-b0fd-9cb3f7eb5925 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:30.167601 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cd602-cfaf-4f0f-bfff-594599621d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:30.168280 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cd602-cfaf-4f0f-bfff-594599621d5a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:30.168557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cd602-cfaf-4f0f-bfff-594599621d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:30.168823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cd602-cfaf-4f0f-bfff-594599621d5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:30.173681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cdd14-81d2-4553-9e39-a283b7b2c5d5 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:30.177908 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cd602-cfaf-4f0f-bfff-594599621d5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:30.179395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cd602-cfaf-4f0f-bfff-594599621d5a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:30.191532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-ae5cd602-cfaf-4f0f-bfff-594599621d5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:30.191532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:30.191532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:30.191532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:30.191532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:30.191532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:30.191532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:30.191532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:30.191532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:30.191532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:30.191532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:30.191532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:30.191532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:30.191532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:30.191532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:30.192496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:30.192496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:30.192496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:30.192496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:30.192496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:30.192496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:30.192496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:30.192496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:30.192496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:30.192496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:30.192496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:30.192496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:30.192496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:30.192496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:30.192496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:30.192496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:30.192496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:30.193455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:30.193455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:30.193455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:30.193455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:30.193455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:30.193455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:30.193455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:30.193455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:30.193455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 416/851] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:30.201100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cd602-cfaf-4f0f-bfff-594599621d5a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:30.236921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:30.304211 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cdd14-81d2-4553-9e39-a283b7b2c5d5 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:30.342754 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cd602-cfaf-4f0f-bfff-594599621d5a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:30.361147 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ffd37-b84e-42cf-9870-4b4297484afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:30.362277 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ffd37-b84e-42cf-9870-4b4297484afa None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:30.362754 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ffd37-b84e-42cf-9870-4b4297484afa None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:30.363164 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ffd37-b84e-42cf-9870-4b4297484afa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:30.363931 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ffd37-b84e-42cf-9870-4b4297484afa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:30.365595 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ffd37-b84e-42cf-9870-4b4297484afa None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:30.376318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-9a6ffd37-b84e-42cf-9870-4b4297484afa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:18:30.376318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:30.376318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:30.376318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:30.376318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:30.376318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:30.376318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:30.376318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:30.376318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:18:30.376318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:30.376318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:30.376318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:30.376318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:30.376318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:30.376318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:30.376318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:30.377532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:30.377532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:30.377532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:30.377532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:30.377532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:30.377532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:30.377532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:30.377532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:30.377532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:30.377532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:30.377532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:30.377532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:30.377532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:30.377532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:30.377532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:30.377532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:30.377532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:30.378420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:30.378420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:30.378420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:30.378420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:30.378420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:30.378420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:30.378420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:30.378420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:30.378420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:30.378420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:30.378420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:30.378420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:30.378420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:18:30.378420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:30.380004 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 436/852] 10.222.0.52 () {56 vars in 1132 bytes} [Mon Aug 29 20:18:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:30.387431 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a6c0b-a985-4542-b419-6f9b25ce3a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:30.387615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ffd37-b84e-42cf-9870-4b4297484afa None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:30.387733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a6c0b-a985-4542-b419-6f9b25ce3a49 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:30.387733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a6c0b-a985-4542-b419-6f9b25ce3a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:30.387733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a6c0b-a985-4542-b419-6f9b25ce3a49 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:30.388263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a6c0b-a985-4542-b419-6f9b25ce3a49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:30.388570 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a6c0b-a985-4542-b419-6f9b25ce3a49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:30.390269 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a6c0b-a985-4542-b419-6f9b25ce3a49 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:30.404453 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 417/853] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:30.410288 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a6c0b-a985-4542-b419-6f9b25ce3a49 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:30.440748 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:30.529651 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ffd37-b84e-42cf-9870-4b4297484afa None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:30.547700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:30.562450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a6c0b-a985-4542-b419-6f9b25ce3a49 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:30.585546 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb49c72-c173-4aed-9583-6745b167280d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:30.586688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb49c72-c173-4aed-9583-6745b167280d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:30.587111 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb49c72-c173-4aed-9583-6745b167280d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:30.587593 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb49c72-c173-4aed-9583-6745b167280d None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:30.588458 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb49c72-c173-4aed-9583-6745b167280d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:30.588933 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb49c72-c173-4aed-9583-6745b167280d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:30.590965 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb49c72-c173-4aed-9583-6745b167280d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:30.597107 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 437/854] 10.222.0.52 () {56 vars in 1126 bytes} [Mon Aug 29 20:18:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:30.603638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb49c72-c173-4aed-9583-6745b167280d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:30.614174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24d951-b5fa-4a54-9b99-bd1f108da9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:30.614906 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24d951-b5fa-4a54-9b99-bd1f108da9ef None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:30.615179 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24d951-b5fa-4a54-9b99-bd1f108da9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:30.615442 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24d951-b5fa-4a54-9b99-bd1f108da9ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:30.616191 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24d951-b5fa-4a54-9b99-bd1f108da9ef None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=dcb9791ea73d46b191ad9fc146297565) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:30.616505 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24d951-b5fa-4a54-9b99-bd1f108da9ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:30.618655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24d951-b5fa-4a54-9b99-bd1f108da9ef None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:30.629484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 418/855] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:18:30 2022] GET /identity/v3/role_assignments?user.id=dcb9791ea73d46b191ad9fc146297565&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:30.644794 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856c4e0-d59a-4ac7-af07-395e8fa4e77f None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:30.645143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856c4e0-d59a-4ac7-af07-395e8fa4e77f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:30.645328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856c4e0-d59a-4ac7-af07-395e8fa4e77f None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:30.646985 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 419/856] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:18:30.653537 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b870c9f-09d7-4690-9a74-96b7dbcf02d9 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:30.653910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b870c9f-09d7-4690-9a74-96b7dbcf02d9 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:30.654087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b870c9f-09d7-4690-9a74-96b7dbcf02d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:30.674780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-2b870c9f-09d7-4690-9a74-96b7dbcf02d9 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:30.676036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2b870c9f-09d7-4690-9a74-96b7dbcf02d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:30.769709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb49c72-c173-4aed-9583-6745b167280d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:30.771839 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:30.773648 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 420/857] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:30.816105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0516fad-def9-483c-823e-dc621f2bb109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:30.817138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0516fad-def9-483c-823e-dc621f2bb109 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:30.819032 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0516fad-def9-483c-823e-dc621f2bb109 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:30.821188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0516fad-def9-483c-823e-dc621f2bb109 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:30.822173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0516fad-def9-483c-823e-dc621f2bb109 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:30.822677 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0516fad-def9-483c-823e-dc621f2bb109 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:30.824367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0516fad-def9-483c-823e-dc621f2bb109 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:30.831182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 438/858] 10.222.0.52 () {56 vars in 1126 bytes} [Mon Aug 29 20:18:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:31.036558 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b870c9f-09d7-4690-9a74-96b7dbcf02d9 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:31.137981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:31.156609 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b870c9f-09d7-4690-9a74-96b7dbcf02d9 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:31.198209 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79680b-731e-4b75-9488-2733674f4258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:31.198852 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79680b-731e-4b75-9488-2733674f4258 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:31.199185 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79680b-731e-4b75-9488-2733674f4258 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:31.199511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79680b-731e-4b75-9488-2733674f4258 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:31.211128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79680b-731e-4b75-9488-2733674f4258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:31.216931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-cd79680b-731e-4b75-9488-2733674f4258 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:31.216931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:31.216931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:31.216931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:31.216931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:31.216931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:31.216931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:31.216931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:31.216931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:31.216931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:31.216931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:31.216931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:31.216931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:31.216931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:31.216931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:31.216931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:31.218020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:31.218020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:31.218020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:31.218020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:31.218020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:31.218020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:31.218020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:31.218020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:31.218020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:31.218020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:31.218020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:31.218020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:31.218020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:31.218020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:31.218020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:31.218020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:31.218910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:31.218910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:31.218910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:31.218910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:31.218910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:31.218910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:31.218910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:31.218910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:31.218910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:31.218910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:31.218910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:18:31.218910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:31.223259 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 421/859] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:18:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:31.224701 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0516fad-def9-483c-823e-dc621f2bb109 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:31.290520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f904d45-82d9-454c-8dbf-f7746c99d06c None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:31.290850 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f904d45-82d9-454c-8dbf-f7746c99d06c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:31.291095 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f904d45-82d9-454c-8dbf-f7746c99d06c None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:31.293450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 422/860] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:31.300580 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53a182-30db-4467-9dea-3294667fc796 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:31.300908 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53a182-30db-4467-9dea-3294667fc796 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:31.301147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53a182-30db-4467-9dea-3294667fc796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:31.360764 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6f53a182-30db-4467-9dea-3294667fc796 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:31.364870 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6f53a182-30db-4467-9dea-3294667fc796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:31.372078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0516fad-def9-483c-823e-dc621f2bb109 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:31.410193 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09894ed-9d54-476f-b9dd-d36b257be877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:31.411307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09894ed-9d54-476f-b9dd-d36b257be877 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:31.411803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09894ed-9d54-476f-b9dd-d36b257be877 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:31.412264 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09894ed-9d54-476f-b9dd-d36b257be877 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:31.414111 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09894ed-9d54-476f-b9dd-d36b257be877 None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:31.414777 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09894ed-9d54-476f-b9dd-d36b257be877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:31.417113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09894ed-9d54-476f-b9dd-d36b257be877 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:31.431045 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 439/861] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:18:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:31.443053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09894ed-9d54-476f-b9dd-d36b257be877 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:31.473585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 423/862] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:31.491478 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:31.570735 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09894ed-9d54-476f-b9dd-d36b257be877 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:31.614353 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551d5e6-8e92-4b16-b0e1-1f07da0088de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:31.615009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551d5e6-8e92-4b16-b0e1-1f07da0088de None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:31.615284 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551d5e6-8e92-4b16-b0e1-1f07da0088de None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:31.615549 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551d5e6-8e92-4b16-b0e1-1f07da0088de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:31.626634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551d5e6-8e92-4b16-b0e1-1f07da0088de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:31.628142 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551d5e6-8e92-4b16-b0e1-1f07da0088de None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:31.643407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-e551d5e6-8e92-4b16-b0e1-1f07da0088de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:31.643407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:31.643407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:31.643407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:31.643407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:31.643407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:31.643407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:31.643407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:31.643407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:31.643407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:31.643407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:31.643407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:31.643407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:31.643407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:31.643407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:31.643407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:31.644403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:31.644403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:31.644403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:31.644403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:31.644403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:31.644403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:31.644403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:31.644403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:31.644403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:31.644403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:31.644403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:31.644403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:31.644403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:31.644403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:31.644403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:31.644403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:31.644403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:31.645493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:31.645493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:31.645493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:31.649437 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 440/863] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:31.651034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53a182-30db-4467-9dea-3294667fc796 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:31.732644 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:31.763382 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53a182-30db-4467-9dea-3294667fc796 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:31.784715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551d5e6-8e92-4b16-b0e1-1f07da0088de None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:31.802140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a980c1-2b66-4844-afd4-e9ac59b0b93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:31.803155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a980c1-2b66-4844-afd4-e9ac59b0b93c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:31.803587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a980c1-2b66-4844-afd4-e9ac59b0b93c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:31.804002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a980c1-2b66-4844-afd4-e9ac59b0b93c None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:31.804799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a980c1-2b66-4844-afd4-e9ac59b0b93c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:31.805285 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a980c1-2b66-4844-afd4-e9ac59b0b93c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:31.807014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a980c1-2b66-4844-afd4-e9ac59b0b93c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:31.820631 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 424/864] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:31.826407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a980c1-2b66-4844-afd4-e9ac59b0b93c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:31.887060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:31.916179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551d5e6-8e92-4b16-b0e1-1f07da0088de None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:31.965510 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba61c9-f6e4-4ece-9fe8-d7211d5276b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:31.967345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba61c9-f6e4-4ece-9fe8-d7211d5276b7 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:31.967851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba61c9-f6e4-4ece-9fe8-d7211d5276b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:31.968347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba61c9-f6e4-4ece-9fe8-d7211d5276b7 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:31.970617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba61c9-f6e4-4ece-9fe8-d7211d5276b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:31.974513 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba61c9-f6e4-4ece-9fe8-d7211d5276b7 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:31.981435 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a980c1-2b66-4844-afd4-e9ac59b0b93c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:32.001253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 441/865] 10.222.0.52 () {60 vars in 1141 bytes} [Mon Aug 29 20:18:31 2022] POST /identity/v3/services => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:18:32.031548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:32.039108 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e6621-6264-41a5-a3e2-907506157a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:32.040156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e6621-6264-41a5-a3e2-907506157a4e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:32.040649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e6621-6264-41a5-a3e2-907506157a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:32.041108 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e6621-6264-41a5-a3e2-907506157a4e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:32.051395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e6621-6264-41a5-a3e2-907506157a4e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:32.053510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e6621-6264-41a5-a3e2-907506157a4e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:32.068350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-293e6621-6264-41a5-a3e2-907506157a4e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:18:32.068350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:32.068350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:32.068350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:32.068350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:32.068350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:32.068350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:32.068350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:32.068350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:32.068350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:32.068350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:32.068350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:32.068350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:32.068350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:32.068350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:32.068350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:32.069493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:32.070456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:32.070456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:32.070456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:32.070456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:32.070456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:32.070456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:32.070456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:32.070456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:32.070456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:18:32.070456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:32.073215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 425/866] 10.222.0.52 () {56 vars in 1117 bytes} [Mon Aug 29 20:18:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:32.082971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba61c9-f6e4-4ece-9fe8-d7211d5276b7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:32.205749 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba61c9-f6e4-4ece-9fe8-d7211d5276b7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:32.242425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bbafb-3bad-4c58-a464-97c4c7f6574c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:32.243814 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bbafb-3bad-4c58-a464-97c4c7f6574c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:32.244224 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bbafb-3bad-4c58-a464-97c4c7f6574c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:32.244635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bbafb-3bad-4c58-a464-97c4c7f6574c None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:32.245630 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bbafb-3bad-4c58-a464-97c4c7f6574c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:32.246096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bbafb-3bad-4c58-a464-97c4c7f6574c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:32.247777 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bbafb-3bad-4c58-a464-97c4c7f6574c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:32.260237 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:32.274539 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 442/867] 10.222.0.52 () {56 vars in 1149 bytes} [Mon Aug 29 20:18:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:32.276627 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e6621-6264-41a5-a3e2-907506157a4e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:32.395791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e6621-6264-41a5-a3e2-907506157a4e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:32.432573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e1bbd-7407-45bc-b058-4ffd1c36fe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:32.433576 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e1bbd-7407-45bc-b058-4ffd1c36fe31 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:32.434081 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e1bbd-7407-45bc-b058-4ffd1c36fe31 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:32.434591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e1bbd-7407-45bc-b058-4ffd1c36fe31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:32.510920 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e1bbd-7407-45bc-b058-4ffd1c36fe31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:32.512766 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e1bbd-7407-45bc-b058-4ffd1c36fe31 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:32.515346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:32.625502 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 426/868] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:18:32 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:18:32.627714 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bbafb-3bad-4c58-a464-97c4c7f6574c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:32.743009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bbafb-3bad-4c58-a464-97c4c7f6574c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:32.781251 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7da017-8947-4961-aef6-1aa63c11b353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:32.781875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7da017-8947-4961-aef6-1aa63c11b353 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:32.782153 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7da017-8947-4961-aef6-1aa63c11b353 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:32.782421 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7da017-8947-4961-aef6-1aa63c11b353 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:32.790588 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cb812-a986-47ce-b228-10a609fbf777 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:32.790917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cb812-a986-47ce-b228-10a609fbf777 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:32.791137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cb812-a986-47ce-b228-10a609fbf777 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:32.792764 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 427/869] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:32.797964 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4500be9-047d-4bff-a563-1f38f185977c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:32.798448 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4500be9-047d-4bff-a563-1f38f185977c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:32.798802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4500be9-047d-4bff-a563-1f38f185977c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:32.799550 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7da017-8947-4961-aef6-1aa63c11b353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:32.801214 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7da017-8947-4961-aef6-1aa63c11b353 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:32.817789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-0a7da017-8947-4961-aef6-1aa63c11b353 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:32.817789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:32.817789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:32.817789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:32.817789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:32.817789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:32.817789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:32.817789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:32.817789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:32.817789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:32.817789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:32.817789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:32.817789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:32.817789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:32.817789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:32.817789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:32.818834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:32.818834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:32.818834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:32.818834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:32.818834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:32.818834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:32.818834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:32.818834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:32.818834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:32.818834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:32.818834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:32.818834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:32.818834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:32.818834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:32.818834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:32.818834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:32.818834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:32.819741 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:32.819741 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:32.819741 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:32.819934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c4500be9-047d-4bff-a563-1f38f185977c None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:32.821231 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c4500be9-047d-4bff-a563-1f38f185977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:32.821881 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 443/870] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:32.833410 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7da017-8947-4961-aef6-1aa63c11b353 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:32.882739 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:32.922758 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 428/871] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:32 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:32.940229 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7da017-8947-4961-aef6-1aa63c11b353 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:32.945279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdfb33-0bcd-42ce-b49c-8a2abc927ddf None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:32.945586 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdfb33-0bcd-42ce-b49c-8a2abc927ddf None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:32.945866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdfb33-0bcd-42ce-b49c-8a2abc927ddf None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:32.947470 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 429/872] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:18:32.952971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba406a2-3be4-4080-9ea0-a821ab19ef86 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:32.953586 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba406a2-3be4-4080-9ea0-a821ab19ef86 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:32.954063 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba406a2-3be4-4080-9ea0-a821ab19ef86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:32.973315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-9ba406a2-3be4-4080-9ea0-a821ab19ef86 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:32.975098 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9ba406a2-3be4-4080-9ea0-a821ab19ef86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:32.976692 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c71a7-b56e-415f-81d7-c30e247308a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:32.977309 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c71a7-b56e-415f-81d7-c30e247308a3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:32.977622 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c71a7-b56e-415f-81d7-c30e247308a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:32.977895 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c71a7-b56e-415f-81d7-c30e247308a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:32.978601 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c71a7-b56e-415f-81d7-c30e247308a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:32.978909 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c71a7-b56e-415f-81d7-c30e247308a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:32.980328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c71a7-b56e-415f-81d7-c30e247308a3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:32.992586 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:32.997937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 444/873] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:32.999336 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c71a7-b56e-415f-81d7-c30e247308a3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:33.064609 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 430/874] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:32 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:33.111421 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c71a7-b56e-415f-81d7-c30e247308a3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:33.124829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:33.154633 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017e227-8cef-40e1-badf-1a616ed77a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:33.155284 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017e227-8cef-40e1-badf-1a616ed77a14 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:33.155561 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017e227-8cef-40e1-badf-1a616ed77a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:33.155829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017e227-8cef-40e1-badf-1a616ed77a14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:33.163784 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017e227-8cef-40e1-badf-1a616ed77a14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:33.165259 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017e227-8cef-40e1-badf-1a616ed77a14 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:33.177415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-0017e227-8cef-40e1-badf-1a616ed77a14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:33.177415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:33.177415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:33.177415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:33.177415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:33.177415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:33.177415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:33.177415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:33.177415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:33.177415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:33.177415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:33.177415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:33.177415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:33.177415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:33.177415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:33.178344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:33.178344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:33.178344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:33.178344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:33.178344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:33.178344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:33.178344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:33.178344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:33.178344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:33.178344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:33.178344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:33.178344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:33.178344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:33.178344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:33.178344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:33.178344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:33.178344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:33.179257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:33.179257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:33.179257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:33.179257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:33.179257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:33.179257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:33.179257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:33.179257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:33.179257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 445/875] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:33.185224 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba406a2-3be4-4080-9ea0-a821ab19ef86 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:33.190569 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017e227-8cef-40e1-badf-1a616ed77a14 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:33.299025 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba406a2-3be4-4080-9ea0-a821ab19ef86 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:33.333020 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017e227-8cef-40e1-badf-1a616ed77a14 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:33.351815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b26ff-fd79-4fed-b27c-16326027af08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:33.352806 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b26ff-fd79-4fed-b27c-16326027af08 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:33.353321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b26ff-fd79-4fed-b27c-16326027af08 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:33.353766 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b26ff-fd79-4fed-b27c-16326027af08 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:33.354610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b26ff-fd79-4fed-b27c-16326027af08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:33.355343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b26ff-fd79-4fed-b27c-16326027af08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:33.356989 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b26ff-fd79-4fed-b27c-16326027af08 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:33.375496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b289d5-9595-413d-8bab-b77858bcc0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:33.375496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b289d5-9595-413d-8bab-b77858bcc0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:33.375496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b289d5-9595-413d-8bab-b77858bcc0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:33.375496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b289d5-9595-413d-8bab-b77858bcc0d2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:33.375921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 431/876] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:33.375997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b289d5-9595-413d-8bab-b77858bcc0d2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:33.376066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b26ff-fd79-4fed-b27c-16326027af08 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:33.376143 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b289d5-9595-413d-8bab-b77858bcc0d2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:33.384865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-95b289d5-9595-413d-8bab-b77858bcc0d2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:18:33.384865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:33.384865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:33.384865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:33.384865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:33.384865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:33.384865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:33.384865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:33.384865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:18:33.384865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:33.384865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:33.384865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:33.384865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:33.384865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:33.384865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:33.384865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:33.384865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:33.385981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:33.385981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:33.385981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:33.385981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:33.385981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:33.385981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:33.385981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:33.385981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:33.385981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:33.385981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:33.385981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:33.385981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:33.385981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:33.385981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:33.385981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:33.385981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:33.390626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:33.390626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:33.390626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:33.390626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:33.390626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:33.390626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:33.390626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:33.390626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:33.390626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:33.390626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:33.390626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:33.390626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:33.390626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:18:33.390626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:33.390626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 446/877] 10.222.0.52 () {56 vars in 1126 bytes} [Mon Aug 29 20:18:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:33.391509 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b289d5-9595-413d-8bab-b77858bcc0d2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:33.392418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:33.426282 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:33.494840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b26ff-fd79-4fed-b27c-16326027af08 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:33.496718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b289d5-9595-413d-8bab-b77858bcc0d2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:33.534636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7445cb9-6c49-4649-8a8e-f7f5d9f430de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:33.534850 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f2d28-f8f8-456d-a9cd-eb51d85ab155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:33.535242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7445cb9-6c49-4649-8a8e-f7f5d9f430de None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:33.535381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f2d28-f8f8-456d-a9cd-eb51d85ab155 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:33.535503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7445cb9-6c49-4649-8a8e-f7f5d9f430de None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:33.535584 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f2d28-f8f8-456d-a9cd-eb51d85ab155 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:33.535793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7445cb9-6c49-4649-8a8e-f7f5d9f430de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:33.535887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f2d28-f8f8-456d-a9cd-eb51d85ab155 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:33.536456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f2d28-f8f8-456d-a9cd-eb51d85ab155 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:33.536556 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7445cb9-6c49-4649-8a8e-f7f5d9f430de None admin] RBAC: Adding query filter params (role.id=8352f2960aa74837804150f4c8774dbc, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=0327aa38835f41a7a82802f9cad2e6d2) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:33.536788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7445cb9-6c49-4649-8a8e-f7f5d9f430de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:33.537878 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f2d28-f8f8-456d-a9cd-eb51d85ab155 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:33.538239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7445cb9-6c49-4649-8a8e-f7f5d9f430de None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:33.546240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 447/878] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:18:33 2022] GET /identity/v3/role_assignments?user.id=0327aa38835f41a7a82802f9cad2e6d2&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=8352f2960aa74837804150f4c8774dbc => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:33.547517 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7445cb9-6c49-4649-8a8e-f7f5d9f430de None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:33.569307 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 432/879] 10.222.0.52 () {60 vars in 1141 bytes} [Mon Aug 29 20:18:33 2022] POST /identity/v3/services => generated 269 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:18:33.680215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:33.685388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7445cb9-6c49-4649-8a8e-f7f5d9f430de None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:33.736598 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a108d0-92fe-4707-9ef4-6a187f5a2c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:33.737275 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a108d0-92fe-4707-9ef4-6a187f5a2c0c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:33.737592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a108d0-92fe-4707-9ef4-6a187f5a2c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:33.737864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a108d0-92fe-4707-9ef4-6a187f5a2c0c None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:33.738500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a108d0-92fe-4707-9ef4-6a187f5a2c0c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:33.738800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a108d0-92fe-4707-9ef4-6a187f5a2c0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:33.740197 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a108d0-92fe-4707-9ef4-6a187f5a2c0c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:33.746618 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 448/880] 10.222.0.52 () {56 vars in 1122 bytes} [Mon Aug 29 20:18:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:33.751960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f2d28-f8f8-456d-a9cd-eb51d85ab155 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:33.833740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:33.872728 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f2d28-f8f8-456d-a9cd-eb51d85ab155 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:33.909734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24428e4-0053-48f8-a657-b966f1aef824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:33.910589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24428e4-0053-48f8-a657-b966f1aef824 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:33.911002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24428e4-0053-48f8-a657-b966f1aef824 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:33.911434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24428e4-0053-48f8-a657-b966f1aef824 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:33.912209 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24428e4-0053-48f8-a657-b966f1aef824 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:33.912642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24428e4-0053-48f8-a657-b966f1aef824 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:33.914234 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24428e4-0053-48f8-a657-b966f1aef824 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:33.919937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 433/881] 10.222.0.52 () {56 vars in 1122 bytes} [Mon Aug 29 20:18:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:34.132874 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1dbe3-29e7-4385-ab37-ef295b4735c5 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:34.133192 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1dbe3-29e7-4385-ab37-ef295b4735c5 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:34.133501 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1dbe3-29e7-4385-ab37-ef295b4735c5 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:34.135116 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 449/882] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:34.140666 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67b74-81ed-48dc-8866-53abcb08ec3a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:34.140953 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67b74-81ed-48dc-8866-53abcb08ec3a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:34.141230 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67b74-81ed-48dc-8866-53abcb08ec3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:34.164543 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-73a67b74-81ed-48dc-8866-53abcb08ec3a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:34.165787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-73a67b74-81ed-48dc-8866-53abcb08ec3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:34.247571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 434/883] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:34.518046 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1dbe3-29e7-4385-ab37-ef295b4735c5 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:34.625787 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1dbe3-29e7-4385-ab37-ef295b4735c5 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:34.662419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1c02a-235e-45c2-8ce1-98a2c4cf57b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:34.663056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1c02a-235e-45c2-8ce1-98a2c4cf57b6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:34.663332 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1c02a-235e-45c2-8ce1-98a2c4cf57b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:34.663599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1c02a-235e-45c2-8ce1-98a2c4cf57b6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:34.664177 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1c02a-235e-45c2-8ce1-98a2c4cf57b6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:34.665591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1c02a-235e-45c2-8ce1-98a2c4cf57b6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:34.674854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-ffb1c02a-235e-45c2-8ce1-98a2c4cf57b6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:18:34.674854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:34.674854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:34.674854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:34.674854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:34.674854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:34.674854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:34.674854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:34.674854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:18:34.674854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:34.674854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:34.674854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:34.674854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:34.674854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:34.674854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:34.674854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:34.674854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:34.675918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:34.675918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:34.675918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:34.675918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:34.675918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:34.675918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:34.675918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:34.675918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:34.675918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:34.675918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:34.675918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:34.675918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:34.675918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:34.675918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:34.675918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:34.675918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:34.676747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:34.676747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:34.676747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:34.676747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:34.676747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:34.676747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:34.676747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:34.676747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:34.676747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:34.676747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:34.676747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:34.676747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:34.676747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:18:34.676747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:34.676747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 450/884] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:18:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:34.682095 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a67b74-81ed-48dc-8866-53abcb08ec3a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:34.753788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:34.797244 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a67b74-81ed-48dc-8866-53abcb08ec3a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:34.833757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed91b00-6868-406f-8e6e-b6da8ef1f0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:34.834385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed91b00-6868-406f-8e6e-b6da8ef1f0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:34.834666 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed91b00-6868-406f-8e6e-b6da8ef1f0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:34.834938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed91b00-6868-406f-8e6e-b6da8ef1f0c9 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:34.835579 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed91b00-6868-406f-8e6e-b6da8ef1f0c9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:34.835882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed91b00-6868-406f-8e6e-b6da8ef1f0c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:34.837268 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed91b00-6868-406f-8e6e-b6da8ef1f0c9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:34.843054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 435/885] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:18:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:34.848784 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1c02a-235e-45c2-8ce1-98a2c4cf57b6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:34.877050 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:34.957173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1c02a-235e-45c2-8ce1-98a2c4cf57b6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:34.993645 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983b7c1-d076-4638-b8d9-d451090b0a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:34.994256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983b7c1-d076-4638-b8d9-d451090b0a34 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:34.994529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983b7c1-d076-4638-b8d9-d451090b0a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:34.994794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983b7c1-d076-4638-b8d9-d451090b0a34 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:34.995554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983b7c1-d076-4638-b8d9-d451090b0a34 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:34.995864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983b7c1-d076-4638-b8d9-d451090b0a34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:34.997529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983b7c1-d076-4638-b8d9-d451090b0a34 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:35.003404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 451/886] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:18:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:35.009318 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed91b00-6868-406f-8e6e-b6da8ef1f0c9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:35.121119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed91b00-6868-406f-8e6e-b6da8ef1f0c9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:35.150291 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:35.158604 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa49e1c-0fcb-4d8f-b073-31d1bae0c9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:35.159222 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa49e1c-0fcb-4d8f-b073-31d1bae0c9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:35.159500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa49e1c-0fcb-4d8f-b073-31d1bae0c9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:35.159772 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa49e1c-0fcb-4d8f-b073-31d1bae0c9d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:35.160681 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa49e1c-0fcb-4d8f-b073-31d1bae0c9d8 None admin] RBAC: Adding query filter params (interface=public, service_id=5b5558c81a224aeabe8625adb465a150, region_id=RegionOne) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:35.160991 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa49e1c-0fcb-4d8f-b073-31d1bae0c9d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:35.162485 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa49e1c-0fcb-4d8f-b073-31d1bae0c9d8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:35.168609 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 436/887] 10.222.0.52 () {56 vars in 1251 bytes} [Mon Aug 29 20:18:35 2022] GET /identity/v3/endpoints?service_id=5b5558c81a224aeabe8625adb465a150&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:35.174354 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983b7c1-d076-4638-b8d9-d451090b0a34 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:35.267876 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:35.283274 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983b7c1-d076-4638-b8d9-d451090b0a34 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:35.320821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5564999-3c7e-4462-ba80-15cde4de586c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:35.321482 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5564999-3c7e-4462-ba80-15cde4de586c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:35.321783 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5564999-3c7e-4462-ba80-15cde4de586c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:35.322132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5564999-3c7e-4462-ba80-15cde4de586c None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:35.322763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5564999-3c7e-4462-ba80-15cde4de586c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:35.324176 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5564999-3c7e-4462-ba80-15cde4de586c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:35.332166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 452/888] 10.222.0.52 () {56 vars in 1087 bytes} [Mon Aug 29 20:18:35 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:18:35.593322 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda245f-7f3d-4df1-b010-40aafa640156 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:35.593656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda245f-7f3d-4df1-b010-40aafa640156 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:35.593972 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda245f-7f3d-4df1-b010-40aafa640156 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:35.595634 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 437/889] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:35.601115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b9e95-8419-48a7-9ad6-b8e3ae98fb30 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:35.601617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b9e95-8419-48a7-9ad6-b8e3ae98fb30 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:35.601730 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b9e95-8419-48a7-9ad6-b8e3ae98fb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:35.621621 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f80b9e95-8419-48a7-9ad6-b8e3ae98fb30 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:35.622817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f80b9e95-8419-48a7-9ad6-b8e3ae98fb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:35.695705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 453/890] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:35.785182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317dfc2-756f-47fd-a249-d680bfeabf5a None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:35.785836 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317dfc2-756f-47fd-a249-d680bfeabf5a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:35.785836 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317dfc2-756f-47fd-a249-d680bfeabf5a None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:35.787321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 438/891] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:35.793912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5de94a-9ec5-4f5c-af6e-b227163838df None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:35.794570 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5de94a-9ec5-4f5c-af6e-b227163838df None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:35.795111 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5de94a-9ec5-4f5c-af6e-b227163838df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:35.815223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-dc5de94a-9ec5-4f5c-af6e-b227163838df None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:35.816829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-dc5de94a-9ec5-4f5c-af6e-b227163838df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:35.891389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 454/892] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:35.909581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fe532-3e86-45e2-82b7-34b8b7e18f38 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:35.910211 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fe532-3e86-45e2-82b7-34b8b7e18f38 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:35.910687 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fe532-3e86-45e2-82b7-34b8b7e18f38 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:35.912263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 439/893] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:35.919161 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864620b-9327-4e05-99f1-03a0881fcfae None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:35.919745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864620b-9327-4e05-99f1-03a0881fcfae None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:35.920387 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864620b-9327-4e05-99f1-03a0881fcfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:35.941035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e864620b-9327-4e05-99f1-03a0881fcfae None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:35.942601 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e864620b-9327-4e05-99f1-03a0881fcfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:35.945830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:35.970158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fe532-3e86-45e2-82b7-34b8b7e18f38 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:36.037322 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 455/894] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:36.100798 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fe532-3e86-45e2-82b7-34b8b7e18f38 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:36.138309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b8c9b-2080-4b62-8921-91f985f868e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:36.138967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b8c9b-2080-4b62-8921-91f985f868e5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:36.139455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b8c9b-2080-4b62-8921-91f985f868e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:36.139897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b8c9b-2080-4b62-8921-91f985f868e5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:36.140559 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b8c9b-2080-4b62-8921-91f985f868e5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:36.142302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b8c9b-2080-4b62-8921-91f985f868e5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:36.151971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-a55b8c9b-2080-4b62-8921-91f985f868e5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:18:36.151971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:36.151971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:36.151971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:36.151971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:36.151971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:36.151971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:36.151971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:36.151971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:18:36.151971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:36.151971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:36.151971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:36.151971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:36.151971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:36.151971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:36.151971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:36.153049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:36.153049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:36.153049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:36.153049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:36.153049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:36.153049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:36.153049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:36.153049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:36.153049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:36.153049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:36.153049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:36.153049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:36.153049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:36.153049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:36.153049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:36.153049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:36.153049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:36.153994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:36.153994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:36.153994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:36.153994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:36.153994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:36.153994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:36.153994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:36.153994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:36.153994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:36.153994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:36.153994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:36.153994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:36.153994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:18:36.153994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:36.153994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 440/895] 10.222.0.52 () {56 vars in 1132 bytes} [Mon Aug 29 20:18:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:36.163950 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864620b-9327-4e05-99f1-03a0881fcfae None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:36.175381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b8c9b-2080-4b62-8921-91f985f868e5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:36.239512 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:36.300534 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b8c9b-2080-4b62-8921-91f985f868e5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:36.304651 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864620b-9327-4e05-99f1-03a0881fcfae None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:36.344012 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a16253-73e1-4cac-91fc-a2c95fc9c66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:36.344840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a16253-73e1-4cac-91fc-a2c95fc9c66f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:36.345182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a16253-73e1-4cac-91fc-a2c95fc9c66f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:36.345564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a16253-73e1-4cac-91fc-a2c95fc9c66f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:36.353183 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5e857-e466-4d7c-862b-01a38d62731b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:36.353938 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5e857-e466-4d7c-862b-01a38d62731b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:36.354285 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5e857-e466-4d7c-862b-01a38d62731b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:36.354629 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5e857-e466-4d7c-862b-01a38d62731b None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:36.355414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5e857-e466-4d7c-862b-01a38d62731b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:36.355743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5e857-e466-4d7c-862b-01a38d62731b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:36.357232 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5e857-e466-4d7c-862b-01a38d62731b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:36.358210 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a16253-73e1-4cac-91fc-a2c95fc9c66f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:36.362803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 456/896] 10.222.0.52 () {56 vars in 1126 bytes} [Mon Aug 29 20:18:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:36.363530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-23a16253-73e1-4cac-91fc-a2c95fc9c66f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:18:36.363530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:36.363530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:36.363530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:36.363530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:36.363530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:36.363530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:36.363530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:36.363530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:36.363530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:36.363530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:36.363530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:36.363530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:36.363530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:36.363530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:36.363530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:36.364434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:36.364434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:36.364434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:36.364434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:36.364434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:36.364434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:36.364434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:36.364434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:36.364434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:36.364434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:36.364434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:36.364434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:36.364434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:36.364434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:36.364434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:36.364434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:36.365279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:36.365279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:36.365279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:36.365279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:36.365279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:36.365279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:36.365279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:36.365279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:36.365279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:36.365279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:36.365279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:18:36.365279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:36.365942 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5e857-e466-4d7c-862b-01a38d62731b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:36.366020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 441/897] 10.222.0.52 () {56 vars in 1120 bytes} [Mon Aug 29 20:18:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:36.370316 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a16253-73e1-4cac-91fc-a2c95fc9c66f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:36.372688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:36.478534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5e857-e466-4d7c-862b-01a38d62731b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:36.489265 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a16253-73e1-4cac-91fc-a2c95fc9c66f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:36.507924 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:36.515086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d6da8-eabd-4dcc-bc6b-00fa6bd20be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:36.515699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d6da8-eabd-4dcc-bc6b-00fa6bd20be8 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:36.515967 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d6da8-eabd-4dcc-bc6b-00fa6bd20be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:36.516251 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d6da8-eabd-4dcc-bc6b-00fa6bd20be8 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:36.517252 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d6da8-eabd-4dcc-bc6b-00fa6bd20be8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:36.518690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d6da8-eabd-4dcc-bc6b-00fa6bd20be8 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:36.528352 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23918a1-ffef-43cc-a902-6d0c00034025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:36.528938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23918a1-ffef-43cc-a902-6d0c00034025 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:36.530464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23918a1-ffef-43cc-a902-6d0c00034025 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:36.530464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23918a1-ffef-43cc-a902-6d0c00034025 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:36.530464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23918a1-ffef-43cc-a902-6d0c00034025 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:36.530464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23918a1-ffef-43cc-a902-6d0c00034025 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:36.531771 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23918a1-ffef-43cc-a902-6d0c00034025 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:36.541393 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 457/898] 10.222.0.52 () {60 vars in 1141 bytes} [Mon Aug 29 20:18:36 2022] POST /identity/v3/services => generated 241 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:18:36.541393 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d6da8-eabd-4dcc-bc6b-00fa6bd20be8 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:36.545404 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 442/899] 10.222.0.52 () {56 vars in 1126 bytes} [Mon Aug 29 20:18:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:36.545404 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23918a1-ffef-43cc-a902-6d0c00034025 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:36.623381 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:36.675345 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23918a1-ffef-43cc-a902-6d0c00034025 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:36.692795 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d6da8-eabd-4dcc-bc6b-00fa6bd20be8 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:36.729831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd17da6-f280-4768-9d31-c8e6721719dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:36.730867 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd17da6-f280-4768-9d31-c8e6721719dc None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:36.731148 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd17da6-f280-4768-9d31-c8e6721719dc None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:36.731421 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd17da6-f280-4768-9d31-c8e6721719dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:36.732145 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd17da6-f280-4768-9d31-c8e6721719dc None admin] RBAC: Adding query filter params (interface=public, service_id=4f9fe7dd69654781973637bae4f17fe9, region_id=RegionOne) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:36.732343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a6000-a282-4a7f-9929-e001b67dad48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:36.732484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd17da6-f280-4768-9d31-c8e6721719dc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:36.733213 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6000-a282-4a7f-9929-e001b67dad48 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:36.733658 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6000-a282-4a7f-9929-e001b67dad48 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:36.733861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd17da6-f280-4768-9d31-c8e6721719dc None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:36.734198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6000-a282-4a7f-9929-e001b67dad48 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:36.735016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a6000-a282-4a7f-9929-e001b67dad48 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:36.735465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a6000-a282-4a7f-9929-e001b67dad48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:36.736835 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a6000-a282-4a7f-9929-e001b67dad48 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:36.740269 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 443/900] 10.222.0.52 () {56 vars in 1251 bytes} [Mon Aug 29 20:18:36 2022] GET /identity/v3/endpoints?service_id=4f9fe7dd69654781973637bae4f17fe9&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:36.746610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd17da6-f280-4768-9d31-c8e6721719dc None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:36.749287 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 458/901] 10.222.0.52 () {56 vars in 1115 bytes} [Mon Aug 29 20:18:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:36.755009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a6000-a282-4a7f-9929-e001b67dad48 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:36.800527 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:36.871059 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd17da6-f280-4768-9d31-c8e6721719dc None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:36.890310 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a6000-a282-4a7f-9929-e001b67dad48 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:36.918926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:36.922679 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26253e1b-d8a4-42e6-9399-d74979a4c4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:36.923671 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26253e1b-d8a4-42e6-9399-d74979a4c4ad None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:36.924082 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26253e1b-d8a4-42e6-9399-d74979a4c4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:36.924520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26253e1b-d8a4-42e6-9399-d74979a4c4ad None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:36.925142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26253e1b-d8a4-42e6-9399-d74979a4c4ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:36.927293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26253e1b-d8a4-42e6-9399-d74979a4c4ad None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:36.931590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703fafd-4e6c-4b6b-976c-cf245cafd4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:36.932228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703fafd-4e6c-4b6b-976c-cf245cafd4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:36.932501 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703fafd-4e6c-4b6b-976c-cf245cafd4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:36.932767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703fafd-4e6c-4b6b-976c-cf245cafd4b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:36.934334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 444/902] 10.222.0.52 () {56 vars in 1087 bytes} [Mon Aug 29 20:18:36 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:18:36.946568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703fafd-4e6c-4b6b-976c-cf245cafd4b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:36.948076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703fafd-4e6c-4b6b-976c-cf245cafd4b9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:36.966349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-a703fafd-4e6c-4b6b-976c-cf245cafd4b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:36.966349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:36.966349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:36.966349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:36.966349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:36.966349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:36.966349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:36.966349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:36.966349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:36.966349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:36.966349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:36.966349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:36.966349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:36.966349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:36.966349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:36.966349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:36.967379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:36.967379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:36.967379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:36.967379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:36.967379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:36.967379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:36.967379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:36.967379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:36.967379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:36.967379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:36.967379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:36.967379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:36.967379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:36.967379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:36.967379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:36.967379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:36.967379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:36.968913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:36.968913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:36.968913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:36.968913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 459/903] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:36.973536 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26253e1b-d8a4-42e6-9399-d74979a4c4ad None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:37.104857 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26253e1b-d8a4-42e6-9399-d74979a4c4ad None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:37.115312 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:37.146166 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c2591-b089-425e-a74d-905a1eb4bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:37.146844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c2591-b089-425e-a74d-905a1eb4bee6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:37.147122 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c2591-b089-425e-a74d-905a1eb4bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:37.147388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c2591-b089-425e-a74d-905a1eb4bee6 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:37.148105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c2591-b089-425e-a74d-905a1eb4bee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:37.148407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c2591-b089-425e-a74d-905a1eb4bee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:37.149842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c2591-b089-425e-a74d-905a1eb4bee6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:37.165576 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 445/904] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:37.171236 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703fafd-4e6c-4b6b-976c-cf245cafd4b9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:37.283171 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703fafd-4e6c-4b6b-976c-cf245cafd4b9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:37.320073 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26799ed8-d863-421b-b6d2-cc9eb28a31f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:37.320970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26799ed8-d863-421b-b6d2-cc9eb28a31f9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:37.321255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26799ed8-d863-421b-b6d2-cc9eb28a31f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:37.321557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26799ed8-d863-421b-b6d2-cc9eb28a31f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:37.330573 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26799ed8-d863-421b-b6d2-cc9eb28a31f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:37.332046 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26799ed8-d863-421b-b6d2-cc9eb28a31f9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:37.346356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-26799ed8-d863-421b-b6d2-cc9eb28a31f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:18:37.346356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:37.346356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:37.346356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:37.346356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:37.346356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:37.346356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:37.346356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:37.346356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:37.346356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:37.346356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:37.346356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:37.346356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:37.346356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:37.346356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:37.346356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:37.347762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:37.348905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:37.348905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:37.348905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:37.348905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:37.348905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:37.348905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:37.348905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:37.348905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:37.348905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:18:37.348905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:37.348905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 460/905] 10.222.0.52 () {56 vars in 1117 bytes} [Mon Aug 29 20:18:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:37.353475 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c2591-b089-425e-a74d-905a1eb4bee6 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:37.365573 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e574c3-bd40-4e38-849a-fcce264cfa76 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:37.365860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e574c3-bd40-4e38-849a-fcce264cfa76 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:37.366197 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e574c3-bd40-4e38-849a-fcce264cfa76 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:37.367888 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 461/906] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:18:37.374843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848245d9-210e-478b-956e-64227e42b6ce None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:37.375296 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848245d9-210e-478b-956e-64227e42b6ce None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:37.375636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848245d9-210e-478b-956e-64227e42b6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:37.398251 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-848245d9-210e-478b-956e-64227e42b6ce None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:37.400094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-848245d9-210e-478b-956e-64227e42b6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:37.435610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:37.480868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c2591-b089-425e-a74d-905a1eb4bee6 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:37.482815 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 462/907] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:18:37.525000 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3ef68-5c52-45d2-8187-ba6a3ffba24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:37.525901 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3ef68-5c52-45d2-8187-ba6a3ffba24e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:37.526317 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3ef68-5c52-45d2-8187-ba6a3ffba24e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:37.526726 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3ef68-5c52-45d2-8187-ba6a3ffba24e None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:37.527668 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3ef68-5c52-45d2-8187-ba6a3ffba24e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:37.528111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3ef68-5c52-45d2-8187-ba6a3ffba24e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:37.529772 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3ef68-5c52-45d2-8187-ba6a3ffba24e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:37.549182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 446/908] 10.222.0.52 () {56 vars in 1149 bytes} [Mon Aug 29 20:18:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:37.557179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848245d9-210e-478b-956e-64227e42b6ce None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:37.662912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848245d9-210e-478b-956e-64227e42b6ce None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:37.706129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719e1d8-f975-4687-89a8-6be7e3305c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:37.706747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719e1d8-f975-4687-89a8-6be7e3305c6e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:37.707023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719e1d8-f975-4687-89a8-6be7e3305c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:37.707289 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719e1d8-f975-4687-89a8-6be7e3305c6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:37.739569 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:37.773677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3ef68-5c52-45d2-8187-ba6a3ffba24e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:37.780072 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719e1d8-f975-4687-89a8-6be7e3305c6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:37.782305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719e1d8-f975-4687-89a8-6be7e3305c6e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:37.809858 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:37.907299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3ef68-5c52-45d2-8187-ba6a3ffba24e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:37.916524 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 463/909] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:18:37 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:18:37.917903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719e1d8-f975-4687-89a8-6be7e3305c6e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:37.950655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efea0f4-20f2-45a2-a725-77cb45274ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:37.951294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efea0f4-20f2-45a2-a725-77cb45274ead None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:37.951571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efea0f4-20f2-45a2-a725-77cb45274ead None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:37.951842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efea0f4-20f2-45a2-a725-77cb45274ead None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:37.952429 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efea0f4-20f2-45a2-a725-77cb45274ead None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:37.954023 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efea0f4-20f2-45a2-a725-77cb45274ead None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:37.966011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-0efea0f4-20f2-45a2-a725-77cb45274ead None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:18:37.966011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:37.966011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:37.966011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:37.966011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:37.966011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:37.966011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:37.966011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:37.966011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:18:37.966011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:37.966011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:37.966011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:37.966011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:37.966011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:37.966011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:37.966011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:37.966011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:37.967084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:37.967084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:37.967084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:37.967084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:37.967084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:37.967084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:37.967084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:37.967084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:37.967084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:37.967084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:37.967084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:37.967084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:37.967084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:37.967084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:37.967084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:37.967084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:37.967915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:37.967915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:37.967915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:37.967915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:37.967915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:37.967915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:37.967915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:37.967915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:37.967915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:37.967915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:37.967915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:37.967915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:37.967915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:18:37.967915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:37.967915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 447/910] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:18:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:37.977037 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efea0f4-20f2-45a2-a725-77cb45274ead None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:37.992427 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:38.034365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719e1d8-f975-4687-89a8-6be7e3305c6e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:38.078827 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b274b9a-05b1-4a69-98f1-17744faa0048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:38.079541 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b274b9a-05b1-4a69-98f1-17744faa0048 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:38.079979 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b274b9a-05b1-4a69-98f1-17744faa0048 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:38.080462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b274b9a-05b1-4a69-98f1-17744faa0048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:38.096977 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b274b9a-05b1-4a69-98f1-17744faa0048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:38.098798 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b274b9a-05b1-4a69-98f1-17744faa0048 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:38.112479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:38.119443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-8b274b9a-05b1-4a69-98f1-17744faa0048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:38.119443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:38.119443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:38.119443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:38.119443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:38.119443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:38.119443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:38.119443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:38.119443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:38.119443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:38.119443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:38.119443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:38.119443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:38.119443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:38.119443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:38.119443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:38.120591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:38.120591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:38.120591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:38.120591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:38.120591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:38.120591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:38.120591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:38.120591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:38.120591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:38.120591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:38.120591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:38.120591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:38.120591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:38.120591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:38.120591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:38.120591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:38.120591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:38.121557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:38.121557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:38.121557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:38.121557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 464/911] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:38.126565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b274b9a-05b1-4a69-98f1-17744faa0048 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:38.128541 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efea0f4-20f2-45a2-a725-77cb45274ead None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:38.178799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10950d-31db-489e-bd7a-9f4c86676dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:38.180020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10950d-31db-489e-bd7a-9f4c86676dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:38.180561 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10950d-31db-489e-bd7a-9f4c86676dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:38.181159 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10950d-31db-489e-bd7a-9f4c86676dc9 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:38.182488 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10950d-31db-489e-bd7a-9f4c86676dc9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:38.183273 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10950d-31db-489e-bd7a-9f4c86676dc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:38.185417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10950d-31db-489e-bd7a-9f4c86676dc9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:38.192927 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 448/912] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:18:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:38.201099 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10950d-31db-489e-bd7a-9f4c86676dc9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:38.245985 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b274b9a-05b1-4a69-98f1-17744faa0048 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:38.263875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:38.288709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fdf76-1dca-430d-a2fb-6be3016a9d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:38.290262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fdf76-1dca-430d-a2fb-6be3016a9d7d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:38.290707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fdf76-1dca-430d-a2fb-6be3016a9d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:38.291131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fdf76-1dca-430d-a2fb-6be3016a9d7d None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:38.292183 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83fdf76-1dca-430d-a2fb-6be3016a9d7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:38.292628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83fdf76-1dca-430d-a2fb-6be3016a9d7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:38.295594 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83fdf76-1dca-430d-a2fb-6be3016a9d7d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:38.317219 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 465/913] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:38.319221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fdf76-1dca-430d-a2fb-6be3016a9d7d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:38.336878 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10950d-31db-489e-bd7a-9f4c86676dc9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:38.389052 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7f968-d47a-48ff-a6ff-573d9bac9130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:38.390284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7f968-d47a-48ff-a6ff-573d9bac9130 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:38.391107 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7f968-d47a-48ff-a6ff-573d9bac9130 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:38.391544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7f968-d47a-48ff-a6ff-573d9bac9130 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:38.392597 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7f968-d47a-48ff-a6ff-573d9bac9130 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:38.393060 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7f968-d47a-48ff-a6ff-573d9bac9130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:38.395332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7f968-d47a-48ff-a6ff-573d9bac9130 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:38.407657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 449/914] 10.222.0.52 () {56 vars in 1114 bytes} [Mon Aug 29 20:18:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:38.409311 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7f968-d47a-48ff-a6ff-573d9bac9130 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:38.436302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:38.450944 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fdf76-1dca-430d-a2fb-6be3016a9d7d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:38.497333 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387cf50-3635-4976-8b24-c918e1d0612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:38.498597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387cf50-3635-4976-8b24-c918e1d0612a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:38.499694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387cf50-3635-4976-8b24-c918e1d0612a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:38.500203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387cf50-3635-4976-8b24-c918e1d0612a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:38.509905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387cf50-3635-4976-8b24-c918e1d0612a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:38.512300 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387cf50-3635-4976-8b24-c918e1d0612a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:38.529061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-5387cf50-3635-4976-8b24-c918e1d0612a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:38.529061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:38.529061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:38.529061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:38.529061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:38.529061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:38.529061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:38.529061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:38.529061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:38.529061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:38.529061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:38.529061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:38.529061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:38.529061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:38.529061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:38.530091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:38.530091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:38.530091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:38.530091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:38.530091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:38.530091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:38.530091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:38.530091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:38.530091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:38.530091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:38.530091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:38.530091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:38.530091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:38.530091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:38.530091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:38.530091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:38.530091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:38.531016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:38.531016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:38.531016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:38.531016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:38.531016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:38.531016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:38.531016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:38.531016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:38.538203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 466/915] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:38.539467 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387cf50-3635-4976-8b24-c918e1d0612a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:38.546234 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7f968-d47a-48ff-a6ff-573d9bac9130 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:38.584106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2d694-e3c2-46e4-b6a9-5e4faa25aec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:38.584853 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2d694-e3c2-46e4-b6a9-5e4faa25aec5 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:38.585031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2d694-e3c2-46e4-b6a9-5e4faa25aec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:38.585272 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2d694-e3c2-46e4-b6a9-5e4faa25aec5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:38.586072 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2d694-e3c2-46e4-b6a9-5e4faa25aec5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:38.587450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2d694-e3c2-46e4-b6a9-5e4faa25aec5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:38.589970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:38.624562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 450/916] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:18:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:18:38.624562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7ac29-7177-4db6-a343-3771a7347405 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:38.624562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7ac29-7177-4db6-a343-3771a7347405 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:38.624562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7ac29-7177-4db6-a343-3771a7347405 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:38.624562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 451/917] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:38.626966 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989b19a-f809-45c4-b4ca-78efba851f83 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:38.627336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989b19a-f809-45c4-b4ca-78efba851f83 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:38.627687 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989b19a-f809-45c4-b4ca-78efba851f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:38.651736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f989b19a-f809-45c4-b4ca-78efba851f83 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:38.653249 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f989b19a-f809-45c4-b4ca-78efba851f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:38.687071 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387cf50-3635-4976-8b24-c918e1d0612a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:38.736892 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2916edb-7485-4f6c-b397-51d4c74395b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:38.737782 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2916edb-7485-4f6c-b397-51d4c74395b6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:38.738200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2916edb-7485-4f6c-b397-51d4c74395b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:38.738579 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2916edb-7485-4f6c-b397-51d4c74395b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:38.739361 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2916edb-7485-4f6c-b397-51d4c74395b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:38.739733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2916edb-7485-4f6c-b397-51d4c74395b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:38.741287 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2916edb-7485-4f6c-b397-51d4c74395b6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:38.749888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 452/918] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:18:38.756625 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 467/919] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:38.762958 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989b19a-f809-45c4-b4ca-78efba851f83 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:38.769154 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:38.879868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989b19a-f809-45c4-b4ca-78efba851f83 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:38.918873 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9405510-54b8-4212-99f3-d58015d36176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:38.919854 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9405510-54b8-4212-99f3-d58015d36176 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:38.920355 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9405510-54b8-4212-99f3-d58015d36176 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:38.920826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9405510-54b8-4212-99f3-d58015d36176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:38.921775 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9405510-54b8-4212-99f3-d58015d36176 None admin] RBAC: Adding query filter params (role.id=5a2fa8fc43094a0f9bed98b6e5c4504a, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=0327aa38835f41a7a82802f9cad2e6d2) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:38.922276 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9405510-54b8-4212-99f3-d58015d36176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:38.923903 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9405510-54b8-4212-99f3-d58015d36176 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:38.930636 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 453/920] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:18:38 2022] GET /identity/v3/role_assignments?user.id=0327aa38835f41a7a82802f9cad2e6d2&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=5a2fa8fc43094a0f9bed98b6e5c4504a => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:38.993944 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5fe62-c37a-43ed-9ac8-9d541713a7f0 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:38.994274 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5fe62-c37a-43ed-9ac8-9d541713a7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:38.994494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5fe62-c37a-43ed-9ac8-9d541713a7f0 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:38.996228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 468/921] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:39.002153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38012608-f67a-4cf7-bb73-c958469390e1 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:39.002866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38012608-f67a-4cf7-bb73-c958469390e1 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:39.003336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38012608-f67a-4cf7-bb73-c958469390e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:39.024020 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5fe62-c37a-43ed-9ac8-9d541713a7f0 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:39.024565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-38012608-f67a-4cf7-bb73-c958469390e1 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:39.026068 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-38012608-f67a-4cf7-bb73-c958469390e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:39.112498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:39.115133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 454/922] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:39.144637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:39.155611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5fe62-c37a-43ed-9ac8-9d541713a7f0 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:39.193909 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3cd7e-dea9-4f26-bd6f-226556252063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:39.194619 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3cd7e-dea9-4f26-bd6f-226556252063 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:39.194894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3cd7e-dea9-4f26-bd6f-226556252063 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:39.195163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3cd7e-dea9-4f26-bd6f-226556252063 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:39.195809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3cd7e-dea9-4f26-bd6f-226556252063 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:39.197253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3cd7e-dea9-4f26-bd6f-226556252063 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:39.209495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-e3f3cd7e-dea9-4f26-bd6f-226556252063 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:18:39.209495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:39.209495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:39.209495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:39.209495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:39.209495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:39.209495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:39.209495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:39.209495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:18:39.209495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:39.209495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:39.209495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:39.209495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:39.209495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:39.209495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:39.209495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:39.209495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:39.210532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:39.210532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:39.210532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:39.210532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:39.210532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:39.210532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:39.210532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:39.210532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:39.210532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:39.210532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:39.210532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:39.210532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:39.210532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:39.210532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:39.210532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:39.210532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:39.211369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:39.211369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:39.211369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:39.211369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:39.211369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:39.211369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:39.211369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:39.211369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:39.211369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:39.211369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:39.211369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:39.211369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:39.211369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:18:39.211369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:39.211369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 469/923] 10.222.0.52 () {56 vars in 1126 bytes} [Mon Aug 29 20:18:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:39.217268 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38012608-f67a-4cf7-bb73-c958469390e1 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:39.331892 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38012608-f67a-4cf7-bb73-c958469390e1 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:39.371302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f0561-daf2-4415-8479-d0e2d002346a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:39.371969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f0561-daf2-4415-8479-d0e2d002346a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:39.372246 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f0561-daf2-4415-8479-d0e2d002346a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:39.372511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f0561-daf2-4415-8479-d0e2d002346a None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:39.373154 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f0561-daf2-4415-8479-d0e2d002346a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:39.373486 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f0561-daf2-4415-8479-d0e2d002346a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:39.375049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f0561-daf2-4415-8479-d0e2d002346a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:39.384332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 455/924] 10.222.0.52 () {56 vars in 1122 bytes} [Mon Aug 29 20:18:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:39.385936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3cd7e-dea9-4f26-bd6f-226556252063 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:39.387142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f0561-daf2-4415-8479-d0e2d002346a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:39.466761 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:39.511452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3cd7e-dea9-4f26-bd6f-226556252063 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:39.519495 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f0561-daf2-4415-8479-d0e2d002346a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:39.550710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf883925-1396-42a1-9a24-7f92e2189b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:39.551442 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf883925-1396-42a1-9a24-7f92e2189b0f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:39.551722 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf883925-1396-42a1-9a24-7f92e2189b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:39.551990 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf883925-1396-42a1-9a24-7f92e2189b0f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:39.552577 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf883925-1396-42a1-9a24-7f92e2189b0f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:39.554117 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf883925-1396-42a1-9a24-7f92e2189b0f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:39.563971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-cf883925-1396-42a1-9a24-7f92e2189b0f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:18:39.563971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:39.563971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:39.563971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:39.563971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:39.563971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:39.563971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:39.563971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:39.563971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:18:39.563971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:39.563971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:39.563971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:39.563971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:39.563971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:39.563971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:39.563971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:39.565163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:39.565163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:39.565163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:39.565163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:39.565163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:39.565163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:39.565163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:39.565163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:39.565163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:39.565163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:39.565163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:39.565163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:39.565163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:39.565163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:39.565163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:39.565163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:39.565163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:39.566262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:39.566262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:39.566262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:39.566262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:39.566262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:39.566262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:39.566262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:39.566262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:39.566262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:39.566262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:39.566262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:39.566262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:39.566262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:18:39.566262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:39.566262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 470/925] 10.222.0.52 () {56 vars in 1132 bytes} [Mon Aug 29 20:18:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:39.572088 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9e792-4e43-4c5e-91f6-85377d4f0e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:39.572856 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9e792-4e43-4c5e-91f6-85377d4f0e29 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:39.573135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9e792-4e43-4c5e-91f6-85377d4f0e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:39.573425 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9e792-4e43-4c5e-91f6-85377d4f0e29 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:39.574021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf883925-1396-42a1-9a24-7f92e2189b0f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:39.574215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9e792-4e43-4c5e-91f6-85377d4f0e29 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:39.574531 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9e792-4e43-4c5e-91f6-85377d4f0e29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:39.575943 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9e792-4e43-4c5e-91f6-85377d4f0e29 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:39.588076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 456/926] 10.222.0.52 () {56 vars in 1122 bytes} [Mon Aug 29 20:18:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:39.589896 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9e792-4e43-4c5e-91f6-85377d4f0e29 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:39.606004 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:39.698250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf883925-1396-42a1-9a24-7f92e2189b0f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:39.722007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9e792-4e43-4c5e-91f6-85377d4f0e29 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:39.748484 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a283b2-bb1f-485d-b437-bb7db7b5d539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:39.749109 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a283b2-bb1f-485d-b437-bb7db7b5d539 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:39.749413 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a283b2-bb1f-485d-b437-bb7db7b5d539 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:39.749695 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a283b2-bb1f-485d-b437-bb7db7b5d539 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:39.750780 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a283b2-bb1f-485d-b437-bb7db7b5d539 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:39.751102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a283b2-bb1f-485d-b437-bb7db7b5d539 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:39.752767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a283b2-bb1f-485d-b437-bb7db7b5d539 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:39.753747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:39.765002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbcf78-8d38-4184-b08c-2564a330da36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:39.765986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 471/927] 10.222.0.52 () {56 vars in 1126 bytes} [Mon Aug 29 20:18:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:39.766683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbcf78-8d38-4184-b08c-2564a330da36 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:39.766952 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a283b2-bb1f-485d-b437-bb7db7b5d539 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:39.767383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbcf78-8d38-4184-b08c-2564a330da36 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:39.767983 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbcf78-8d38-4184-b08c-2564a330da36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:39.769078 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbcf78-8d38-4184-b08c-2564a330da36 None admin] RBAC: Adding query filter params (interface=public, service_id=52dcdf88e5564e0ab538dbe780e91c37, region_id=RegionOne) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:39.769654 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbcf78-8d38-4184-b08c-2564a330da36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:39.771439 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbcf78-8d38-4184-b08c-2564a330da36 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:39.782788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 457/928] 10.222.0.52 () {56 vars in 1251 bytes} [Mon Aug 29 20:18:39 2022] GET /identity/v3/endpoints?service_id=52dcdf88e5564e0ab538dbe780e91c37&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:39.784556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbcf78-8d38-4184-b08c-2564a330da36 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:39.890010 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:39.908993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a283b2-bb1f-485d-b437-bb7db7b5d539 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:39.915568 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbcf78-8d38-4184-b08c-2564a330da36 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:39.948727 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3ea20-855e-47f4-b061-52d8da6114e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:39.950201 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3ea20-855e-47f4-b061-52d8da6114e3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:39.950918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3ea20-855e-47f4-b061-52d8da6114e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:39.951360 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3ea20-855e-47f4-b061-52d8da6114e3 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:39.952174 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3ea20-855e-47f4-b061-52d8da6114e3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:39.952618 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3ea20-855e-47f4-b061-52d8da6114e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:39.954189 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3ea20-855e-47f4-b061-52d8da6114e3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:39.955251 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc322-a3ed-47af-a492-26af5c6f97e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:39.955986 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc322-a3ed-47af-a492-26af5c6f97e4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:39.956360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc322-a3ed-47af-a492-26af5c6f97e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:39.956725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc322-a3ed-47af-a492-26af5c6f97e4 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:39.957467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dc322-a3ed-47af-a492-26af5c6f97e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:39.958907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dc322-a3ed-47af-a492-26af5c6f97e4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:39.961815 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 472/929] 10.222.0.52 () {56 vars in 1126 bytes} [Mon Aug 29 20:18:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:39.967662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3ea20-855e-47f4-b061-52d8da6114e3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:39.977402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 458/930] 10.222.0.52 () {56 vars in 1087 bytes} [Mon Aug 29 20:18:39 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:18:40.097056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3ea20-855e-47f4-b061-52d8da6114e3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:40.138974 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09d1fb-7d06-40d0-8190-a44c638e8089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:40.139595 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09d1fb-7d06-40d0-8190-a44c638e8089 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:40.139870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09d1fb-7d06-40d0-8190-a44c638e8089 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:40.140187 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09d1fb-7d06-40d0-8190-a44c638e8089 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:40.140830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09d1fb-7d06-40d0-8190-a44c638e8089 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:40.142296 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09d1fb-7d06-40d0-8190-a44c638e8089 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:40.165343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 473/931] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:18:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:18:40.712107 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5946434-e7f4-400f-a3f6-33a29f2d943f None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:40.712461 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5946434-e7f4-400f-a3f6-33a29f2d943f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:40.712648 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5946434-e7f4-400f-a3f6-33a29f2d943f None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:40.714636 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 459/932] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:40.720874 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878cf26-dde8-4792-a6ee-d99e720f62ea None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:40.721379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878cf26-dde8-4792-a6ee-d99e720f62ea None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:40.721459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878cf26-dde8-4792-a6ee-d99e720f62ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:40.728809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:40.745973 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d878cf26-dde8-4792-a6ee-d99e720f62ea None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:40.747521 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d878cf26-dde8-4792-a6ee-d99e720f62ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:40.832873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 474/933] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:40.910944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42fb64-1531-4f4a-8897-a833f2a743fa None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:40.911280 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42fb64-1531-4f4a-8897-a833f2a743fa None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:40.911492 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42fb64-1531-4f4a-8897-a833f2a743fa None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:40.912816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 460/934] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:40.918260 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea7d29-067f-481e-a2d3-a544dcc22f61 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:40.918797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea7d29-067f-481e-a2d3-a544dcc22f61 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:40.919269 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea7d29-067f-481e-a2d3-a544dcc22f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:40.938237 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6fea7d29-067f-481e-a2d3-a544dcc22f61 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:40.939784 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6fea7d29-067f-481e-a2d3-a544dcc22f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:41.014695 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 475/935] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:41.098847 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42fb64-1531-4f4a-8897-a833f2a743fa None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:41.162889 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:41.217763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42fb64-1531-4f4a-8897-a833f2a743fa None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:41.256985 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c7345-79df-4f1e-8e11-1bcf2b5f25e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:41.257625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c7345-79df-4f1e-8e11-1bcf2b5f25e4 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:41.257946 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c7345-79df-4f1e-8e11-1bcf2b5f25e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:41.258432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c7345-79df-4f1e-8e11-1bcf2b5f25e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:41.259143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c7345-79df-4f1e-8e11-1bcf2b5f25e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:41.260581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c7345-79df-4f1e-8e11-1bcf2b5f25e4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:41.263434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: WARNING keystone.server.flask.common [None req-8d7c7345-79df-4f1e-8e11-1bcf2b5f25e4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 20:18:41.282624 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.sql.core [None req-8d7c7345-79df-4f1e-8e11-1bcf2b5f25e4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 20:18:41.282624 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 20:18:41.282624 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [parameters: {'id': '4d9741653b4e423c9896e5fb0f0eeb89', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 20:18:41.282624 dv-cinder-854263-2-smb devstack@keystone.service[81540]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81540) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 20:18:41.288868 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea7d29-067f-481e-a2d3-a544dcc22f61 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:41.300704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-8d7c7345-79df-4f1e-8e11-1bcf2b5f25e4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4d9741653b4e423c9896e5fb0f0eeb89.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4d9741653b4e423c9896e5fb0f0eeb89. Aug 29 20:18:41.300704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:41.300704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:18:41.300704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:18:41.300704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:18:41.300704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:18:41.300704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:18:41.300704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:18:41.300704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:18:41.300704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:18:41.300704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:18:41.300704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:18:41.300704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result.read() Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 20:18:41.302329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 20:18:41.304213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:18:41.304213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:18:41.304213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 20:18:41.304213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application yield resource Aug 29 20:18:41.304213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:18:41.304213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:18:41.304213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 20:18:41.304213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 20:18:41.304213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 20:18:41.304213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 20:18:41.304213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 20:18:41.304213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise self.value Aug 29 20:18:41.304213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 20:18:41.304213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 20:18:41.304213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 20:18:41.304213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application session.commit() Aug 29 20:18:41.304213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 20:18:41.307519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 20:18:41.307519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 20:18:41.307519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 20:18:41.307519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 20:18:41.307519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.session.flush() Aug 29 20:18:41.307519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 20:18:41.307519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 20:18:41.307519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 20:18:41.307519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 20:18:41.307519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 20:18:41.307519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application compat.raise_( Aug 29 20:18:41.307519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:18:41.307519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception Aug 29 20:18:41.307519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 20:18:41.307519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 20:18:41.307519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 20:18:41.307519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 20:18:41.311129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 20:18:41.311129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 20:18:41.311129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 20:18:41.311129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 20:18:41.311129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 20:18:41.311129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 20:18:41.311129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 20:18:41.311129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 20:18:41.311129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 20:18:41.311129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 20:18:41.311129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 20:18:41.311129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 20:18:41.311129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 20:18:41.311129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 20:18:41.311129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 20:18:41.314571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 20:18:41.314571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:18:41.314571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception Aug 29 20:18:41.314571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:18:41.314571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:18:41.314571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:18:41.314571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:18:41.314571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:18:41.314571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:18:41.314571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:18:41.314571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:18:41.314571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:18:41.314571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:18:41.314571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:18:41.314571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result.read() Aug 29 20:18:41.314571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:18:41.314571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:18:41.320158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:18:41.320158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:18:41.320158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:18:41.320158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:18:41.320158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:18:41.320158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:18:41.320158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 20:18:41.320158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 20:18:41.320158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [parameters: {'id': '4d9741653b4e423c9896e5fb0f0eeb89', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 20:18:41.320158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 20:18:41.320158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:41.320158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:41.320158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:41.320158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:41.320158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 20:18:41.323062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 20:18:41.323062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 20:18:41.323062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 20:18:41.323062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 20:18:41.323062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:41.323062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:41.323062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:41.323062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:41.323062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:41.323062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:41.323062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:41.323062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:41.323062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:41.323062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:41.323062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:41.323062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:41.323062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:41.326934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:41.326934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 20:18:41.326934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 20:18:41.326934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:41.326934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:41.326934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 20:18:41.326934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 20:18:41.326934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4d9741653b4e423c9896e5fb0f0eeb89. Aug 29 20:18:41.326934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:41.326934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 461/936] 10.222.0.52 () {60 vars in 1140 bytes} [Mon Aug 29 20:18:41 2022] POST /identity/v3/projects => generated 262 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:41.326934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c7345-79df-4f1e-8e11-1bcf2b5f25e4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:41.399835 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:41.438879 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c7345-79df-4f1e-8e11-1bcf2b5f25e4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:41.452138 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:41.460603 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea7d29-067f-481e-a2d3-a544dcc22f61 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:41.484531 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f4e3d-2e56-4a34-b4ce-77993e780138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:41.485581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f4e3d-2e56-4a34-b4ce-77993e780138 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:41.486099 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f4e3d-2e56-4a34-b4ce-77993e780138 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:41.486571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f4e3d-2e56-4a34-b4ce-77993e780138 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:41.495097 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f4e3d-2e56-4a34-b4ce-77993e780138 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:41.497385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f4e3d-2e56-4a34-b4ce-77993e780138 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:41.503150 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414b280-0bb4-4c07-a806-5a3c957e264c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:41.503988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414b280-0bb4-4c07-a806-5a3c957e264c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:41.504264 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414b280-0bb4-4c07-a806-5a3c957e264c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:41.504529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414b280-0bb4-4c07-a806-5a3c957e264c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:41.511582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-047f4e3d-2e56-4a34-b4ce-77993e780138 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:41.511582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:41.511582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:41.511582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:41.511582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:41.511582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:41.511582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:41.511582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:41.511582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:41.511582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:41.511582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:41.511582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:41.511582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:41.511582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:41.511582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:41.512544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:41.512544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:41.512544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:41.512544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:41.512544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:41.512544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:41.512544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:41.512544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:41.512544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:41.512544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:41.512544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:41.512544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:41.512544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:41.512544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:41.512544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:41.512544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:41.512544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:41.513466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:41.513466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:41.513466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:41.513466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:41.513466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:41.513466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:41.513466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:41.513466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:41.515991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414b280-0bb4-4c07-a806-5a3c957e264c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:41.516232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 462/937] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:41.522011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f4e3d-2e56-4a34-b4ce-77993e780138 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:41.523971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-4414b280-0bb4-4c07-a806-5a3c957e264c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:18:41.523971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:41.523971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:41.523971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:41.523971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:41.523971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:41.523971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:41.523971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:41.523971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:41.523971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:41.523971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:41.523971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:41.523971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:41.523971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:41.523971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:41.523971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:41.525067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:41.525067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:41.525067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:41.525067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:41.525067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:41.525067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:41.525067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:41.525067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:41.525067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:41.525067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:41.525067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:41.525067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:41.525067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:41.525067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:41.525067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:41.525067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:41.526131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:41.526131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:41.526131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:41.526131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:41.526131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:41.526131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:41.526131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:41.526131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:41.526131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:41.526131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:41.526131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:18:41.526131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:41.533499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 476/938] 10.222.0.52 () {56 vars in 1120 bytes} [Mon Aug 29 20:18:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:41.538453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414b280-0bb4-4c07-a806-5a3c957e264c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:41.666073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f4e3d-2e56-4a34-b4ce-77993e780138 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:41.666313 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414b280-0bb4-4c07-a806-5a3c957e264c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:41.696485 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:41.710377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f1e77-ecc8-447e-b10a-466351de6343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:41.711412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f1e77-ecc8-447e-b10a-466351de6343 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:41.711917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f1e77-ecc8-447e-b10a-466351de6343 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:41.712396 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f1e77-ecc8-447e-b10a-466351de6343 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:41.713380 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f1e77-ecc8-447e-b10a-466351de6343 None admin] RBAC: Adding query filter params (name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:41.713756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71945166-0a31-4df6-bc78-9993b34f2c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:41.714167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f1e77-ecc8-447e-b10a-466351de6343 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:41.714357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71945166-0a31-4df6-bc78-9993b34f2c91 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:41.714744 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71945166-0a31-4df6-bc78-9993b34f2c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:41.715315 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71945166-0a31-4df6-bc78-9993b34f2c91 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:41.715984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71945166-0a31-4df6-bc78-9993b34f2c91 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:41.716286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71945166-0a31-4df6-bc78-9993b34f2c91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:41.717268 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f1e77-ecc8-447e-b10a-466351de6343 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:41.717668 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71945166-0a31-4df6-bc78-9993b34f2c91 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:41.732515 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 477/939] 10.222.0.52 () {56 vars in 1115 bytes} [Mon Aug 29 20:18:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:41.734460 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71945166-0a31-4df6-bc78-9993b34f2c91 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:41.749475 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 463/940] 10.222.0.52 () {56 vars in 1112 bytes} [Mon Aug 29 20:18:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:41.861323 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71945166-0a31-4df6-bc78-9993b34f2c91 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:41.900604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781374c6-975f-4c6d-bdb5-5990c9a78c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:41.901258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781374c6-975f-4c6d-bdb5-5990c9a78c66 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:41.901567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781374c6-975f-4c6d-bdb5-5990c9a78c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:41.901838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781374c6-975f-4c6d-bdb5-5990c9a78c66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:41.915632 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781374c6-975f-4c6d-bdb5-5990c9a78c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:41.917129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781374c6-975f-4c6d-bdb5-5990c9a78c66 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:41.933861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-781374c6-975f-4c6d-bdb5-5990c9a78c66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:41.933861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:41.933861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:41.933861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:41.933861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:41.933861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:41.933861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:41.933861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:41.933861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:41.933861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:41.933861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:41.933861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:41.933861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:41.933861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:41.933861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:41.933861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:41.934867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:41.934867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:41.934867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:41.934867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:41.934867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:41.934867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:41.934867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:41.934867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:41.934867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:41.934867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:41.934867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:41.934867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:41.934867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:41.934867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:41.934867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:41.934867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:41.934867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:41.935803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:41.935803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:41.935803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:41.935803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 478/941] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:41.943091 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f1e77-ecc8-447e-b10a-466351de6343 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:41.982818 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:42.067516 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f1e77-ecc8-447e-b10a-466351de6343 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:42.089022 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df26dc-9da9-4794-97a9-2db71ed71c7a None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:42.089351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df26dc-9da9-4794-97a9-2db71ed71c7a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:42.089625 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df26dc-9da9-4794-97a9-2db71ed71c7a None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:42.091434 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 479/942] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:18:42.096941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eaca3e-e943-4486-964a-2a2605c5e32b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:42.097227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eaca3e-e943-4486-964a-2a2605c5e32b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:42.097528 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eaca3e-e943-4486-964a-2a2605c5e32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:42.114169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b25f2-3130-4f3a-ac0c-de53150483fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:42.114724 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b25f2-3130-4f3a-ac0c-de53150483fd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:42.114977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b25f2-3130-4f3a-ac0c-de53150483fd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:42.115234 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b25f2-3130-4f3a-ac0c-de53150483fd None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:42.115892 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b25f2-3130-4f3a-ac0c-de53150483fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:42.116201 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b25f2-3130-4f3a-ac0c-de53150483fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:42.117640 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b25f2-3130-4f3a-ac0c-de53150483fd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:42.123047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-25eaca3e-e943-4486-964a-2a2605c5e32b None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:42.124544 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-25eaca3e-e943-4486-964a-2a2605c5e32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:42.131427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 464/943] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:42.140353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b25f2-3130-4f3a-ac0c-de53150483fd None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:42.161169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:42.209293 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 480/944] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:18:42.211118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83faa99-cb1e-4a7b-ab85-c57be12f4c41 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:42.211453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83faa99-cb1e-4a7b-ab85-c57be12f4c41 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:42.211789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83faa99-cb1e-4a7b-ab85-c57be12f4c41 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:42.213549 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 481/945] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:42.219369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadcc68-4a08-48da-afdb-32ba93e7e014 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:42.219650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadcc68-4a08-48da-afdb-32ba93e7e014 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:42.219922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadcc68-4a08-48da-afdb-32ba93e7e014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:42.239887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5eadcc68-4a08-48da-afdb-32ba93e7e014 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:42.241120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5eadcc68-4a08-48da-afdb-32ba93e7e014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:42.262477 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:42.276561 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b25f2-3130-4f3a-ac0c-de53150483fd None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:42.319551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f595c0-6af2-44c1-bf0c-7e5bef784899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:42.320441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 482/946] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:18:42.320944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f595c0-6af2-44c1-bf0c-7e5bef784899 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:42.321452 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f595c0-6af2-44c1-bf0c-7e5bef784899 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:42.321924 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f595c0-6af2-44c1-bf0c-7e5bef784899 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:42.330415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f595c0-6af2-44c1-bf0c-7e5bef784899 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:42.332177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f595c0-6af2-44c1-bf0c-7e5bef784899 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:42.350408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-80f595c0-6af2-44c1-bf0c-7e5bef784899 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:18:42.350408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:42.350408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:42.350408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:42.350408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:42.350408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:42.350408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:42.350408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:42.350408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:42.350408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:42.350408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:42.350408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:42.350408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:42.350408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:42.350408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:42.350408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:42.351405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:42.357144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:42.357144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:42.357144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:42.357144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:42.357144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:42.357144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:42.357144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:42.357144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:42.357144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:18:42.357144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:42.357144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 465/947] 10.222.0.52 () {56 vars in 1117 bytes} [Mon Aug 29 20:18:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:42.362551 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadcc68-4a08-48da-afdb-32ba93e7e014 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:42.468701 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadcc68-4a08-48da-afdb-32ba93e7e014 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:42.478837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:42.485827 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f595c0-6af2-44c1-bf0c-7e5bef784899 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:42.509033 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a2c72-8b1f-4a1e-83a3-621e72db6f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:42.510552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2c72-8b1f-4a1e-83a3-621e72db6f0c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:42.510980 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2c72-8b1f-4a1e-83a3-621e72db6f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:42.511478 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a2c72-8b1f-4a1e-83a3-621e72db6f0c None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:42.512684 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a2c72-8b1f-4a1e-83a3-621e72db6f0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:42.513278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a2c72-8b1f-4a1e-83a3-621e72db6f0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:42.515540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a2c72-8b1f-4a1e-83a3-621e72db6f0c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:42.539577 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 483/948] 10.222.0.52 () {56 vars in 1149 bytes} [Mon Aug 29 20:18:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:42.546082 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a2c72-8b1f-4a1e-83a3-621e72db6f0c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:42.597180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f595c0-6af2-44c1-bf0c-7e5bef784899 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:42.637131 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1eff9-aac2-48cb-8fb3-4ff839e96a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:42.637767 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1eff9-aac2-48cb-8fb3-4ff839e96a19 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:42.637922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1eff9-aac2-48cb-8fb3-4ff839e96a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:42.638167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1eff9-aac2-48cb-8fb3-4ff839e96a19 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:42.638757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1eff9-aac2-48cb-8fb3-4ff839e96a19 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:42.640243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1eff9-aac2-48cb-8fb3-4ff839e96a19 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:42.649332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-e7a1eff9-aac2-48cb-8fb3-4ff839e96a19 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:18:42.649332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:42.649332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:42.649332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:42.649332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:42.649332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:42.649332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:42.649332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:42.649332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:18:42.649332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:42.649332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:42.649332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:42.649332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:42.649332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:42.649332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:42.649332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:42.649332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:42.650407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:42.650407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:42.650407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:42.650407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:42.650407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:42.650407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:42.650407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:42.650407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:42.650407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:42.650407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:42.650407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:42.650407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:42.650407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:42.650407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:42.650407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:42.650407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:42.651263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:42.651263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:42.651263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:42.651263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:42.651263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:42.651263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:42.651263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:42.651263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:42.651263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:42.651263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:42.651263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:42.651263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:42.651263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:18:42.651263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:42.651263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 466/949] 10.222.0.52 () {56 vars in 1126 bytes} [Mon Aug 29 20:18:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:42.652082 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1eff9-aac2-48cb-8fb3-4ff839e96a19 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:42.671225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a2c72-8b1f-4a1e-83a3-621e72db6f0c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:42.673907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:42.712231 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea647616-21d3-4881-917e-5b0c6472e52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:42.713336 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea647616-21d3-4881-917e-5b0c6472e52f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:42.713656 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea647616-21d3-4881-917e-5b0c6472e52f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:42.713925 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea647616-21d3-4881-917e-5b0c6472e52f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:42.725215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea647616-21d3-4881-917e-5b0c6472e52f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:42.726644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea647616-21d3-4881-917e-5b0c6472e52f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:42.742191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-ea647616-21d3-4881-917e-5b0c6472e52f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:42.742191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:42.742191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:42.742191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:42.742191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:42.742191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:42.742191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:42.742191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:42.742191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:42.742191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:42.742191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:42.742191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:42.742191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:42.742191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:42.742191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:42.742191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:42.743654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:42.743654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:42.743654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:42.743654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:42.743654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:42.743654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:42.743654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:42.743654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:42.743654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:42.743654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:42.743654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:42.743654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:42.743654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:42.743654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:42.743654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:42.743654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:42.743654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:42.744545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:42.744545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:42.744545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:42.744545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 484/950] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:42.744777 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea647616-21d3-4881-917e-5b0c6472e52f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:42.752451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:42.775914 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1eff9-aac2-48cb-8fb3-4ff839e96a19 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:42.812916 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdfb31-761f-4dee-a96a-1d8367a7d87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:42.813582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdfb31-761f-4dee-a96a-1d8367a7d87d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:42.813861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdfb31-761f-4dee-a96a-1d8367a7d87d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:42.814127 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdfb31-761f-4dee-a96a-1d8367a7d87d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:42.814710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdfb31-761f-4dee-a96a-1d8367a7d87d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:42.816078 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdfb31-761f-4dee-a96a-1d8367a7d87d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:42.826523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-75cdfb31-761f-4dee-a96a-1d8367a7d87d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:18:42.826523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:42.826523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:42.826523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:42.826523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:42.826523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:42.826523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:42.826523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:42.826523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:18:42.826523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:42.826523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:42.826523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:42.826523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:42.826523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:42.826523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:42.826523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:42.826523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:42.827756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:42.827756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:42.827756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:42.827756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:42.827756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:42.827756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:42.827756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:42.827756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:42.827756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:42.827756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:42.827756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:42.827756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:42.827756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:42.827756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:42.827756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:42.827756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:42.828749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:42.828749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:42.828749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:42.828749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:42.828749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:42.828749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:42.828749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:42.828749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:42.828749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:42.828749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:42.828749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:42.828749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:42.828749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:18:42.828749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:42.831234 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 467/951] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:42.832265 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdfb31-761f-4dee-a96a-1d8367a7d87d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:42.866213 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea647616-21d3-4881-917e-5b0c6472e52f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:42.906337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0ceb8-8730-4be5-98a7-b01737e884b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:42.907176 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0ceb8-8730-4be5-98a7-b01737e884b7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:42.907543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0ceb8-8730-4be5-98a7-b01737e884b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:42.907953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0ceb8-8730-4be5-98a7-b01737e884b7 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:42.908695 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0ceb8-8730-4be5-98a7-b01737e884b7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:42.909059 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0ceb8-8730-4be5-98a7-b01737e884b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:42.910634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0ceb8-8730-4be5-98a7-b01737e884b7 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:42.917288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 485/952] 10.222.0.52 () {56 vars in 1122 bytes} [Mon Aug 29 20:18:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:42.918279 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0ceb8-8730-4be5-98a7-b01737e884b7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:42.925826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:42.950876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdfb31-761f-4dee-a96a-1d8367a7d87d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:42.993660 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd64f31-8a08-40a7-9c7c-d0e8af1a3aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:42.994182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd64f31-8a08-40a7-9c7c-d0e8af1a3aef None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:42.994453 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd64f31-8a08-40a7-9c7c-d0e8af1a3aef None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:42.994725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd64f31-8a08-40a7-9c7c-d0e8af1a3aef None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:42.995409 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd64f31-8a08-40a7-9c7c-d0e8af1a3aef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:42.995773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd64f31-8a08-40a7-9c7c-d0e8af1a3aef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:42.997237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd64f31-8a08-40a7-9c7c-d0e8af1a3aef None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:43.001572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:43.016476 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 468/953] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:43.016476 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd64f31-8a08-40a7-9c7c-d0e8af1a3aef None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:43.047212 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0ceb8-8730-4be5-98a7-b01737e884b7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:43.086271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36979857-d379-4efa-b6d2-8490dd00cb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:43.086989 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36979857-d379-4efa-b6d2-8490dd00cb93 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:43.087312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36979857-d379-4efa-b6d2-8490dd00cb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:43.087696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36979857-d379-4efa-b6d2-8490dd00cb93 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:43.088206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36979857-d379-4efa-b6d2-8490dd00cb93 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:43.088486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36979857-d379-4efa-b6d2-8490dd00cb93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:43.090278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36979857-d379-4efa-b6d2-8490dd00cb93 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:43.095740 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 486/954] 10.222.0.52 () {56 vars in 1112 bytes} [Mon Aug 29 20:18:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:43.096231 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36979857-d379-4efa-b6d2-8490dd00cb93 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:43.147401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd64f31-8a08-40a7-9c7c-d0e8af1a3aef None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:43.190787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfc546-bef9-4409-8367-eab6e07ad6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:43.191402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfc546-bef9-4409-8367-eab6e07ad6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:43.191684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfc546-bef9-4409-8367-eab6e07ad6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:43.191949 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfc546-bef9-4409-8367-eab6e07ad6a6 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:43.192574 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfc546-bef9-4409-8367-eab6e07ad6a6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:43.192872 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfc546-bef9-4409-8367-eab6e07ad6a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:43.194281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfc546-bef9-4409-8367-eab6e07ad6a6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:43.204507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 469/955] 10.222.0.52 () {56 vars in 1122 bytes} [Mon Aug 29 20:18:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:43.204507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfc546-bef9-4409-8367-eab6e07ad6a6 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:43.207853 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:43.220589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36979857-d379-4efa-b6d2-8490dd00cb93 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:43.252598 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:43.260003 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70df2c-393e-4e05-b526-7c226b5fd9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:43.260736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70df2c-393e-4e05-b526-7c226b5fd9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:43.261078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70df2c-393e-4e05-b526-7c226b5fd9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:43.261522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70df2c-393e-4e05-b526-7c226b5fd9f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:43.269236 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70df2c-393e-4e05-b526-7c226b5fd9f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:43.270594 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70df2c-393e-4e05-b526-7c226b5fd9f6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:43.282596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-8b70df2c-393e-4e05-b526-7c226b5fd9f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:43.282596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:43.282596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:43.282596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:43.282596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:43.282596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:43.282596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:43.282596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:43.282596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:43.282596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:43.282596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:43.282596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:43.282596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:43.282596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:43.282596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:43.283789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:43.283789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:43.283789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:43.283789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:43.283789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:43.283789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:43.283789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:43.283789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:43.283789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:43.283789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:43.283789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:43.283789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:43.283789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:43.283789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:43.283789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:43.283789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:43.283789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:43.285078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:43.285078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:43.285078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:43.285078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:43.285078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:43.285078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:43.285078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:43.285078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:43.285078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 487/956] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:43.285078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70df2c-393e-4e05-b526-7c226b5fd9f6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:43.334546 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfc546-bef9-4409-8367-eab6e07ad6a6 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:43.376747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721399a-563b-4096-afda-dc12673e9093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:43.377388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721399a-563b-4096-afda-dc12673e9093 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:43.377670 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721399a-563b-4096-afda-dc12673e9093 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:43.377942 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721399a-563b-4096-afda-dc12673e9093 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:43.378584 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721399a-563b-4096-afda-dc12673e9093 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:43.378886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721399a-563b-4096-afda-dc12673e9093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:43.380308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721399a-563b-4096-afda-dc12673e9093 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:43.385487 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 470/957] 10.222.0.52 () {56 vars in 1112 bytes} [Mon Aug 29 20:18:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:43.390730 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721399a-563b-4096-afda-dc12673e9093 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:43.414377 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70df2c-393e-4e05-b526-7c226b5fd9f6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:43.463437 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d8722-227c-4b35-85d9-e287b628d432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:43.464451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8722-227c-4b35-85d9-e287b628d432 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:43.465214 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8722-227c-4b35-85d9-e287b628d432 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:43.465692 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8722-227c-4b35-85d9-e287b628d432 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:43.466593 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d8722-227c-4b35-85d9-e287b628d432 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:43.468266 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d8722-227c-4b35-85d9-e287b628d432 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:43.494951 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:43.497233 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 488/958] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:18:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:18:43.541901 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721399a-563b-4096-afda-dc12673e9093 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:43.591355 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4ee49-b42a-423b-bdcb-f5395f5f57e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:43.592134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4ee49-b42a-423b-bdcb-f5395f5f57e6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:43.592530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4ee49-b42a-423b-bdcb-f5395f5f57e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:43.592911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4ee49-b42a-423b-bdcb-f5395f5f57e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:43.593760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4ee49-b42a-423b-bdcb-f5395f5f57e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:43.594170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4ee49-b42a-423b-bdcb-f5395f5f57e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:43.595800 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4ee49-b42a-423b-bdcb-f5395f5f57e6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:43.610837 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 471/959] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:43.617049 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d8722-227c-4b35-85d9-e287b628d432 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:43.674154 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:43.734146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d8722-227c-4b35-85d9-e287b628d432 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:43.774661 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae033d-cf09-4cf1-b0de-c119fc4cf759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:43.775439 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae033d-cf09-4cf1-b0de-c119fc4cf759 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:43.775624 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae033d-cf09-4cf1-b0de-c119fc4cf759 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:43.775875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae033d-cf09-4cf1-b0de-c119fc4cf759 None admin] PATH_INFO: `/v3/projects/03ca2c70c46a477494884c9997540861/users/0327aa38835f41a7a82802f9cad2e6d2/roles/5a2fa8fc43094a0f9bed98b6e5c4504a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:43.778240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae033d-cf09-4cf1-b0de-c119fc4cf759 None admin] RBAC: Authorizing `identity:create_grant(project_id=03ca2c70c46a477494884c9997540861, user_id=0327aa38835f41a7a82802f9cad2e6d2, role_id=5a2fa8fc43094a0f9bed98b6e5c4504a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:43.779695 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae033d-cf09-4cf1-b0de-c119fc4cf759 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:43.796068 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 489/960] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:18:43 2022] PUT /identity/v3/projects/03ca2c70c46a477494884c9997540861/users/0327aa38835f41a7a82802f9cad2e6d2/roles/5a2fa8fc43094a0f9bed98b6e5c4504a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:18:43.848172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa95413-cf75-47e2-a497-74fe9cf4f131 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:43.848504 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa95413-cf75-47e2-a497-74fe9cf4f131 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:43.848708 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa95413-cf75-47e2-a497-74fe9cf4f131 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:43.850492 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 472/961] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:43.856405 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012bf42-09b7-4588-900a-3eb6b0c48fb8 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:43.856739 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012bf42-09b7-4588-900a-3eb6b0c48fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:43.856951 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012bf42-09b7-4588-900a-3eb6b0c48fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:43.877047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1012bf42-09b7-4588-900a-3eb6b0c48fb8 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:43.878061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1012bf42-09b7-4588-900a-3eb6b0c48fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:43.964796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 490/962] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:44.234662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa95413-cf75-47e2-a497-74fe9cf4f131 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:44.357398 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa95413-cf75-47e2-a497-74fe9cf4f131 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:44.380983 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:44.394997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe7ec1-8039-4042-9878-fe85e45e2d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:44.395620 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe7ec1-8039-4042-9878-fe85e45e2d39 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:44.395900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe7ec1-8039-4042-9878-fe85e45e2d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:44.396172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe7ec1-8039-4042-9878-fe85e45e2d39 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:44.396838 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe7ec1-8039-4042-9878-fe85e45e2d39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:44.398318 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe7ec1-8039-4042-9878-fe85e45e2d39 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:44.414296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.sql.core [None req-dffe7ec1-8039-4042-9878-fe85e45e2d39 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 20:18:44.414296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 20:18:44.414296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [parameters: {'user_id': 'b71647ca6f5442b5b052c03baba82ba9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 20:18:44.414296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81540) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 20:18:44.423045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-dffe7ec1-8039-4042-9878-fe85e45e2d39 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 20:18:44.423045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:44.423045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:18:44.423045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:18:44.423045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:18:44.423045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:18:44.423045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:18:44.423045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:18:44.423045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:18:44.423045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:18:44.423045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:18:44.423045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:18:44.423045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:18:44.423045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result.read() Aug 29 20:18:44.423045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:18:44.423981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:18:44.425002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 20:18:44.425002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application yield resource Aug 29 20:18:44.425002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:18:44.425002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:18:44.425002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 20:18:44.425002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 20:18:44.425002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 20:18:44.425002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 20:18:44.425002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 20:18:44.425002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise self.value Aug 29 20:18:44.425002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 20:18:44.425002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 20:18:44.425002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 20:18:44.425002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application session.commit() Aug 29 20:18:44.425002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 20:18:44.425002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 20:18:44.425002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 20:18:44.427215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 20:18:44.427215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 20:18:44.427215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.session.flush() Aug 29 20:18:44.427215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 20:18:44.427215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 20:18:44.427215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 20:18:44.427215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 20:18:44.427215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 20:18:44.427215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application compat.raise_( Aug 29 20:18:44.427215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:18:44.427215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception Aug 29 20:18:44.427215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 20:18:44.427215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 20:18:44.427215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 20:18:44.427215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 20:18:44.427215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 20:18:44.427215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 20:18:44.429401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 20:18:44.429401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 20:18:44.429401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 20:18:44.429401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 20:18:44.429401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 20:18:44.429401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 20:18:44.429401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 20:18:44.429401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 20:18:44.429401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 20:18:44.429401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 20:18:44.429401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 20:18:44.429401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 20:18:44.429401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 20:18:44.429401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 20:18:44.429401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:18:44.429401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception Aug 29 20:18:44.431341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:18:44.431341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:18:44.431341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:18:44.431341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:18:44.431341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:18:44.431341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:18:44.431341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:18:44.431341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:18:44.431341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:18:44.431341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:18:44.431341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:18:44.431341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result.read() Aug 29 20:18:44.431341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:18:44.431341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:18:44.431341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:18:44.431341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:18:44.433548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:18:44.433548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:18:44.433548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:18:44.433548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:18:44.433548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 20:18:44.433548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 20:18:44.433548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b71647ca6f5442b5b052c03baba82ba9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 20:18:44.433548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 20:18:44.433548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:44.433548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:44.433548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:44.433548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:44.433548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:44.433548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:44.433548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:44.435490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:44.435490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:44.435490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:44.435490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:44.435490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:44.435490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:44.435490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:44.435490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 20:18:44.435490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 20:18:44.435490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:44.435490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:44.435490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:44.435490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:44.435490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:44.435490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:44.435490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 20:18:44.435490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 20:18:44.437637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 20:18:44.437637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 20:18:44.437637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 20:18:44.437637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 20:18:44.437637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 20:18:44.437637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:44.437637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 473/963] 10.222.0.52 () {60 vars in 1131 bytes} [Mon Aug 29 20:18:44 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:44.438530 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012bf42-09b7-4588-900a-3eb6b0c48fb8 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:44.485757 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:44.560800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012bf42-09b7-4588-900a-3eb6b0c48fb8 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:44.599131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9bd82-e04e-4e51-8834-94d232caba11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:44.600192 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9bd82-e04e-4e51-8834-94d232caba11 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:44.600743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9bd82-e04e-4e51-8834-94d232caba11 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:44.601205 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9bd82-e04e-4e51-8834-94d232caba11 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:44.610086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9bd82-e04e-4e51-8834-94d232caba11 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:44.612017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9bd82-e04e-4e51-8834-94d232caba11 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:44.625493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-aac9bd82-e04e-4e51-8834-94d232caba11 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:18:44.625493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:44.625493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:44.625493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:44.625493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:44.625493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:44.625493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:44.625493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:44.625493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:44.625493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:44.625493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:44.625493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:44.625493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:44.625493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:44.625493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:44.625493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:44.626502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:44.627443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:44.627443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:44.627443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:44.627443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:44.627443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:44.627443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:44.627443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:44.627443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:44.627443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:18:44.627443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:44.630247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 491/964] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:18:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:44.636059 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe7ec1-8039-4042-9878-fe85e45e2d39 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:44.753907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe7ec1-8039-4042-9878-fe85e45e2d39 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:44.790307 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddb174-b3a8-44a6-8472-81104fa600ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:44.790924 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddb174-b3a8-44a6-8472-81104fa600ec None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:44.791204 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddb174-b3a8-44a6-8472-81104fa600ec None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:44.791476 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddb174-b3a8-44a6-8472-81104fa600ec None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:44.792191 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddb174-b3a8-44a6-8472-81104fa600ec None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:44.792549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddb174-b3a8-44a6-8472-81104fa600ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:44.794258 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddb174-b3a8-44a6-8472-81104fa600ec None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:44.844743 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 474/965] 10.222.0.52 () {56 vars in 1101 bytes} [Mon Aug 29 20:18:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:45.477952 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cc831-03b8-40eb-8cf9-ebec298c0022 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:45.478508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cc831-03b8-40eb-8cf9-ebec298c0022 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:45.478508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cc831-03b8-40eb-8cf9-ebec298c0022 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:45.479887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 492/966] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:45.485569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caecbf3-fa38-4aab-8ea9-de97ac6a81b8 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:45.486023 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caecbf3-fa38-4aab-8ea9-de97ac6a81b8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:45.486123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caecbf3-fa38-4aab-8ea9-de97ac6a81b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:45.505336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1caecbf3-fa38-4aab-8ea9-de97ac6a81b8 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:45.506898 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1caecbf3-fa38-4aab-8ea9-de97ac6a81b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:45.547789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:45.569554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da058731-8d53-4a7e-be61-eaa1b33013df None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:45.569871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da058731-8d53-4a7e-be61-eaa1b33013df None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:45.570101 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da058731-8d53-4a7e-be61-eaa1b33013df None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:45.571478 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 493/967] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:18:45.577210 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998c37f-1daf-4eb8-a380-2bb6f3052436 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:45.577526 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998c37f-1daf-4eb8-a380-2bb6f3052436 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:45.577794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998c37f-1daf-4eb8-a380-2bb6f3052436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:45.586642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 475/968] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:45.597225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a998c37f-1daf-4eb8-a380-2bb6f3052436 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:45.598448 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a998c37f-1daf-4eb8-a380-2bb6f3052436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:45.677451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 494/969] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:18:45.831054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c7f2c-b2a2-4f7b-8628-bc526dac0b09 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:45.831411 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c7f2c-b2a2-4f7b-8628-bc526dac0b09 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:45.831596 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c7f2c-b2a2-4f7b-8628-bc526dac0b09 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:45.833103 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 476/970] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:45.838428 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e2273-2402-4b68-b310-7c3b59bb5e2f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:45.838711 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e2273-2402-4b68-b310-7c3b59bb5e2f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:45.838969 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e2273-2402-4b68-b310-7c3b59bb5e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:45.853332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c7f2c-b2a2-4f7b-8628-bc526dac0b09 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:45.860160 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b52e2273-2402-4b68-b310-7c3b59bb5e2f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:45.861398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b52e2273-2402-4b68-b310-7c3b59bb5e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:45.888015 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:45.946388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 495/971] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:45.947237 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e2273-2402-4b68-b310-7c3b59bb5e2f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:45.968998 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c7f2c-b2a2-4f7b-8628-bc526dac0b09 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:46.007526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e217f-87c9-4123-9aac-e51ea91a66e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:46.008357 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e217f-87c9-4123-9aac-e51ea91a66e5 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:46.008631 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e217f-87c9-4123-9aac-e51ea91a66e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:46.009042 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e217f-87c9-4123-9aac-e51ea91a66e5 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:46.010046 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e217f-87c9-4123-9aac-e51ea91a66e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:46.011455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e217f-87c9-4123-9aac-e51ea91a66e5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:46.028653 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 477/972] 10.222.0.52 () {60 vars in 1141 bytes} [Mon Aug 29 20:18:45 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:18:46.069787 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e2273-2402-4b68-b310-7c3b59bb5e2f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:46.121695 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eff19e-c010-4438-8d3b-af9f81a3c30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:46.122352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eff19e-c010-4438-8d3b-af9f81a3c30d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:46.122628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eff19e-c010-4438-8d3b-af9f81a3c30d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:46.122895 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eff19e-c010-4438-8d3b-af9f81a3c30d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:46.123481 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eff19e-c010-4438-8d3b-af9f81a3c30d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:46.124891 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eff19e-c010-4438-8d3b-af9f81a3c30d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:46.134975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-d1eff19e-c010-4438-8d3b-af9f81a3c30d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:18:46.134975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:46.134975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:46.134975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:46.134975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:46.134975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:46.134975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:46.134975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:46.134975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:18:46.134975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:46.134975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:46.134975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:46.134975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:46.134975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:46.134975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:46.134975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:46.134975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:46.136355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:46.136355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:46.136355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:46.136355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:46.136355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:46.136355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:46.136355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:46.136355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:46.136355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:46.136355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:46.136355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:46.136355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:46.136355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:46.136355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:46.136355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:46.136355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:46.137239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:46.137239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:46.137239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:46.137239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:46.137239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:46.137239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:46.137239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:46.137239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:46.137239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:46.137239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:46.137239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:46.137239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:46.137239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:18:46.137239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:46.137239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 496/973] 10.222.0.52 () {56 vars in 1126 bytes} [Mon Aug 29 20:18:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:46.142556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e217f-87c9-4123-9aac-e51ea91a66e5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:46.182238 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:46.213275 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eff19e-c010-4438-8d3b-af9f81a3c30d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:46.243697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:46.272161 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e217f-87c9-4123-9aac-e51ea91a66e5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:46.310647 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d99ed-7d58-4403-a236-e7154acd6a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:46.311262 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d99ed-7d58-4403-a236-e7154acd6a44 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:46.311533 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d99ed-7d58-4403-a236-e7154acd6a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:46.311829 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d99ed-7d58-4403-a236-e7154acd6a44 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:46.312438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d99ed-7d58-4403-a236-e7154acd6a44 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:46.312734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d99ed-7d58-4403-a236-e7154acd6a44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:46.314135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d99ed-7d58-4403-a236-e7154acd6a44 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:46.324328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 478/974] 10.222.0.52 () {56 vars in 1122 bytes} [Mon Aug 29 20:18:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:46.325570 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d99ed-7d58-4403-a236-e7154acd6a44 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:46.343590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eff19e-c010-4438-8d3b-af9f81a3c30d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:46.386101 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1621b29-ee78-423f-82ea-7e2d13ad5382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:46.386751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1621b29-ee78-423f-82ea-7e2d13ad5382 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:46.387022 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1621b29-ee78-423f-82ea-7e2d13ad5382 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:46.387285 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1621b29-ee78-423f-82ea-7e2d13ad5382 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:46.398805 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1621b29-ee78-423f-82ea-7e2d13ad5382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:46.407919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-a1621b29-ee78-423f-82ea-7e2d13ad5382 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:18:46.407919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:46.407919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:46.407919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:46.407919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:46.407919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:46.407919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:46.407919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:46.407919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:46.407919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:46.407919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:46.407919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:46.407919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:46.407919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:46.407919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:46.407919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:46.409131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:46.409131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:46.409131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:46.409131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:46.409131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:46.409131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:46.409131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:46.409131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:46.409131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:46.409131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:46.409131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:46.409131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:46.409131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:46.409131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:46.409131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:46.409131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:46.410040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:46.410040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:46.410040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:46.410040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:46.410040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:46.410040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:46.410040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:46.410040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:46.410040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:46.410040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:46.410040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:18:46.410040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:46.410040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 497/975] 10.222.0.52 () {56 vars in 1120 bytes} [Mon Aug 29 20:18:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:46.415304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1621b29-ee78-423f-82ea-7e2d13ad5382 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:46.449637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:46.457049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d99ed-7d58-4403-a236-e7154acd6a44 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:46.497052 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e8c51-e8e4-4ca3-9db2-51d9ee1476d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:46.497888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e8c51-e8e4-4ca3-9db2-51d9ee1476d6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:46.497979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e8c51-e8e4-4ca3-9db2-51d9ee1476d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:46.498237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e8c51-e8e4-4ca3-9db2-51d9ee1476d6 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:46.498886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e8c51-e8e4-4ca3-9db2-51d9ee1476d6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:46.499240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e8c51-e8e4-4ca3-9db2-51d9ee1476d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:46.500891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e8c51-e8e4-4ca3-9db2-51d9ee1476d6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:46.501986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:46.516153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 479/976] 10.222.0.52 () {56 vars in 1122 bytes} [Mon Aug 29 20:18:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:46.516153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e8c51-e8e4-4ca3-9db2-51d9ee1476d6 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:46.527177 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1621b29-ee78-423f-82ea-7e2d13ad5382 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:46.562007 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c458c8-36f2-4330-8626-39ed876e98c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:46.562622 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c458c8-36f2-4330-8626-39ed876e98c5 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:46.562899 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c458c8-36f2-4330-8626-39ed876e98c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:46.563171 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c458c8-36f2-4330-8626-39ed876e98c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:46.563844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c458c8-36f2-4330-8626-39ed876e98c5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:46.564145 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c458c8-36f2-4330-8626-39ed876e98c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:46.565559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c458c8-36f2-4330-8626-39ed876e98c5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:46.575966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 498/977] 10.222.0.52 () {56 vars in 1115 bytes} [Mon Aug 29 20:18:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:46.581739 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c458c8-36f2-4330-8626-39ed876e98c5 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:46.651208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e8c51-e8e4-4ca3-9db2-51d9ee1476d6 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:46.692594 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1f172-8b04-4b09-8d90-1c2a6bf45de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:46.693216 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1f172-8b04-4b09-8d90-1c2a6bf45de8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:46.693517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1f172-8b04-4b09-8d90-1c2a6bf45de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:46.693971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1f172-8b04-4b09-8d90-1c2a6bf45de8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:46.694520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1f172-8b04-4b09-8d90-1c2a6bf45de8 None admin] RBAC: Adding query filter params (interface=admin, service_id=52dcdf88e5564e0ab538dbe780e91c37, region_id=RegionOne) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:46.694829 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1f172-8b04-4b09-8d90-1c2a6bf45de8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:46.696204 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1f172-8b04-4b09-8d90-1c2a6bf45de8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:46.702713 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 480/978] 10.222.0.52 () {56 vars in 1249 bytes} [Mon Aug 29 20:18:46 2022] GET /identity/v3/endpoints?service_id=52dcdf88e5564e0ab538dbe780e91c37&interface=admin®ion_id=RegionOne => generated 193 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:46.703599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c458c8-36f2-4330-8626-39ed876e98c5 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:46.708341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1f172-8b04-4b09-8d90-1c2a6bf45de8 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:46.736388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:46.744167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5603690-cab6-4f3e-91a8-2d60528f0948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:46.744915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5603690-cab6-4f3e-91a8-2d60528f0948 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:46.745268 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5603690-cab6-4f3e-91a8-2d60528f0948 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:46.745727 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5603690-cab6-4f3e-91a8-2d60528f0948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:46.757901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:46.759887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5603690-cab6-4f3e-91a8-2d60528f0948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:46.762240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5603690-cab6-4f3e-91a8-2d60528f0948 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:46.777329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-b5603690-cab6-4f3e-91a8-2d60528f0948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:46.777329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:46.777329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:46.777329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:46.777329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:46.777329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:46.777329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:46.777329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:46.777329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:46.777329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:46.777329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:46.777329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:46.777329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:46.777329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:46.777329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:46.777329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:46.778554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:46.778554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:46.778554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:46.778554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:46.778554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:46.778554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:46.778554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:46.778554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:46.778554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:46.778554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:46.778554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:46.778554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:46.778554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:46.778554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:46.778554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:46.778554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:46.778554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:46.779978 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:46.779978 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:46.779978 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:46.779978 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 499/979] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:46.784463 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5603690-cab6-4f3e-91a8-2d60528f0948 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:46.830691 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1f172-8b04-4b09-8d90-1c2a6bf45de8 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:46.868758 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30eda15-5122-44d8-9e62-a43938011883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:46.869537 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eda15-5122-44d8-9e62-a43938011883 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:46.869814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eda15-5122-44d8-9e62-a43938011883 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:46.870084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eda15-5122-44d8-9e62-a43938011883 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:46.870763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30eda15-5122-44d8-9e62-a43938011883 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:46.872169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30eda15-5122-44d8-9e62-a43938011883 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:46.878896 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 481/980] 10.222.0.52 () {56 vars in 1087 bytes} [Mon Aug 29 20:18:46 2022] GET /identity/v3/services => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:18:46.905903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5603690-cab6-4f3e-91a8-2d60528f0948 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:46.951629 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d678f7d-3b2f-46bc-a2cf-4228a7aca4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:46.952264 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d678f7d-3b2f-46bc-a2cf-4228a7aca4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:46.952543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d678f7d-3b2f-46bc-a2cf-4228a7aca4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:46.952782 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d678f7d-3b2f-46bc-a2cf-4228a7aca4d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:46.953495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d678f7d-3b2f-46bc-a2cf-4228a7aca4d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:46.953791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d678f7d-3b2f-46bc-a2cf-4228a7aca4d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:46.955216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d678f7d-3b2f-46bc-a2cf-4228a7aca4d9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:46.971058 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 500/981] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:46.976878 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30eda15-5122-44d8-9e62-a43938011883 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:47.081644 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:47.095368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30eda15-5122-44d8-9e62-a43938011883 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:47.132115 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3ad37-596e-4563-9e78-0a29f79897fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:47.132748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3ad37-596e-4563-9e78-0a29f79897fc None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:47.133027 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3ad37-596e-4563-9e78-0a29f79897fc None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:47.133299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3ad37-596e-4563-9e78-0a29f79897fc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:47.142264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3ad37-596e-4563-9e78-0a29f79897fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:47.143784 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3ad37-596e-4563-9e78-0a29f79897fc None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:47.157133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-b4c3ad37-596e-4563-9e78-0a29f79897fc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:18:47.157133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:47.157133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:47.157133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:47.157133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:47.157133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:47.157133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:47.157133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:47.157133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:47.157133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:47.157133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:47.157133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:47.157133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:47.157133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:47.157133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:47.157133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:47.158337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:47.160036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:47.160036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:47.160036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:47.160036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:47.160036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:47.160036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:47.160036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:47.160036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:47.160036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:18:47.160036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:47.160036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 482/982] 10.222.0.52 () {56 vars in 1117 bytes} [Mon Aug 29 20:18:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:47.164582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d678f7d-3b2f-46bc-a2cf-4228a7aca4d9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:47.223748 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:47.275742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d678f7d-3b2f-46bc-a2cf-4228a7aca4d9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:47.311172 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740e501-d747-4007-a46e-52f90224fd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:47.311783 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740e501-d747-4007-a46e-52f90224fd50 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:47.312062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740e501-d747-4007-a46e-52f90224fd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:47.312334 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740e501-d747-4007-a46e-52f90224fd50 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:47.313074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740e501-d747-4007-a46e-52f90224fd50 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:47.313396 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740e501-d747-4007-a46e-52f90224fd50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:47.314835 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740e501-d747-4007-a46e-52f90224fd50 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:47.340226 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 501/983] 10.222.0.52 () {56 vars in 1149 bytes} [Mon Aug 29 20:18:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:47.341555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3ad37-596e-4563-9e78-0a29f79897fc None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:47.458414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3ad37-596e-4563-9e78-0a29f79897fc None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:47.493887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dff97b-79dc-408c-8746-5daf116a79c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:47.494494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dff97b-79dc-408c-8746-5daf116a79c1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:47.494765 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dff97b-79dc-408c-8746-5daf116a79c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:47.495047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dff97b-79dc-408c-8746-5daf116a79c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:47.515004 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:47.571434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dff97b-79dc-408c-8746-5daf116a79c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:47.572914 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dff97b-79dc-408c-8746-5daf116a79c1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:47.679494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 483/984] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:18:47 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:18:47.685610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740e501-d747-4007-a46e-52f90224fd50 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:47.795555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740e501-d747-4007-a46e-52f90224fd50 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:47.807785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:47.834414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067828a-86ba-4bbb-b0bf-fc934468866f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:47.835055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067828a-86ba-4bbb-b0bf-fc934468866f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:47.835330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067828a-86ba-4bbb-b0bf-fc934468866f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:47.835597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067828a-86ba-4bbb-b0bf-fc934468866f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:47.846944 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067828a-86ba-4bbb-b0bf-fc934468866f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:47.848415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067828a-86ba-4bbb-b0bf-fc934468866f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:47.864158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-9067828a-86ba-4bbb-b0bf-fc934468866f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:47.864158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:47.864158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:47.864158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:47.864158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:47.864158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:47.864158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:47.864158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:47.864158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:47.864158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:47.864158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:47.864158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:47.864158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:47.864158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:47.864158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:47.864158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:47.865166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:47.865166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:47.865166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:47.865166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:47.865166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:47.865166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:47.865166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:47.865166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:47.865166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:47.865166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:47.865166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:47.865166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:47.865166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:47.865166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:47.865166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:47.865166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:47.865166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:47.866090 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:47.866090 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:47.866090 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:47.869485 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 502/985] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:47.871344 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dff97b-79dc-408c-8746-5daf116a79c1 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:47.926779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:47.980705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeda95-8905-4797-99bf-f085f3200e40 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:47.980990 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeda95-8905-4797-99bf-f085f3200e40 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:47.981261 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeda95-8905-4797-99bf-f085f3200e40 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:47.983002 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 503/986] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:47.989078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff391b-ef25-4912-b76b-5cd229942854 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:47.989352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff391b-ef25-4912-b76b-5cd229942854 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:47.989657 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff391b-ef25-4912-b76b-5cd229942854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:48.003868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dff97b-79dc-408c-8746-5daf116a79c1 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:48.010367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2aff391b-ef25-4912-b76b-5cd229942854 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:48.011649 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2aff391b-ef25-4912-b76b-5cd229942854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:48.043424 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499933ef-c47e-4419-b1c8-423093da95b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:48.044034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499933ef-c47e-4419-b1c8-423093da95b1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:48.044311 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499933ef-c47e-4419-b1c8-423093da95b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:48.044579 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499933ef-c47e-4419-b1c8-423093da95b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:48.045227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499933ef-c47e-4419-b1c8-423093da95b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:48.045556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499933ef-c47e-4419-b1c8-423093da95b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:48.046938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499933ef-c47e-4419-b1c8-423093da95b1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:48.059846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 484/987] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:48.066398 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499933ef-c47e-4419-b1c8-423093da95b1 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:48.090065 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 504/988] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:48.171198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499933ef-c47e-4419-b1c8-423093da95b1 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:48.181509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:48.208448 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85419873-74c4-4c71-986f-29e7d04293e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:48.209457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85419873-74c4-4c71-986f-29e7d04293e4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:48.209906 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85419873-74c4-4c71-986f-29e7d04293e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:48.210343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85419873-74c4-4c71-986f-29e7d04293e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:48.217940 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85419873-74c4-4c71-986f-29e7d04293e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:48.219649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85419873-74c4-4c71-986f-29e7d04293e4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:48.231656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-85419873-74c4-4c71-986f-29e7d04293e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:48.231656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:48.231656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:48.231656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:48.231656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:48.231656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:48.231656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:48.231656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:48.231656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:48.231656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:48.231656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:48.231656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:48.231656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:48.231656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:48.231656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:48.232613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:48.232613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:48.232613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:48.232613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:48.232613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:48.232613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:48.232613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:48.232613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:48.232613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:48.232613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:48.232613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:48.232613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:48.232613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:48.232613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:48.232613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:48.232613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:48.232613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:48.233749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:48.233749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:48.233749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:48.233749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:48.233749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:48.233749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:48.233749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:48.233749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:48.240117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 485/989] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:48.241439 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff391b-ef25-4912-b76b-5cd229942854 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:48.351295 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:48.359238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff391b-ef25-4912-b76b-5cd229942854 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:48.361631 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85419873-74c4-4c71-986f-29e7d04293e4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:48.397125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cbcb7-4402-43db-bca7-5e30ffb24c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:48.397770 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cbcb7-4402-43db-bca7-5e30ffb24c23 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:48.398203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cbcb7-4402-43db-bca7-5e30ffb24c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:48.398308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cbcb7-4402-43db-bca7-5e30ffb24c23 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:48.398995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cbcb7-4402-43db-bca7-5e30ffb24c23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:48.399297 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cbcb7-4402-43db-bca7-5e30ffb24c23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:48.400732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cbcb7-4402-43db-bca7-5e30ffb24c23 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:48.419478 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 505/990] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:48.421645 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cbcb7-4402-43db-bca7-5e30ffb24c23 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:48.504159 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85419873-74c4-4c71-986f-29e7d04293e4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:48.545667 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6fd5f-1b1b-4012-aa7c-90316c7c22c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:48.546408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6fd5f-1b1b-4012-aa7c-90316c7c22c0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:48.546688 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6fd5f-1b1b-4012-aa7c-90316c7c22c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:48.546975 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6fd5f-1b1b-4012-aa7c-90316c7c22c0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:48.547554 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6fd5f-1b1b-4012-aa7c-90316c7c22c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:48.549039 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6fd5f-1b1b-4012-aa7c-90316c7c22c0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:48.555651 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cbcb7-4402-43db-bca7-5e30ffb24c23 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:48.558725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-7fb6fd5f-1b1b-4012-aa7c-90316c7c22c0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:18:48.558725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:48.558725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:48.558725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:48.558725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:48.558725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:48.558725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:48.558725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:48.558725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:18:48.558725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:48.558725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:48.558725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:48.558725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:48.558725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:48.558725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:48.558725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:48.558725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:48.559739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:48.559739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:48.559739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:48.559739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:48.559739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:48.559739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:48.559739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:48.559739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:48.559739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:48.559739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:48.559739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:48.559739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:48.559739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:48.559739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:48.559739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:48.559739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:48.562377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:48.562377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:48.562377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:48.562377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:48.562377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:48.562377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:48.562377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:48.562377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:48.562377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:48.562377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:48.562377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:48.562377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:48.562377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:18:48.562377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:48.562377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 486/991] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:48.566432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6fd5f-1b1b-4012-aa7c-90316c7c22c0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:48.594426 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd490e6-256b-482a-808b-21327edb2c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:48.595029 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd490e6-256b-482a-808b-21327edb2c9f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:48.595304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd490e6-256b-482a-808b-21327edb2c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:48.595572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd490e6-256b-482a-808b-21327edb2c9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:48.596293 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd490e6-256b-482a-808b-21327edb2c9f None admin] RBAC: Adding query filter params (role.id=5a2fa8fc43094a0f9bed98b6e5c4504a, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=0327aa38835f41a7a82802f9cad2e6d2) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:48.596599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd490e6-256b-482a-808b-21327edb2c9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:48.598054 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd490e6-256b-482a-808b-21327edb2c9f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:48.602760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:48.604103 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 506/992] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:18:48 2022] GET /identity/v3/role_assignments?user.id=0327aa38835f41a7a82802f9cad2e6d2&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=5a2fa8fc43094a0f9bed98b6e5c4504a => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:48.689458 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6fd5f-1b1b-4012-aa7c-90316c7c22c0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:48.728795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea7db7-0cef-4f94-963f-8dabd4fe083d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:48.729634 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea7db7-0cef-4f94-963f-8dabd4fe083d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:48.729930 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea7db7-0cef-4f94-963f-8dabd4fe083d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:48.730170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea7db7-0cef-4f94-963f-8dabd4fe083d None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:48.730826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea7db7-0cef-4f94-963f-8dabd4fe083d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:48.731127 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea7db7-0cef-4f94-963f-8dabd4fe083d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:48.732548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea7db7-0cef-4f94-963f-8dabd4fe083d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:48.742908 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 487/993] 10.222.0.52 () {56 vars in 1112 bytes} [Mon Aug 29 20:18:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:48.744638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd490e6-256b-482a-808b-21327edb2c9f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:48.766810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:48.842340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018e901-3f60-46cd-b7ee-922f43cc3270 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:48.842626 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018e901-3f60-46cd-b7ee-922f43cc3270 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:48.842909 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018e901-3f60-46cd-b7ee-922f43cc3270 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:48.844414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 488/994] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:18:48.849488 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9534f2-d2ca-4082-8561-fe6e4e625a53 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:48.849775 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9534f2-d2ca-4082-8561-fe6e4e625a53 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:48.850050 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9534f2-d2ca-4082-8561-fe6e4e625a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:48.857071 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd490e6-256b-482a-808b-21327edb2c9f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:48.870855 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-db9534f2-d2ca-4082-8561-fe6e4e625a53 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:48.872324 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-db9534f2-d2ca-4082-8561-fe6e4e625a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:48.898820 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67c59d-78ec-4fed-8199-5676288adb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:48.899465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67c59d-78ec-4fed-8199-5676288adb24 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:48.899744 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67c59d-78ec-4fed-8199-5676288adb24 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:48.900018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67c59d-78ec-4fed-8199-5676288adb24 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:48.900678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67c59d-78ec-4fed-8199-5676288adb24 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:48.900958 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67c59d-78ec-4fed-8199-5676288adb24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:48.902471 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67c59d-78ec-4fed-8199-5676288adb24 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:48.907698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 507/995] 10.222.0.52 () {56 vars in 1112 bytes} [Mon Aug 29 20:18:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:48.913664 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67c59d-78ec-4fed-8199-5676288adb24 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:48.954238 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 489/996] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:18:49.000759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:49.021925 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67c59d-78ec-4fed-8199-5676288adb24 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:49.059322 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7de58d-9c66-43cf-a3b7-fd4663d8cb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:49.059935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7de58d-9c66-43cf-a3b7-fd4663d8cb6e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:49.060269 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7de58d-9c66-43cf-a3b7-fd4663d8cb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:49.060582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7de58d-9c66-43cf-a3b7-fd4663d8cb6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:49.061311 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7de58d-9c66-43cf-a3b7-fd4663d8cb6e None admin] RBAC: Adding query filter params (interface=public, service_id=6cdc714dfb1d448a98782adf5ae67a9e, region_id=RegionOne) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:49.061625 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7de58d-9c66-43cf-a3b7-fd4663d8cb6e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:49.063005 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7de58d-9c66-43cf-a3b7-fd4663d8cb6e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:49.069597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 508/997] 10.222.0.52 () {56 vars in 1251 bytes} [Mon Aug 29 20:18:48 2022] GET /identity/v3/endpoints?service_id=6cdc714dfb1d448a98782adf5ae67a9e&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:49.075950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9534f2-d2ca-4082-8561-fe6e4e625a53 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:49.119749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:49.207751 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9534f2-d2ca-4082-8561-fe6e4e625a53 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:49.215985 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7de58d-9c66-43cf-a3b7-fd4663d8cb6e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:49.252335 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570e02d-ad7a-491f-b803-56e37a3396ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:49.253057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570e02d-ad7a-491f-b803-56e37a3396ff None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:49.253337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570e02d-ad7a-491f-b803-56e37a3396ff None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:49.253730 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570e02d-ad7a-491f-b803-56e37a3396ff None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:49.254358 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570e02d-ad7a-491f-b803-56e37a3396ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:49.255756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570e02d-ad7a-491f-b803-56e37a3396ff None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:49.273489 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 490/998] 10.222.0.52 () {56 vars in 1087 bytes} [Mon Aug 29 20:18:49 2022] GET /identity/v3/services => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:18:49.351422 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7de58d-9c66-43cf-a3b7-fd4663d8cb6e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:49.393904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a1f4b-b104-471a-aa27-72974f4dff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:49.394559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a1f4b-b104-471a-aa27-72974f4dff67 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:49.394840 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a1f4b-b104-471a-aa27-72974f4dff67 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:49.395117 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a1f4b-b104-471a-aa27-72974f4dff67 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:49.395705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a1f4b-b104-471a-aa27-72974f4dff67 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:49.397128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a1f4b-b104-471a-aa27-72974f4dff67 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:49.407030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-ec0a1f4b-b104-471a-aa27-72974f4dff67 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:18:49.407030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:49.407030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:49.407030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:49.407030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:49.407030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:49.407030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:49.407030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:49.407030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:18:49.407030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:49.407030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:49.407030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:49.407030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:49.407030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:49.407030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:49.407030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:49.407030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:49.408196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:49.408196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:49.408196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:49.408196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:49.408196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:49.408196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:49.408196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:49.408196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:49.408196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:49.408196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:49.408196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:49.408196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:49.408196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:49.408196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:49.408196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:49.408196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:49.410470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:49.410470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:49.410470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:49.410470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:49.410470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:49.410470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:49.410470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:49.410470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:49.410470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:49.410470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:49.410470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:49.410470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:49.410470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:18:49.410470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:49.410470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 509/999] 10.222.0.52 () {56 vars in 1126 bytes} [Mon Aug 29 20:18:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:49.415257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570e02d-ad7a-491f-b803-56e37a3396ff None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:49.521061 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:49.533319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570e02d-ad7a-491f-b803-56e37a3396ff None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:49.570237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97b151-e299-4639-a671-5f8e8b0a84e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:49.570909 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97b151-e299-4639-a671-5f8e8b0a84e1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:49.571174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97b151-e299-4639-a671-5f8e8b0a84e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:49.571386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97b151-e299-4639-a671-5f8e8b0a84e1 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:49.572028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97b151-e299-4639-a671-5f8e8b0a84e1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:49.572325 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97b151-e299-4639-a671-5f8e8b0a84e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:49.573868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97b151-e299-4639-a671-5f8e8b0a84e1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:49.579927 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 491/1000] 10.222.0.52 () {56 vars in 1122 bytes} [Mon Aug 29 20:18:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:49.585530 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a1f4b-b104-471a-aa27-72974f4dff67 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:49.598234 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:49.696846 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a1f4b-b104-471a-aa27-72974f4dff67 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:49.737075 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545491a-11cc-4cbc-b6d2-4a056045b572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:49.737771 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545491a-11cc-4cbc-b6d2-4a056045b572 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:49.738048 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545491a-11cc-4cbc-b6d2-4a056045b572 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:49.738320 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545491a-11cc-4cbc-b6d2-4a056045b572 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:49.738977 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545491a-11cc-4cbc-b6d2-4a056045b572 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:49.739289 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545491a-11cc-4cbc-b6d2-4a056045b572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:49.741003 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545491a-11cc-4cbc-b6d2-4a056045b572 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:49.751038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 510/1001] 10.222.0.52 () {56 vars in 1122 bytes} [Mon Aug 29 20:18:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:49.759114 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97b151-e299-4639-a671-5f8e8b0a84e1 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:49.888487 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97b151-e299-4639-a671-5f8e8b0a84e1 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:49.927134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03e2d7-6fb8-4d12-ac84-fe3cf5eef466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:49.928127 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03e2d7-6fb8-4d12-ac84-fe3cf5eef466 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:49.928599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03e2d7-6fb8-4d12-ac84-fe3cf5eef466 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:49.929137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03e2d7-6fb8-4d12-ac84-fe3cf5eef466 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:49.930033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03e2d7-6fb8-4d12-ac84-fe3cf5eef466 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:49.931597 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03e2d7-6fb8-4d12-ac84-fe3cf5eef466 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:49.952941 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 492/1002] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:18:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:18:50.620976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d600c-0be4-4478-9a6e-94ae9b70e318 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:50.621219 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d600c-0be4-4478-9a6e-94ae9b70e318 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:50.621569 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d600c-0be4-4478-9a6e-94ae9b70e318 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:50.622980 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 511/1003] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:50.628575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b78d6-aa3c-474d-be28-a7277ca6bf96 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:50.629268 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b78d6-aa3c-474d-be28-a7277ca6bf96 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:50.629268 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b78d6-aa3c-474d-be28-a7277ca6bf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:50.648842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-2d8b78d6-aa3c-474d-be28-a7277ca6bf96 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:50.650147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2d8b78d6-aa3c-474d-be28-a7277ca6bf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:50.661527 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:50.732919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 493/1004] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:50 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:50.997825 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d600c-0be4-4478-9a6e-94ae9b70e318 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:51.076739 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:51.112645 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d600c-0be4-4478-9a6e-94ae9b70e318 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:51.148004 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e635f-cb13-4fdf-88a0-96d3a1fa01ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:51.148631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e635f-cb13-4fdf-88a0-96d3a1fa01ca None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:51.148912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e635f-cb13-4fdf-88a0-96d3a1fa01ca None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:51.149168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e635f-cb13-4fdf-88a0-96d3a1fa01ca None admin] PATH_INFO: `/v3/services/image` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:51.149776 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e635f-cb13-4fdf-88a0-96d3a1fa01ca None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:51.151279 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e635f-cb13-4fdf-88a0-96d3a1fa01ca None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:51.160560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-077e635f-cb13-4fdf-88a0-96d3a1fa01ca None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:18:51.160560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:51.160560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:51.160560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:51.160560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:51.160560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:51.160560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:51.160560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:51.160560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:18:51.160560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:51.160560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:51.160560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:51.160560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:51.160560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:51.160560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:51.160560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:51.160560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:51.161607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:51.161607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:51.161607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:51.161607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:51.161607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:51.161607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:51.161607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:51.161607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:51.161607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:51.161607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:51.161607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:51.161607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:51.161607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:51.161607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:51.161607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:51.161607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:51.162475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:51.162475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:51.162475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:51.162475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:51.162475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:51.162475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:51.162475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:51.162475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:51.162475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:51.162475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:51.162475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:51.162475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:51.162475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:18:51.162475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:51.165721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 512/1005] 10.222.0.52 () {56 vars in 1105 bytes} [Mon Aug 29 20:18:50 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:51.167871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b78d6-aa3c-474d-be28-a7277ca6bf96 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:51.232559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02521c4-305c-483c-ab44-4d9fb34056ea None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:51.232857 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02521c4-305c-483c-ab44-4d9fb34056ea None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:51.233127 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02521c4-305c-483c-ab44-4d9fb34056ea None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:51.234498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 513/1006] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:18:51.239518 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acbe44-562b-4afa-973d-4cfcdf48cd3e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:51.239799 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acbe44-562b-4afa-973d-4cfcdf48cd3e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:51.240078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acbe44-562b-4afa-973d-4cfcdf48cd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:51.258541 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-78acbe44-562b-4afa-973d-4cfcdf48cd3e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:51.259663 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-78acbe44-562b-4afa-973d-4cfcdf48cd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:51.281132 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b78d6-aa3c-474d-be28-a7277ca6bf96 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:51.318843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddaccd-00bf-4cf8-8172-8b8b2f0f3ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:51.319479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddaccd-00bf-4cf8-8172-8b8b2f0f3ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:51.319781 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddaccd-00bf-4cf8-8172-8b8b2f0f3ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:51.320098 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddaccd-00bf-4cf8-8172-8b8b2f0f3ce8 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:51.320760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ddaccd-00bf-4cf8-8172-8b8b2f0f3ce8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:51.321135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ddaccd-00bf-4cf8-8172-8b8b2f0f3ce8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:51.322586 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ddaccd-00bf-4cf8-8172-8b8b2f0f3ce8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:51.333096 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 494/1007] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:51.333324 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 514/1008] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:51 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:18:51.334945 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddaccd-00bf-4cf8-8172-8b8b2f0f3ce8 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:51.345521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:51.453742 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddaccd-00bf-4cf8-8172-8b8b2f0f3ce8 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:51.495190 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819df0b8-0f4d-4bbf-a492-7bbe260cdfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:51.495874 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819df0b8-0f4d-4bbf-a492-7bbe260cdfe9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:51.496159 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819df0b8-0f4d-4bbf-a492-7bbe260cdfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:51.496430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819df0b8-0f4d-4bbf-a492-7bbe260cdfe9 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:51.497085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819df0b8-0f4d-4bbf-a492-7bbe260cdfe9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:51.497392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819df0b8-0f4d-4bbf-a492-7bbe260cdfe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:51.498811 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819df0b8-0f4d-4bbf-a492-7bbe260cdfe9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:51.504174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 495/1009] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:51.603053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acbe44-562b-4afa-973d-4cfcdf48cd3e None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:51.680129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:51.719314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acbe44-562b-4afa-973d-4cfcdf48cd3e None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:51.755516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fbe46-c248-4f23-8347-0daac26a5d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:51.756728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fbe46-c248-4f23-8347-0daac26a5d90 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:51.756728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fbe46-c248-4f23-8347-0daac26a5d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:51.756728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fbe46-c248-4f23-8347-0daac26a5d90 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:51.757318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fbe46-c248-4f23-8347-0daac26a5d90 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:51.758809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fbe46-c248-4f23-8347-0daac26a5d90 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:51.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-cb8fbe46-c248-4f23-8347-0daac26a5d90 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:18:51.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:51.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:51.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:51.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:51.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:51.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:51.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:51.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:18:51.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:51.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:51.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:51.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:51.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:51.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:51.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:51.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:51.769983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:51.769983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:51.769983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:51.769983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:51.769983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:51.769983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:51.769983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:51.769983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:51.769983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:51.769983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:51.769983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:51.769983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:51.769983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:51.769983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:51.769983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:51.769983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:51.770875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:51.770875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:51.770875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:51.770875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:51.770875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:51.770875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:51.770875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:51.770875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:51.770875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:51.770875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:51.770875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:51.770875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:51.770875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:18:51.770875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:51.770875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 515/1010] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:51.777151 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819df0b8-0f4d-4bbf-a492-7bbe260cdfe9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:51.858366 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:51.895562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819df0b8-0f4d-4bbf-a492-7bbe260cdfe9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:51.933185 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ee1fd-b86a-4f1c-99f0-3555057a404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:51.933835 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ee1fd-b86a-4f1c-99f0-3555057a404b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:51.933973 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766fd9a-9b83-4869-aa1f-25f99bb9c493 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:51.934159 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ee1fd-b86a-4f1c-99f0-3555057a404b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:51.934256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766fd9a-9b83-4869-aa1f-25f99bb9c493 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:51.934342 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ee1fd-b86a-4f1c-99f0-3555057a404b None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:51.934497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766fd9a-9b83-4869-aa1f-25f99bb9c493 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:51.934979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ee1fd-b86a-4f1c-99f0-3555057a404b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:51.935275 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ee1fd-b86a-4f1c-99f0-3555057a404b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:51.936006 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 516/1011] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:18:51.936652 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ee1fd-b86a-4f1c-99f0-3555057a404b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:51.941101 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef129c-e974-4308-9d25-706c4abedeae None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:51.941409 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef129c-e974-4308-9d25-706c4abedeae None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:51.941684 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef129c-e974-4308-9d25-706c4abedeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:51.946764 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 496/1012] 10.222.0.52 () {56 vars in 1112 bytes} [Mon Aug 29 20:18:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:51.948369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ee1fd-b86a-4f1c-99f0-3555057a404b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:51.963307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-90ef129c-e974-4308-9d25-706c4abedeae None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:51.965158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-90ef129c-e974-4308-9d25-706c4abedeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:52.041198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 517/1013] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:51 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:18:52.072651 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ee1fd-b86a-4f1c-99f0-3555057a404b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:52.109137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:52.115575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db68d6-0482-4631-9df0-00933b5216b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:52.116239 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db68d6-0482-4631-9df0-00933b5216b2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:52.116504 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db68d6-0482-4631-9df0-00933b5216b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:52.116786 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db68d6-0482-4631-9df0-00933b5216b2 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:52.117478 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db68d6-0482-4631-9df0-00933b5216b2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:52.117785 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db68d6-0482-4631-9df0-00933b5216b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:52.119194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db68d6-0482-4631-9df0-00933b5216b2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:52.125178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 497/1014] 10.222.0.52 () {56 vars in 1112 bytes} [Mon Aug 29 20:18:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:52.130908 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef129c-e974-4308-9d25-706c4abedeae None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:52.194544 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:52.242199 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef129c-e974-4308-9d25-706c4abedeae None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:52.280318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7614f0-0422-4540-9fda-bff3387eefda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:52.280909 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7614f0-0422-4540-9fda-bff3387eefda None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:52.281083 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7614f0-0422-4540-9fda-bff3387eefda None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:52.281293 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7614f0-0422-4540-9fda-bff3387eefda None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:52.282007 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7614f0-0422-4540-9fda-bff3387eefda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:52.283412 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7614f0-0422-4540-9fda-bff3387eefda None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:52.313400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 518/1015] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:18:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:18:52.313662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db68d6-0482-4631-9df0-00933b5216b2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:52.444680 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db68d6-0482-4631-9df0-00933b5216b2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:52.492300 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf7472-8e96-4673-81fd-21e9959da08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:52.492939 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf7472-8e96-4673-81fd-21e9959da08c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:52.493215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf7472-8e96-4673-81fd-21e9959da08c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:52.493542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf7472-8e96-4673-81fd-21e9959da08c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:52.494704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf7472-8e96-4673-81fd-21e9959da08c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:52.496207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf7472-8e96-4673-81fd-21e9959da08c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:52.497865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 498/1016] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:52.504372 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7614f0-0422-4540-9fda-bff3387eefda None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:52.623725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7614f0-0422-4540-9fda-bff3387eefda None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:52.642515 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:52.665325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd100ff-315e-4910-ad2f-4e9c407714dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:52.665966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd100ff-315e-4910-ad2f-4e9c407714dc None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:52.666240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd100ff-315e-4910-ad2f-4e9c407714dc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:52.666505 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd100ff-315e-4910-ad2f-4e9c407714dc None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:52.667321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd100ff-315e-4910-ad2f-4e9c407714dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:52.668636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd100ff-315e-4910-ad2f-4e9c407714dc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:52.705477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 519/1017] 10.222.0.52 () {60 vars in 1141 bytes} [Mon Aug 29 20:18:52 2022] POST /identity/v3/projects => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:18:53.451099 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec7157-13fd-4f10-8d58-43d4e9c239e3 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:53.451627 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec7157-13fd-4f10-8d58-43d4e9c239e3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:53.451627 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec7157-13fd-4f10-8d58-43d4e9c239e3 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:53.453339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 499/1018] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:18:53.458735 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c4bfd-8358-485b-87b2-61586b83d043 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:53.459261 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c4bfd-8358-485b-87b2-61586b83d043 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:53.459261 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c4bfd-8358-485b-87b2-61586b83d043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:53.478955 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b15c4bfd-8358-485b-87b2-61586b83d043 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:53.480236 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b15c4bfd-8358-485b-87b2-61586b83d043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:53.558510 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 520/1019] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:53 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:53.837468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec7157-13fd-4f10-8d58-43d4e9c239e3 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:53.903525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:53.953213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec7157-13fd-4f10-8d58-43d4e9c239e3 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:53.990838 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c28b7-5111-48a0-adf2-7084df113726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:53.991446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c28b7-5111-48a0-adf2-7084df113726 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:53.991748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c28b7-5111-48a0-adf2-7084df113726 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:53.992021 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c28b7-5111-48a0-adf2-7084df113726 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:53.992691 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c28b7-5111-48a0-adf2-7084df113726 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:53.994116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c28b7-5111-48a0-adf2-7084df113726 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:54.012863 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 500/1020] 10.222.0.52 () {60 vars in 1141 bytes} [Mon Aug 29 20:18:53 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:18:54.415167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42fd32-e931-4981-89fc-b192be2bd3e3 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:54.415427 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42fd32-e931-4981-89fc-b192be2bd3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:54.415708 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42fd32-e931-4981-89fc-b192be2bd3e3 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:54.417549 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 521/1021] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:54.423954 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd942f5-811f-4316-a187-fb0e2a6a6c6e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:54.424258 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd942f5-811f-4316-a187-fb0e2a6a6c6e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:54.424621 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd942f5-811f-4316-a187-fb0e2a6a6c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:54.445570 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-9bd942f5-811f-4316-a187-fb0e2a6a6c6e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:54.446386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9bd942f5-811f-4316-a187-fb0e2a6a6c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:54.531465 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 501/1022] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:54.683191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174ffe8-c7ac-4b4e-9748-3bafbda91a0b None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:54.683705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174ffe8-c7ac-4b4e-9748-3bafbda91a0b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:54.683705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174ffe8-c7ac-4b4e-9748-3bafbda91a0b None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:54.685480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 522/1023] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:54.690791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcb83f-3a76-45ec-a6d5-707850b1d0f9 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:54.691077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcb83f-3a76-45ec-a6d5-707850b1d0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:54.691345 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcb83f-3a76-45ec-a6d5-707850b1d0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:54.710469 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1fdcb83f-3a76-45ec-a6d5-707850b1d0f9 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:54.711663 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1fdcb83f-3a76-45ec-a6d5-707850b1d0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:54.764953 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:54.794440 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 502/1024] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:54.795282 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174ffe8-c7ac-4b4e-9748-3bafbda91a0b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:54.901441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:54.910322 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174ffe8-c7ac-4b4e-9748-3bafbda91a0b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:54.949979 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db121d-67fa-43e2-9e9f-dca565ac6aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:54.950635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db121d-67fa-43e2-9e9f-dca565ac6aaa None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:54.950918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db121d-67fa-43e2-9e9f-dca565ac6aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:54.951186 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db121d-67fa-43e2-9e9f-dca565ac6aaa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:54.962710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db121d-67fa-43e2-9e9f-dca565ac6aaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:54.968062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-60db121d-67fa-43e2-9e9f-dca565ac6aaa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:18:54.968062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:54.968062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:54.968062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:54.968062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:54.968062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:54.968062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:54.968062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:54.968062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:54.968062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:54.968062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:54.968062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:54.968062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:54.968062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:54.968062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:54.968062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:54.969216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:54.969216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:54.969216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:54.969216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:54.969216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:54.969216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:54.969216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:54.969216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:54.969216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:54.969216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:54.969216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:54.969216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:54.969216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:54.969216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:54.969216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:54.969216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:54.970872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:54.970872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:54.970872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:54.970872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:54.970872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:54.970872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:54.970872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:54.970872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:54.970872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:54.970872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:54.970872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:18:54.970872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:54.970872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 523/1025] 10.222.0.52 () {56 vars in 1120 bytes} [Mon Aug 29 20:18:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:54.975193 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcb83f-3a76-45ec-a6d5-707850b1d0f9 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:55.068597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db121d-67fa-43e2-9e9f-dca565ac6aaa None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:55.096693 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcb83f-3a76-45ec-a6d5-707850b1d0f9 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:55.140540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054a6b4-81db-4cb6-ba1b-06763bcadae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:55.141188 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054a6b4-81db-4cb6-ba1b-06763bcadae0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:55.141498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054a6b4-81db-4cb6-ba1b-06763bcadae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:55.141773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054a6b4-81db-4cb6-ba1b-06763bcadae0 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:55.142444 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054a6b4-81db-4cb6-ba1b-06763bcadae0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:55.142749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054a6b4-81db-4cb6-ba1b-06763bcadae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:55.144138 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054a6b4-81db-4cb6-ba1b-06763bcadae0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:55.153009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 503/1026] 10.222.0.52 () {56 vars in 1115 bytes} [Mon Aug 29 20:18:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:55.158766 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054a6b4-81db-4cb6-ba1b-06763bcadae0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:55.195790 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db121d-67fa-43e2-9e9f-dca565ac6aaa None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:55.211734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:55.232648 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68f3ae-1b1f-4e0b-a73f-faf8f1511a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:55.233281 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68f3ae-1b1f-4e0b-a73f-faf8f1511a93 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:55.233585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68f3ae-1b1f-4e0b-a73f-faf8f1511a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:55.233853 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68f3ae-1b1f-4e0b-a73f-faf8f1511a93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:55.234978 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68f3ae-1b1f-4e0b-a73f-faf8f1511a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:55.236508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68f3ae-1b1f-4e0b-a73f-faf8f1511a93 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:55.238234 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 524/1027] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:55.243909 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68f3ae-1b1f-4e0b-a73f-faf8f1511a93 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:55.281251 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:55.287897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054a6b4-81db-4cb6-ba1b-06763bcadae0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:55.329280 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eeff39-75aa-4827-8742-ac0da5e99ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:55.330053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eeff39-75aa-4827-8742-ac0da5e99ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:55.330395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eeff39-75aa-4827-8742-ac0da5e99ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:55.330733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eeff39-75aa-4827-8742-ac0da5e99ef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:55.347766 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eeff39-75aa-4827-8742-ac0da5e99ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:55.349569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eeff39-75aa-4827-8742-ac0da5e99ef2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:55.366501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-d2eeff39-75aa-4827-8742-ac0da5e99ef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:55.366501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:55.366501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:55.366501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:55.366501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:55.366501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:55.366501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:55.366501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:55.366501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:55.366501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:55.366501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:55.366501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:55.366501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:55.366501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:55.366501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:55.366501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:55.367657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:55.367657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:55.367657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:55.367657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:55.367657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:55.367657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:55.367657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:55.367657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:55.367657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:55.367657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:55.367657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:55.367657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:55.367657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:55.367657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:55.367657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:55.367657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:55.367657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:55.368655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:55.368655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:55.368655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:55.368655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 504/1028] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:55.374025 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eeff39-75aa-4827-8742-ac0da5e99ef2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:55.396270 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68f3ae-1b1f-4e0b-a73f-faf8f1511a93 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:55.437898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a640fc7-20a7-4f11-9734-ceac1c07c4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:55.438527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a640fc7-20a7-4f11-9734-ceac1c07c4d1 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:55.438855 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a640fc7-20a7-4f11-9734-ceac1c07c4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:55.439351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a640fc7-20a7-4f11-9734-ceac1c07c4d1 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:55.439796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a640fc7-20a7-4f11-9734-ceac1c07c4d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:55.441242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a640fc7-20a7-4f11-9734-ceac1c07c4d1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:55.466118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 525/1029] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:18:55 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:18:55.476792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:55.491571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eeff39-75aa-4827-8742-ac0da5e99ef2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:55.535714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600f817-eb14-49ac-aea2-76c4d9e897cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:55.536742 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600f817-eb14-49ac-aea2-76c4d9e897cf None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:55.536742 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600f817-eb14-49ac-aea2-76c4d9e897cf None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:55.536742 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600f817-eb14-49ac-aea2-76c4d9e897cf None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:55.537387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600f817-eb14-49ac-aea2-76c4d9e897cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:55.537690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600f817-eb14-49ac-aea2-76c4d9e897cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:55.539102 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600f817-eb14-49ac-aea2-76c4d9e897cf None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:55.553904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 505/1030] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:55.559742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a640fc7-20a7-4f11-9734-ceac1c07c4d1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:55.655473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:55.675956 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a640fc7-20a7-4f11-9734-ceac1c07c4d1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:55.719032 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ed5f9-8387-4535-a213-d37d6bc086d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:55.720340 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ed5f9-8387-4535-a213-d37d6bc086d3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:55.720759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ed5f9-8387-4535-a213-d37d6bc086d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:55.721164 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ed5f9-8387-4535-a213-d37d6bc086d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:55.730337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ed5f9-8387-4535-a213-d37d6bc086d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:55.732053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ed5f9-8387-4535-a213-d37d6bc086d3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:55.744578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-0f5ed5f9-8387-4535-a213-d37d6bc086d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:18:55.744578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:55.744578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:55.744578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:55.744578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:55.744578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:55.744578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:55.744578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:55.744578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:55.744578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:55.744578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:55.744578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:55.744578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:18:55.744578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:18:55.744578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:18:55.744578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:55.745751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:55.746683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:55.746683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:55.746683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:18:55.746683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:18:55.746683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:18:55.746683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:18:55.746683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:18:55.746683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:18:55.746683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:18:55.746683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:55.747213 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 526/1031] 10.222.0.52 () {56 vars in 1093 bytes} [Mon Aug 29 20:18:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:55.752684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600f817-eb14-49ac-aea2-76c4d9e897cf None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:55.859629 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600f817-eb14-49ac-aea2-76c4d9e897cf None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:55.897415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7eaa75-5f05-46c4-9b9b-88c413e404c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:55.898049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eaa75-5f05-46c4-9b9b-88c413e404c8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:55.898318 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eaa75-5f05-46c4-9b9b-88c413e404c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:55.898581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eaa75-5f05-46c4-9b9b-88c413e404c8 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:55.899305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7eaa75-5f05-46c4-9b9b-88c413e404c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:55.899605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7eaa75-5f05-46c4-9b9b-88c413e404c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:55.901102 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7eaa75-5f05-46c4-9b9b-88c413e404c8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:55.919675 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 506/1032] 10.222.0.52 () {56 vars in 1133 bytes} [Mon Aug 29 20:18:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:55.925304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ed5f9-8387-4535-a213-d37d6bc086d3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:55.996996 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbaa45-251e-4e2f-bc78-758155f41cba None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:55.997321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbaa45-251e-4e2f-bc78-758155f41cba None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:55.997511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbaa45-251e-4e2f-bc78-758155f41cba None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:55.998884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 507/1033] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:18:56.004443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350c95d-97b5-443a-9b7e-b6cbab24631e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:56.004725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350c95d-97b5-443a-9b7e-b6cbab24631e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:56.004997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350c95d-97b5-443a-9b7e-b6cbab24631e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:56.023902 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-0350c95d-97b5-443a-9b7e-b6cbab24631e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:56.025095 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0350c95d-97b5-443a-9b7e-b6cbab24631e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:56.027315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:56.032084 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ed5f9-8387-4535-a213-d37d6bc086d3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:56.073666 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e8818-7796-4731-b804-33f0cd80f309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:56.074301 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e8818-7796-4731-b804-33f0cd80f309 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:56.074581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e8818-7796-4731-b804-33f0cd80f309 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:56.074851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e8818-7796-4731-b804-33f0cd80f309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:56.098317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:56.114558 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 508/1034] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:18:56.163856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e8818-7796-4731-b804-33f0cd80f309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:56.165325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e8818-7796-4731-b804-33f0cd80f309 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:56.271495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 527/1035] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:18:55 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:18:56.277047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350c95d-97b5-443a-9b7e-b6cbab24631e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:56.381373 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e8818-7796-4731-b804-33f0cd80f309 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:56.391305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350c95d-97b5-443a-9b7e-b6cbab24631e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:56.425652 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:56.428784 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74615d30-f1d2-45ed-bfb4-bc454df62bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:56.429309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74615d30-f1d2-45ed-bfb4-bc454df62bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:56.429614 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74615d30-f1d2-45ed-bfb4-bc454df62bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:56.429882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74615d30-f1d2-45ed-bfb4-bc454df62bf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:56.437152 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:56.443159 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74615d30-f1d2-45ed-bfb4-bc454df62bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:56.444633 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74615d30-f1d2-45ed-bfb4-bc454df62bf1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:56.460360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-74615d30-f1d2-45ed-bfb4-bc454df62bf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:56.460360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:56.460360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:56.460360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:56.460360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:56.460360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:56.460360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:56.460360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:56.460360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:56.460360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:56.460360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:56.460360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:56.460360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:18:56.460360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:18:56.460360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:18:56.460360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:18:56.461714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:56.461714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:56.461714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:56.461714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:56.461714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:56.461714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:56.461714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:56.461714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:56.461714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:56.461714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:56.461714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:56.461714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:56.461714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:56.461714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:56.461714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:56.461714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:56.461714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:18:56.462616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:18:56.462616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:18:56.462616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:56.466842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 509/1036] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:56.467597 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74615d30-f1d2-45ed-bfb4-bc454df62bf1 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:56.490288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e8818-7796-4731-b804-33f0cd80f309 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:56.529329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63310334-68f5-40b8-8da4-c709c5cfe698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:56.530197 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63310334-68f5-40b8-8da4-c709c5cfe698 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:56.530478 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63310334-68f5-40b8-8da4-c709c5cfe698 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:56.530750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63310334-68f5-40b8-8da4-c709c5cfe698 None admin] PATH_INFO: `/v3/services/image` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:56.531500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63310334-68f5-40b8-8da4-c709c5cfe698 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:56.533510 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63310334-68f5-40b8-8da4-c709c5cfe698 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:56.543922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-63310334-68f5-40b8-8da4-c709c5cfe698 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:18:56.543922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:56.543922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:56.543922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:56.543922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:56.543922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:56.543922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:56.543922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:56.543922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:18:56.543922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:56.543922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:56.543922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:56.543922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:56.543922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:56.543922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:56.543922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:56.543922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:56.544988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:56.544988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:56.544988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:56.544988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:56.544988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:56.544988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:56.544988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:56.544988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:56.544988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:56.544988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:56.544988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:56.544988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:56.544988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:56.544988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:56.544988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:56.544988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:56.545902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:56.545902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:56.545902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:56.545902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:56.545902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:56.545902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:56.545902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:56.545902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:56.545902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:56.545902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:56.545902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:56.545902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:56.545902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:18:56.545902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:56.545902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 528/1037] 10.222.0.52 () {56 vars in 1105 bytes} [Mon Aug 29 20:18:56 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:18:56.550893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63310334-68f5-40b8-8da4-c709c5cfe698 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:56.578395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74615d30-f1d2-45ed-bfb4-bc454df62bf1 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:56.631246 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c55829-ff60-4892-9d3f-bd88b36a7f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:56.632440 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c55829-ff60-4892-9d3f-bd88b36a7f0d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:56.632817 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c55829-ff60-4892-9d3f-bd88b36a7f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:56.633677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c55829-ff60-4892-9d3f-bd88b36a7f0d None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:56.634418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c55829-ff60-4892-9d3f-bd88b36a7f0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:56.634732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c55829-ff60-4892-9d3f-bd88b36a7f0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:56.636261 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c55829-ff60-4892-9d3f-bd88b36a7f0d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:56.650694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 510/1038] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:56.656763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c55829-ff60-4892-9d3f-bd88b36a7f0d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:56.670026 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63310334-68f5-40b8-8da4-c709c5cfe698 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:56.678615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:56.708396 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737be11e-f1f9-4825-855b-8fa9ef2deeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:56.709001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737be11e-f1f9-4825-855b-8fa9ef2deeb6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:56.709271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737be11e-f1f9-4825-855b-8fa9ef2deeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:56.709558 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737be11e-f1f9-4825-855b-8fa9ef2deeb6 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:56.710181 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737be11e-f1f9-4825-855b-8fa9ef2deeb6 None admin] RBAC: Adding query filter params (name=image) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:56.710543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737be11e-f1f9-4825-855b-8fa9ef2deeb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:56.712014 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737be11e-f1f9-4825-855b-8fa9ef2deeb6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:56.714468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:56.717546 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 529/1039] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:56.723296 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737be11e-f1f9-4825-855b-8fa9ef2deeb6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:56.771180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c55829-ff60-4892-9d3f-bd88b36a7f0d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:56.807135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110a325-2c15-4df1-b5ee-9be3d0748c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:56.807724 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a325-2c15-4df1-b5ee-9be3d0748c88 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:56.807998 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a325-2c15-4df1-b5ee-9be3d0748c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:56.808264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a325-2c15-4df1-b5ee-9be3d0748c88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:56.815429 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110a325-2c15-4df1-b5ee-9be3d0748c88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:56.816884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110a325-2c15-4df1-b5ee-9be3d0748c88 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:56.828405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-a110a325-2c15-4df1-b5ee-9be3d0748c88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:56.828405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:56.828405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:56.828405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:56.828405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:56.828405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:56.828405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:56.828405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:56.828405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:56.828405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:56.828405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:56.828405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:56.828405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:18:56.828405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:18:56.828405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:18:56.829381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:18:56.829381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:56.829381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:56.829381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:56.829381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:56.829381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:56.829381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:56.829381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:56.829381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:56.829381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:56.829381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:56.829381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:56.829381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:56.829381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:56.829381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:56.829381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:56.829381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:56.830313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:18:56.830313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:18:56.830313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:18:56.830313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:18:56.830313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:18:56.830313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:18:56.830313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:18:56.830313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:56.830313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 511/1040] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:18:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:56.835330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110a325-2c15-4df1-b5ee-9be3d0748c88 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:56.835484 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737be11e-f1f9-4825-855b-8fa9ef2deeb6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:56.873096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3099e6-a39c-4047-930c-c707dccc0b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:56.873738 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3099e6-a39c-4047-930c-c707dccc0b31 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:56.874012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3099e6-a39c-4047-930c-c707dccc0b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:56.874276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3099e6-a39c-4047-930c-c707dccc0b31 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:56.874907 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3099e6-a39c-4047-930c-c707dccc0b31 None admin] RBAC: Adding query filter params (type=image) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:56.875258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3099e6-a39c-4047-930c-c707dccc0b31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:56.876673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3099e6-a39c-4047-930c-c707dccc0b31 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:56.882090 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 530/1041] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:56.887799 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3099e6-a39c-4047-930c-c707dccc0b31 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:56.924064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:56.953798 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110a325-2c15-4df1-b5ee-9be3d0748c88 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:56.966010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:56.993989 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d364c7b-0d7e-42af-a137-e89c6b3d81d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:56.995187 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d364c7b-0d7e-42af-a137-e89c6b3d81d9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:56.995466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d364c7b-0d7e-42af-a137-e89c6b3d81d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:56.995742 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d364c7b-0d7e-42af-a137-e89c6b3d81d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:56.996479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d364c7b-0d7e-42af-a137-e89c6b3d81d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:56.996787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d364c7b-0d7e-42af-a137-e89c6b3d81d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:56.998774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d364c7b-0d7e-42af-a137-e89c6b3d81d9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:57.010069 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3099e6-a39c-4047-930c-c707dccc0b31 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:57.012547 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 512/1042] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:18:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:57.018432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d364c7b-0d7e-42af-a137-e89c6b3d81d9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:57.047824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9173285-cfa2-4c0b-8479-6b13ce1f95d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:57.048446 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9173285-cfa2-4c0b-8479-6b13ce1f95d7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:57.048719 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9173285-cfa2-4c0b-8479-6b13ce1f95d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:57.048990 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9173285-cfa2-4c0b-8479-6b13ce1f95d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:57.049733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9173285-cfa2-4c0b-8479-6b13ce1f95d7 None admin] RBAC: Adding query filter params (interface=public, service_id=9c3bc6e0af1d46d6b3544d49f5d91a3c, region_id=RegionOne) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:57.050117 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9173285-cfa2-4c0b-8479-6b13ce1f95d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:57.051681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9173285-cfa2-4c0b-8479-6b13ce1f95d7 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:57.057477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 531/1043] 10.222.0.52 () {56 vars in 1251 bytes} [Mon Aug 29 20:18:56 2022] GET /identity/v3/endpoints?service_id=9c3bc6e0af1d46d6b3544d49f5d91a3c&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:57.062954 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9173285-cfa2-4c0b-8479-6b13ce1f95d7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:57.141092 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d364c7b-0d7e-42af-a137-e89c6b3d81d9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:57.169016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:57.172641 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9173285-cfa2-4c0b-8479-6b13ce1f95d7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:57.180448 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f5083-41fd-4044-a96d-6079cee86981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:57.181586 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f5083-41fd-4044-a96d-6079cee86981 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:57.181867 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f5083-41fd-4044-a96d-6079cee86981 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:57.182160 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f5083-41fd-4044-a96d-6079cee86981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:57.183300 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f5083-41fd-4044-a96d-6079cee86981 None admin] RBAC: Adding query filter params (role.id=5a2fa8fc43094a0f9bed98b6e5c4504a, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=9c95d16fd4da4fa7987b893eae0b3ef5) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:57.183611 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f5083-41fd-4044-a96d-6079cee86981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:57.185414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f5083-41fd-4044-a96d-6079cee86981 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:57.197404 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 513/1044] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:18:57 2022] GET /identity/v3/role_assignments?user.id=9c95d16fd4da4fa7987b893eae0b3ef5&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=5a2fa8fc43094a0f9bed98b6e5c4504a => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:18:57.210679 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19019448-81d7-464f-b6a3-f8119cf73ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:57.211300 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19019448-81d7-464f-b6a3-f8119cf73ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:57.211604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19019448-81d7-464f-b6a3-f8119cf73ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:57.211891 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19019448-81d7-464f-b6a3-f8119cf73ab4 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:57.212503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19019448-81d7-464f-b6a3-f8119cf73ab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:57.214291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19019448-81d7-464f-b6a3-f8119cf73ab4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:57.222415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 532/1045] 10.222.0.52 () {56 vars in 1087 bytes} [Mon Aug 29 20:18:57 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:18:57.494395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191f390-922b-4df2-bb41-cec632f5b917 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:57.494741 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191f390-922b-4df2-bb41-cec632f5b917 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:57.495021 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191f390-922b-4df2-bb41-cec632f5b917 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:57.496380 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 514/1046] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:57.502122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608260c-68f0-478d-909f-4106a08cee4e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:57.502402 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608260c-68f0-478d-909f-4106a08cee4e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:57.502677 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608260c-68f0-478d-909f-4106a08cee4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:57.523770 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7608260c-68f0-478d-909f-4106a08cee4e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:57.525099 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7608260c-68f0-478d-909f-4106a08cee4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:57.599144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 533/1047] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:57.863121 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191f390-922b-4df2-bb41-cec632f5b917 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:57.902812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:57.976780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191f390-922b-4df2-bb41-cec632f5b917 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:58.011344 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279d3bf-9b48-474d-a439-b38618b77923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:58.011979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279d3bf-9b48-474d-a439-b38618b77923 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:58.012256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279d3bf-9b48-474d-a439-b38618b77923 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:58.012520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279d3bf-9b48-474d-a439-b38618b77923 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:58.023373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279d3bf-9b48-474d-a439-b38618b77923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:58.028252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-6279d3bf-9b48-474d-a439-b38618b77923 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:18:58.028252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:58.028252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:58.028252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:58.028252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:58.028252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:58.028252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:58.028252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:58.028252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:58.028252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:58.028252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:58.028252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:58.028252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:58.028252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:58.028252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:58.028252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:58.029196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:58.029196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:58.029196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:58.029196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:58.029196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:58.029196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:58.029196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:58.029196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:58.029196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:58.029196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:58.029196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:58.029196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:58.029196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:58.029196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:58.029196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:58.029196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:58.034935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:58.034935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:58.034935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:58.034935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:58.034935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:58.034935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:58.034935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:58.034935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:58.034935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:58.034935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:58.034935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:18:58.034935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:58.034935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 515/1048] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:18:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:58.035887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608260c-68f0-478d-909f-4106a08cee4e None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:58.144302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:58.154824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608260c-68f0-478d-909f-4106a08cee4e None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:58.198601 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0613eaf-dcfe-4577-806b-8e5fdb6537c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:58.199219 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0613eaf-dcfe-4577-806b-8e5fdb6537c3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:58.199498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0613eaf-dcfe-4577-806b-8e5fdb6537c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:58.199773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0613eaf-dcfe-4577-806b-8e5fdb6537c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:58.200444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0613eaf-dcfe-4577-806b-8e5fdb6537c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:58.200749 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0613eaf-dcfe-4577-806b-8e5fdb6537c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:58.202175 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0613eaf-dcfe-4577-806b-8e5fdb6537c3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:58.211619 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 534/1049] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:18:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:58.218144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279d3bf-9b48-474d-a439-b38618b77923 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:58.326749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:58.340319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279d3bf-9b48-474d-a439-b38618b77923 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:58.377972 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9387d-c120-49f9-9386-217b6f8f7b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:58.378608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9387d-c120-49f9-9386-217b6f8f7b37 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:58.378888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9387d-c120-49f9-9386-217b6f8f7b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:58.379159 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9387d-c120-49f9-9386-217b6f8f7b37 None admin] PATH_INFO: `/v3/users/2b4f04d746784c7aba907e6c142f29ce` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:58.393513 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9387d-c120-49f9-9386-217b6f8f7b37 None admin] RBAC: Authorizing `identity:get_user(user_id=2b4f04d746784c7aba907e6c142f29ce)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:58.395089 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9387d-c120-49f9-9386-217b6f8f7b37 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:58.396960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 516/1050] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:18:58 2022] GET /identity/v3/users/2b4f04d746784c7aba907e6c142f29ce => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:58.402985 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0613eaf-dcfe-4577-806b-8e5fdb6537c3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:58.510340 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0613eaf-dcfe-4577-806b-8e5fdb6537c3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:58.548300 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d4961-083b-4fed-867e-f61e56dd24cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:58.548902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d4961-083b-4fed-867e-f61e56dd24cd None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:58.549191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d4961-083b-4fed-867e-f61e56dd24cd None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:58.549715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d4961-083b-4fed-867e-f61e56dd24cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:58.574884 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:58.622582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d4961-083b-4fed-867e-f61e56dd24cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:58.624061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d4961-083b-4fed-867e-f61e56dd24cd None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:58.765449 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 535/1051] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:18:58 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:18:58.771697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9387d-c120-49f9-9386-217b6f8f7b37 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:58.923520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9387d-c120-49f9-9386-217b6f8f7b37 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:58.981197 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61d028-771f-4fcb-8427-442af154c8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:58.981995 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61d028-771f-4fcb-8427-442af154c8bd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:58.982278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61d028-771f-4fcb-8427-442af154c8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:58.982550 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61d028-771f-4fcb-8427-442af154c8bd None admin] PATH_INFO: `/v3/projects/c5c8b30d8bf149a899729983c2b8cc27` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:58.983732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61d028-771f-4fcb-8427-442af154c8bd None admin] RBAC: Authorizing `identity:get_project(project_id=c5c8b30d8bf149a899729983c2b8cc27)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:58.985186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61d028-771f-4fcb-8427-442af154c8bd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:58.987143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 517/1052] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:18:58 2022] GET /identity/v3/projects/c5c8b30d8bf149a899729983c2b8cc27 => generated 311 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:58.993731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d4961-083b-4fed-867e-f61e56dd24cd None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:59.069555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:59.121419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d4961-083b-4fed-867e-f61e56dd24cd None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:59.160207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff9782-f53f-43e1-a04c-351e47eecffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:59.160827 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff9782-f53f-43e1-a04c-351e47eecffe None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:59.161105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff9782-f53f-43e1-a04c-351e47eecffe None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:59.161389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff9782-f53f-43e1-a04c-351e47eecffe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:59.162151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff9782-f53f-43e1-a04c-351e47eecffe None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=c5c8b30d8bf149a899729983c2b8cc27, user.id=2b4f04d746784c7aba907e6c142f29ce) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:59.162461 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff9782-f53f-43e1-a04c-351e47eecffe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:59.163910 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff9782-f53f-43e1-a04c-351e47eecffe None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:59.170658 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 536/1053] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:18:58 2022] GET /identity/v3/role_assignments?user.id=2b4f04d746784c7aba907e6c142f29ce&scope.project.id=c5c8b30d8bf149a899729983c2b8cc27&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:59.202821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802a20b-ca3e-4dc0-86a0-d7a2cc81dc90 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:59.203079 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802a20b-ca3e-4dc0-86a0-d7a2cc81dc90 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:59.203368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802a20b-ca3e-4dc0-86a0-d7a2cc81dc90 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:59.204997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 518/1054] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:59.210749 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e926e1a-3aa1-4938-91e6-3aa08d91ea02 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:59.211091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e926e1a-3aa1-4938-91e6-3aa08d91ea02 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:59.211275 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e926e1a-3aa1-4938-91e6-3aa08d91ea02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:59.215910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4992f-2c58-4190-ae1e-14388e7eb6f2 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:59.216185 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4992f-2c58-4190-ae1e-14388e7eb6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:59.216484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4992f-2c58-4190-ae1e-14388e7eb6f2 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:59.217946 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 519/1055] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:18:59.224128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1ccf8-99c9-4531-aedd-ba87499e79b8 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:59.224439 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1ccf8-99c9-4531-aedd-ba87499e79b8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:59.225144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1ccf8-99c9-4531-aedd-ba87499e79b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:59.233726 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6e926e1a-3aa1-4938-91e6-3aa08d91ea02 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:59.234937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6e926e1a-3aa1-4938-91e6-3aa08d91ea02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:59.245585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-72d1ccf8-99c9-4531-aedd-ba87499e79b8 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:59.246982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-72d1ccf8-99c9-4531-aedd-ba87499e79b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:59.265817 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:59.350308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 537/1056] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:18:59.363604 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 520/1057] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:18:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:18:59.651915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e926e1a-3aa1-4938-91e6-3aa08d91ea02 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:59.683562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1ccf8-99c9-4531-aedd-ba87499e79b8 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:59.721551 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:59.798333 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e926e1a-3aa1-4938-91e6-3aa08d91ea02 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:59.832282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1ccf8-99c9-4531-aedd-ba87499e79b8 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:59.848404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d71c17-f965-4884-b8d2-746238f47bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:59.849329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d71c17-f965-4884-b8d2-746238f47bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:59.849664 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d71c17-f965-4884-b8d2-746238f47bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:59.849935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d71c17-f965-4884-b8d2-746238f47bb3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:59.862596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d71c17-f965-4884-b8d2-746238f47bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:18:59.867581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-f2d71c17-f965-4884-b8d2-746238f47bb3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:18:59.867581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:59.867581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:59.867581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:59.867581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:59.867581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:59.867581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:59.867581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:59.867581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:59.867581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:59.867581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:59.867581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:59.867581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:18:59.867581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:18:59.867581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:18:59.867581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:18:59.868796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:18:59.868796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:18:59.868796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:18:59.868796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:18:59.868796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:59.868796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:59.868796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:59.868796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:59.868796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:59.868796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:59.868796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:59.868796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:59.868796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:59.868796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:59.868796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:59.868796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:59.869966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:59.869966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:59.869966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:59.869966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:59.869966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:18:59.869966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:18:59.869966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:18:59.869966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:18:59.869966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:18:59.869966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:18:59.869966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:18:59.869966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:18:59.869966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 538/1058] 10.222.0.52 () {56 vars in 1120 bytes} [Mon Aug 29 20:18:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:59.875550 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d71c17-f965-4884-b8d2-746238f47bb3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:59.887412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a600b5c-95ea-4599-91a4-5fbc54203654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:59.888299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a600b5c-95ea-4599-91a4-5fbc54203654 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:59.888564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a600b5c-95ea-4599-91a4-5fbc54203654 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:59.888834 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a600b5c-95ea-4599-91a4-5fbc54203654 None admin] PATH_INFO: `/v3/services/image` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:59.889508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a600b5c-95ea-4599-91a4-5fbc54203654 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:59.891228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a600b5c-95ea-4599-91a4-5fbc54203654 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:59.903028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-3a600b5c-95ea-4599-91a4-5fbc54203654 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:18:59.903028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:59.903028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:18:59.903028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:18:59.903028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:18:59.903028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:18:59.903028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:18:59.903028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:59.903028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:18:59.903028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:59.903028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:18:59.903028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:59.903028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:18:59.903028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:18:59.903028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:18:59.903028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:18:59.903028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:18:59.904494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:18:59.904494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:18:59.904494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:18:59.904494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:18:59.904494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:18:59.904494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:18:59.904494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:18:59.904494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:18:59.904494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:18:59.904494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:18:59.904494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:18:59.904494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:18:59.904494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:18:59.904494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:18:59.904494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:18:59.904494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:18:59.905735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:18:59.905735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:18:59.905735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:18:59.905735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:18:59.905735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:18:59.905735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:18:59.905735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:18:59.905735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:18:59.905735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:18:59.905735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:18:59.905735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:18:59.905735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:18:59.905735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:18:59.905735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:18:59.905735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 521/1059] 10.222.0.52 () {56 vars in 1105 bytes} [Mon Aug 29 20:18:59 2022] GET /identity/v3/services/image => generated 86 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:18:59.913165 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a600b5c-95ea-4599-91a4-5fbc54203654 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:59.941972 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:00.032041 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d71c17-f965-4884-b8d2-746238f47bb3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:00.043388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:00.082477 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a600b5c-95ea-4599-91a4-5fbc54203654 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:00.100308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78381f77-8d68-4332-8d8c-ff7beccad85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:00.100938 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78381f77-8d68-4332-8d8c-ff7beccad85f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:00.101182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78381f77-8d68-4332-8d8c-ff7beccad85f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:00.101508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78381f77-8d68-4332-8d8c-ff7beccad85f None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:00.102508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78381f77-8d68-4332-8d8c-ff7beccad85f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:00.102816 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78381f77-8d68-4332-8d8c-ff7beccad85f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:00.104838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78381f77-8d68-4332-8d8c-ff7beccad85f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:00.124514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 539/1060] 10.222.0.52 () {56 vars in 1115 bytes} [Mon Aug 29 20:18:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:19:00.131489 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78381f77-8d68-4332-8d8c-ff7beccad85f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:00.151238 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c4210-1d38-4df0-a6a1-3867219d086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:00.152375 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c4210-1d38-4df0-a6a1-3867219d086c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:00.152917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c4210-1d38-4df0-a6a1-3867219d086c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:00.153633 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c4210-1d38-4df0-a6a1-3867219d086c None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:00.154767 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c4210-1d38-4df0-a6a1-3867219d086c None admin] RBAC: Adding query filter params (name=image) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:00.155368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c4210-1d38-4df0-a6a1-3867219d086c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:00.158124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c4210-1d38-4df0-a6a1-3867219d086c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:00.169449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 522/1061] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:18:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:00.175756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c4210-1d38-4df0-a6a1-3867219d086c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:00.301390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:00.301688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78381f77-8d68-4332-8d8c-ff7beccad85f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:00.347618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c4210-1d38-4df0-a6a1-3867219d086c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:00.367164 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44810db9-76c0-4643-bdf3-62327f9383a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:00.370502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44810db9-76c0-4643-bdf3-62327f9383a7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:00.370502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44810db9-76c0-4643-bdf3-62327f9383a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:00.370502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44810db9-76c0-4643-bdf3-62327f9383a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:00.387229 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44810db9-76c0-4643-bdf3-62327f9383a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:00.390138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44810db9-76c0-4643-bdf3-62327f9383a7 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:00.397813 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475f8a9-8683-43a4-bc9b-a3fcbbad0b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:00.398434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475f8a9-8683-43a4-bc9b-a3fcbbad0b02 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:00.398707 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475f8a9-8683-43a4-bc9b-a3fcbbad0b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:00.399106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475f8a9-8683-43a4-bc9b-a3fcbbad0b02 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:00.399637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475f8a9-8683-43a4-bc9b-a3fcbbad0b02 None admin] RBAC: Adding query filter params (type=image) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:00.399934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475f8a9-8683-43a4-bc9b-a3fcbbad0b02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:00.401456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475f8a9-8683-43a4-bc9b-a3fcbbad0b02 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:00.407790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 523/1062] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:19:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:19:00.414913 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475f8a9-8683-43a4-bc9b-a3fcbbad0b02 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:00.428086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-44810db9-76c0-4643-bdf3-62327f9383a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:19:00.428086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:00.428086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:00.428086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:00.428086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:00.428086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:00.428086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:00.428086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:00.428086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:00.428086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:00.428086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:00.428086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:00.428086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:19:00.428086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:19:00.428086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:19:00.428086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:19:00.429258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:00.429258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:00.429258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:00.429258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:00.429258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:00.429258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:00.429258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:00.429258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:00.429258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:00.429258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:00.429258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:00.429258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:00.429258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:00.429258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:00.429258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:00.429258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:00.429258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:19:00.430415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:19:00.430415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:19:00.430415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:19:00.430415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 540/1063] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:19:00.435603 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44810db9-76c0-4643-bdf3-62327f9383a7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:00.475534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:00.563175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475f8a9-8683-43a4-bc9b-a3fcbbad0b02 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:00.585675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44810db9-76c0-4643-bdf3-62327f9383a7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:00.632312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ccb3f-5d9c-4d18-ad3d-214bc93a01f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:00.632840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbceb47c-07bd-4b1b-9986-af6a172c3714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:00.632992 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ccb3f-5d9c-4d18-ad3d-214bc93a01f9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:00.633334 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ccb3f-5d9c-4d18-ad3d-214bc93a01f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:00.633700 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ccb3f-5d9c-4d18-ad3d-214bc93a01f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:00.634283 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceb47c-07bd-4b1b-9986-af6a172c3714 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:00.634398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ccb3f-5d9c-4d18-ad3d-214bc93a01f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:00.634746 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ccb3f-5d9c-4d18-ad3d-214bc93a01f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:00.635030 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceb47c-07bd-4b1b-9986-af6a172c3714 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:00.635556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceb47c-07bd-4b1b-9986-af6a172c3714 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:00.636364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ccb3f-5d9c-4d18-ad3d-214bc93a01f9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:00.636931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbceb47c-07bd-4b1b-9986-af6a172c3714 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:00.638671 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbceb47c-07bd-4b1b-9986-af6a172c3714 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:00.651400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 541/1064] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:00.658163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ccb3f-5d9c-4d18-ad3d-214bc93a01f9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:00.660949 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:00.678326 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 524/1065] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:19:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:19:00.778215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:00.805724 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ccb3f-5d9c-4d18-ad3d-214bc93a01f9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:00.861515 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b2961-ccba-4451-9583-22bcc5873246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:00.862586 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b2961-ccba-4451-9583-22bcc5873246 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:00.862850 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b2961-ccba-4451-9583-22bcc5873246 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:00.863167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b2961-ccba-4451-9583-22bcc5873246 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:00.872944 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b2961-ccba-4451-9583-22bcc5873246 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:00.874515 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b2961-ccba-4451-9583-22bcc5873246 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:00.888009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-c70b2961-ccba-4451-9583-22bcc5873246 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:19:00.888009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:00.888009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:00.888009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:00.888009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:00.888009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:00.888009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:00.888009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:00.888009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:00.888009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:00.888009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:00.888009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:00.888009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:19:00.888009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:19:00.888009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:19:00.888009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:00.889326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:00.890786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:00.890786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:00.890786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:19:00.890786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:19:00.890786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:19:00.890786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:19:00.890786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:19:00.890786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:19:00.890786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:19:00.890786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:19:00.890786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 542/1066] 10.222.0.52 () {56 vars in 1093 bytes} [Mon Aug 29 20:19:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:19:00.895620 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbceb47c-07bd-4b1b-9986-af6a172c3714 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:01.017753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbceb47c-07bd-4b1b-9986-af6a172c3714 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:01.059440 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c3255-d483-4a65-bf93-63ea850ecdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:01.060116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c3255-d483-4a65-bf93-63ea850ecdb2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:01.060450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c3255-d483-4a65-bf93-63ea850ecdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:01.060720 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c3255-d483-4a65-bf93-63ea850ecdb2 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:01.061600 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c3255-d483-4a65-bf93-63ea850ecdb2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:01.061947 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c3255-d483-4a65-bf93-63ea850ecdb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:01.063536 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c3255-d483-4a65-bf93-63ea850ecdb2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:01.093388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 525/1067] 10.222.0.52 () {56 vars in 1133 bytes} [Mon Aug 29 20:19:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:01.096041 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b2961-ccba-4451-9583-22bcc5873246 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:01.248074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b2961-ccba-4451-9583-22bcc5873246 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:01.289295 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009114e7-b669-42b6-b19b-12c2272d7569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:01.290613 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009114e7-b669-42b6-b19b-12c2272d7569 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:01.291001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009114e7-b669-42b6-b19b-12c2272d7569 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:01.291476 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009114e7-b669-42b6-b19b-12c2272d7569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:01.300427 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:01.308777 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009114e7-b669-42b6-b19b-12c2272d7569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:01.310551 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009114e7-b669-42b6-b19b-12c2272d7569 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:01.328125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-009114e7-b669-42b6-b19b-12c2272d7569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:19:01.328125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:01.328125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:01.328125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:01.328125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:01.328125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:01.328125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:01.328125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:01.328125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:01.328125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:01.328125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:01.328125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:01.328125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:19:01.328125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:19:01.328125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:19:01.328125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:19:01.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:01.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:01.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:01.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:01.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:01.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:01.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:01.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:01.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:01.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:01.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:01.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:01.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:01.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:01.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:01.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:01.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:19:01.332585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:19:01.332585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:19:01.332585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:19:01.333917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 543/1068] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:19:01.340102 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c3255-d483-4a65-bf93-63ea850ecdb2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:01.398816 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b1406-3f02-4e05-8b67-ef2c155b41f7 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:01.399337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b1406-3f02-4e05-8b67-ef2c155b41f7 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:01.399809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b1406-3f02-4e05-8b67-ef2c155b41f7 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:01.402712 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 544/1069] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:19:01.411546 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4644d4-789b-4000-9772-1f42de7fc958 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:01.412029 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4644d4-789b-4000-9772-1f42de7fc958 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:01.412430 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4644d4-789b-4000-9772-1f42de7fc958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:01.441347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-8a4644d4-789b-4000-9772-1f42de7fc958 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:01.443137 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8a4644d4-789b-4000-9772-1f42de7fc958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:01.463183 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:01.540678 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c3255-d483-4a65-bf93-63ea850ecdb2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:01.561087 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 545/1070] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:19:01.590879 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781b160-57fc-483e-ad06-d86a6585eb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:01.591759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781b160-57fc-483e-ad06-d86a6585eb47 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:01.592206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781b160-57fc-483e-ad06-d86a6585eb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:01.592650 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781b160-57fc-483e-ad06-d86a6585eb47 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:01.593580 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781b160-57fc-483e-ad06-d86a6585eb47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:01.594084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781b160-57fc-483e-ad06-d86a6585eb47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:01.595715 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781b160-57fc-483e-ad06-d86a6585eb47 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:01.613914 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 526/1071] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:01.616879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4644d4-789b-4000-9772-1f42de7fc958 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:01.740906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4644d4-789b-4000-9772-1f42de7fc958 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:01.763466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:01.785509 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56245c-2739-416f-83cb-740504f9b04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:01.786135 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56245c-2739-416f-83cb-740504f9b04a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:01.786415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56245c-2739-416f-83cb-740504f9b04a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:01.786835 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56245c-2739-416f-83cb-740504f9b04a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:01.796077 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56245c-2739-416f-83cb-740504f9b04a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:01.797605 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56245c-2739-416f-83cb-740504f9b04a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:01.810941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-5d56245c-2739-416f-83cb-740504f9b04a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:19:01.810941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:01.810941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:01.810941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:01.810941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:01.810941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:01.810941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:01.810941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:01.810941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:01.810941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:01.810941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:01.810941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:01.810941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:19:01.810941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:19:01.810941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:19:01.812180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:19:01.812180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:01.812180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:01.812180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:01.812180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:01.812180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:01.812180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:01.812180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:01.812180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:01.812180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:01.812180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:01.812180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:01.812180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:01.812180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:01.812180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:01.812180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:01.812180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:01.813631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:19:01.813631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:19:01.813631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:19:01.813631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:19:01.813631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:19:01.813631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:19:01.813631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:19:01.813631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:19:01.817429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 546/1072] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:19:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:19:01.818391 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781b160-57fc-483e-ad06-d86a6585eb47 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:01.880509 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56245c-2739-416f-83cb-740504f9b04a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:01.964214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781b160-57fc-483e-ad06-d86a6585eb47 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:01.994948 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:02.028797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95fe36-e66d-4266-95a0-892872762661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:02.029711 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95fe36-e66d-4266-95a0-892872762661 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:02.030105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95fe36-e66d-4266-95a0-892872762661 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:02.030477 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95fe36-e66d-4266-95a0-892872762661 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:02.031288 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95fe36-e66d-4266-95a0-892872762661 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:02.031701 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95fe36-e66d-4266-95a0-892872762661 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:02.033500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95fe36-e66d-4266-95a0-892872762661 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:02.054006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 527/1073] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:19:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:02.054195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56245c-2739-416f-83cb-740504f9b04a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:02.056008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95fe36-e66d-4266-95a0-892872762661 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:02.102351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d27b4c-edf4-495a-b5c4-6224fdf4464a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:02.103204 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d27b4c-edf4-495a-b5c4-6224fdf4464a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:02.103584 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d27b4c-edf4-495a-b5c4-6224fdf4464a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:02.104066 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d27b4c-edf4-495a-b5c4-6224fdf4464a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:02.116749 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d27b4c-edf4-495a-b5c4-6224fdf4464a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:19:02.122038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-39d27b4c-edf4-495a-b5c4-6224fdf4464a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:19:02.122038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:02.122038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:02.122038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:02.122038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:02.122038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:02.122038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:02.122038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:02.122038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:02.122038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:02.122038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:02.122038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:02.122038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:19:02.122038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:19:02.122038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:19:02.122038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:19:02.124037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:19:02.124037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:19:02.124037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:19:02.124037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:19:02.124037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:02.124037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:02.124037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:02.124037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:02.124037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:02.124037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:02.124037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:02.124037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:02.124037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:02.124037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:02.124037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:02.124037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:02.125932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:02.125932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:02.125932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:02.125932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:02.125932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:19:02.125932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:19:02.125932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:19:02.125932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:19:02.125932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:19:02.125932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:19:02.125932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:19:02.125932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:19:02.125932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 547/1074] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:19:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:19:02.130444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d27b4c-edf4-495a-b5c4-6224fdf4464a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:02.184071 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:02.214567 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95fe36-e66d-4266-95a0-892872762661 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:02.282429 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84c758-623d-40d5-b9d8-34c45cc2ff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:02.283624 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84c758-623d-40d5-b9d8-34c45cc2ff3f None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:02.284115 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84c758-623d-40d5-b9d8-34c45cc2ff3f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:02.284603 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84c758-623d-40d5-b9d8-34c45cc2ff3f None admin] PATH_INFO: `/v3/projects/03ca2c70c46a477494884c9997540861/users/9c95d16fd4da4fa7987b893eae0b3ef5/roles/5a2fa8fc43094a0f9bed98b6e5c4504a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:02.288540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84c758-623d-40d5-b9d8-34c45cc2ff3f None admin] RBAC: Authorizing `identity:create_grant(project_id=03ca2c70c46a477494884c9997540861, user_id=9c95d16fd4da4fa7987b893eae0b3ef5, role_id=5a2fa8fc43094a0f9bed98b6e5c4504a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:02.291449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84c758-623d-40d5-b9d8-34c45cc2ff3f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:02.292045 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d27b4c-edf4-495a-b5c4-6224fdf4464a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:02.313793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 528/1075] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:19:02 2022] PUT /identity/v3/projects/03ca2c70c46a477494884c9997540861/users/9c95d16fd4da4fa7987b893eae0b3ef5/roles/5a2fa8fc43094a0f9bed98b6e5c4504a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:19:02.359253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e5db4-ecda-4d78-81a8-ec0f469a86b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:02.359963 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e5db4-ecda-4d78-81a8-ec0f469a86b4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:02.360240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e5db4-ecda-4d78-81a8-ec0f469a86b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:02.360501 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e5db4-ecda-4d78-81a8-ec0f469a86b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:02.361515 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e5db4-ecda-4d78-81a8-ec0f469a86b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:02.361644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e5db4-ecda-4d78-81a8-ec0f469a86b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:02.363715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e5db4-ecda-4d78-81a8-ec0f469a86b4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:02.377399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 548/1076] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:19:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:19:02.383951 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84c758-623d-40d5-b9d8-34c45cc2ff3f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:02.442468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:02.549947 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84c758-623d-40d5-b9d8-34c45cc2ff3f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:02.597417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccbd78-c5e1-422d-b829-41054a797935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:02.597998 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccbd78-c5e1-422d-b829-41054a797935 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:02.598274 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccbd78-c5e1-422d-b829-41054a797935 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:02.598542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccbd78-c5e1-422d-b829-41054a797935 None admin] PATH_INFO: `/v3/users/2b4f04d746784c7aba907e6c142f29ce` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:02.599816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccbd78-c5e1-422d-b829-41054a797935 None admin] RBAC: Authorizing `identity:get_user(user_id=2b4f04d746784c7aba907e6c142f29ce)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:02.601338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccbd78-c5e1-422d-b829-41054a797935 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:02.603304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 529/1077] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:19:02 2022] GET /identity/v3/users/2b4f04d746784c7aba907e6c142f29ce => generated 285 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:02.609423 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e5db4-ecda-4d78-81a8-ec0f469a86b4 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:02.766691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e5db4-ecda-4d78-81a8-ec0f469a86b4 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:02.770254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:02.831183 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cc6f1-6f57-4c3d-8dad-d4f646bbfa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:02.832307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cc6f1-6f57-4c3d-8dad-d4f646bbfa24 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:02.832788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cc6f1-6f57-4c3d-8dad-d4f646bbfa24 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:02.833221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cc6f1-6f57-4c3d-8dad-d4f646bbfa24 None admin] PATH_INFO: `/v3/projects/c5c8b30d8bf149a899729983c2b8cc27` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:02.834922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cc6f1-6f57-4c3d-8dad-d4f646bbfa24 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c8b30d8bf149a899729983c2b8cc27)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:02.836460 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cc6f1-6f57-4c3d-8dad-d4f646bbfa24 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:02.838614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 549/1078] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:19:02 2022] GET /identity/v3/projects/c5c8b30d8bf149a899729983c2b8cc27 => generated 311 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:02.845282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccbd78-c5e1-422d-b829-41054a797935 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:02.855774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec9f50-459f-40b4-9f7a-ea2dfd7225d4 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:02.856217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec9f50-459f-40b4-9f7a-ea2dfd7225d4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:02.856646 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec9f50-459f-40b4-9f7a-ea2dfd7225d4 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:02.859393 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 550/1079] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:02.870263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87cfc7-aa29-46ac-9534-8b95ee45fb56 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:02.870659 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87cfc7-aa29-46ac-9534-8b95ee45fb56 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:02.870851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87cfc7-aa29-46ac-9534-8b95ee45fb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:02.891885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6b87cfc7-aa29-46ac-9534-8b95ee45fb56 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:02.893271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6b87cfc7-aa29-46ac-9534-8b95ee45fb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:03.022373 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 551/1080] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:19:03.036856 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccbd78-c5e1-422d-b829-41054a797935 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:03.044026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:03.119355 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f9a33-af8a-48ca-b03a-c4695bd267c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:03.120782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f9a33-af8a-48ca-b03a-c4695bd267c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:03.121278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f9a33-af8a-48ca-b03a-c4695bd267c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:03.123400 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f9a33-af8a-48ca-b03a-c4695bd267c3 None admin] PATH_INFO: `/v3/projects/c5c8b30d8bf149a899729983c2b8cc27/users/2b4f04d746784c7aba907e6c142f29ce/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:03.128078 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f9a33-af8a-48ca-b03a-c4695bd267c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c8b30d8bf149a899729983c2b8cc27, user_id=2b4f04d746784c7aba907e6c142f29ce, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:03.130487 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f9a33-af8a-48ca-b03a-c4695bd267c3 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:03.147365 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 530/1081] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:19:02 2022] PUT /identity/v3/projects/c5c8b30d8bf149a899729983c2b8cc27/users/2b4f04d746784c7aba907e6c142f29ce/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:19:03.338887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87cfc7-aa29-46ac-9534-8b95ee45fb56 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:03.469613 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:03.474477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87cfc7-aa29-46ac-9534-8b95ee45fb56 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:03.523715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64f66e-b27b-446a-beff-12968035d4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:03.524468 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64f66e-b27b-446a-beff-12968035d4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:03.525403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64f66e-b27b-446a-beff-12968035d4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:03.525793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64f66e-b27b-446a-beff-12968035d4b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:03.630965 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64f66e-b27b-446a-beff-12968035d4b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:03.632425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64f66e-b27b-446a-beff-12968035d4b8 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:03.822919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:03.833405 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 552/1082] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:19:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:19:03.836232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f9a33-af8a-48ca-b03a-c4695bd267c3 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:03.989780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f9a33-af8a-48ca-b03a-c4695bd267c3 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:04.048240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146e281-86ca-45d7-9a98-123ed927d4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:04.049515 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e281-86ca-45d7-9a98-123ed927d4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:04.049891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e281-86ca-45d7-9a98-123ed927d4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:04.050324 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e281-86ca-45d7-9a98-123ed927d4c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:04.079500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146e281-86ca-45d7-9a98-123ed927d4c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:04.082673 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146e281-86ca-45d7-9a98-123ed927d4c0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:04.115815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-e146e281-86ca-45d7-9a98-123ed927d4c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:19:04.115815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:04.115815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:04.115815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:04.115815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:04.115815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:04.115815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:04.115815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:04.115815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:04.115815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:04.115815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:04.115815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:04.115815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:19:04.115815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:19:04.115815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:19:04.115815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:19:04.117087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:04.117087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:04.117087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:04.117087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:04.117087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:04.117087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:04.117087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:04.117087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:04.117087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:04.117087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:04.117087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:04.117087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:04.117087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:04.117087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:04.117087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:04.117087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:04.117087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:19:04.124124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:19:04.124124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:19:04.124124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:19:04.124124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 531/1083] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:19:04.128451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64f66e-b27b-446a-beff-12968035d4b8 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:04.271387 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64f66e-b27b-446a-beff-12968035d4b8 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:04.309857 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423314d8-f5c1-4c6b-ba48-b64021a0af6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:04.310496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423314d8-f5c1-4c6b-ba48-b64021a0af6e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:04.310779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423314d8-f5c1-4c6b-ba48-b64021a0af6e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:04.311043 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423314d8-f5c1-4c6b-ba48-b64021a0af6e None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:04.311771 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423314d8-f5c1-4c6b-ba48-b64021a0af6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:04.311999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423314d8-f5c1-4c6b-ba48-b64021a0af6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:04.313400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423314d8-f5c1-4c6b-ba48-b64021a0af6e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:04.329273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 553/1084] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:04.682339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2ac96-2b0f-4320-98a7-76adcf3c4c16 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:04.682528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2ac96-2b0f-4320-98a7-76adcf3c4c16 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:04.682794 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2ac96-2b0f-4320-98a7-76adcf3c4c16 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:04.684209 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 532/1085] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:04.690183 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111b8f8-cce0-4468-a856-59b1845424d2 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:04.690709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111b8f8-cce0-4468-a856-59b1845424d2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:04.690709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111b8f8-cce0-4468-a856-59b1845424d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:04.710741 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2111b8f8-cce0-4468-a856-59b1845424d2 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:04.711939 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2111b8f8-cce0-4468-a856-59b1845424d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:04.779082 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:04.798912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 554/1086] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:19:05.080304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2ac96-2b0f-4320-98a7-76adcf3c4c16 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:05.105641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:05.235867 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2ac96-2b0f-4320-98a7-76adcf3c4c16 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:05.286203 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6bdc4-add8-490d-a361-a861a00bd2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:05.287062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6bdc4-add8-490d-a361-a861a00bd2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:05.287341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6bdc4-add8-490d-a361-a861a00bd2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:05.287618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6bdc4-add8-490d-a361-a861a00bd2f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:05.304794 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6bdc4-add8-490d-a361-a861a00bd2f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:19:05.312905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-26b6bdc4-add8-490d-a361-a861a00bd2f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:19:05.312905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:05.312905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:05.312905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:05.312905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:05.312905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:05.312905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:05.312905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:05.312905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:05.312905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:05.312905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:05.312905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:05.312905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:19:05.312905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:19:05.312905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:19:05.312905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:19:05.314066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:19:05.314066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:19:05.314066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:19:05.314066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:19:05.314066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:05.314066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:05.314066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:05.314066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:05.314066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:05.314066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:05.314066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:05.314066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:05.314066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:05.314066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:05.314066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:05.314066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:05.315147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:05.315147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:05.315147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:05.315147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:05.315147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:19:05.315147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:19:05.315147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:19:05.315147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:19:05.315147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:19:05.315147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:19:05.315147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:19:05.315147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:19:05.315147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 533/1087] 10.222.0.52 () {56 vars in 1120 bytes} [Mon Aug 29 20:19:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:19:05.323468 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111b8f8-cce0-4468-a856-59b1845424d2 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:05.420888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd6639-a412-4278-b765-2b5064fab4ce None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:05.421328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd6639-a412-4278-b765-2b5064fab4ce None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:05.421727 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd6639-a412-4278-b765-2b5064fab4ce None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:05.423596 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 534/1088] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:19:05.430519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b610e1-ceff-4e80-9102-212ea3eeb573 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:05.430802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b610e1-ceff-4e80-9102-212ea3eeb573 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:05.431077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b610e1-ceff-4e80-9102-212ea3eeb573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:05.452285 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111b8f8-cce0-4468-a856-59b1845424d2 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:05.454924 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-77b610e1-ceff-4e80-9102-212ea3eeb573 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:05.456892 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-77b610e1-ceff-4e80-9102-212ea3eeb573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:05.507002 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe737d4-bdcf-4c4c-8778-72bccf1580ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:05.508027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe737d4-bdcf-4c4c-8778-72bccf1580ce None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:05.508515 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe737d4-bdcf-4c4c-8778-72bccf1580ce None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:05.508973 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe737d4-bdcf-4c4c-8778-72bccf1580ce None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:05.510269 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe737d4-bdcf-4c4c-8778-72bccf1580ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:05.510793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe737d4-bdcf-4c4c-8778-72bccf1580ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:05.513312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe737d4-bdcf-4c4c-8778-72bccf1580ce None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:05.523981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 555/1089] 10.222.0.52 () {56 vars in 1115 bytes} [Mon Aug 29 20:19:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:05.531850 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe737d4-bdcf-4c4c-8778-72bccf1580ce None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:05.565420 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 535/1090] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:19:05.603546 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:05.669800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe737d4-bdcf-4c4c-8778-72bccf1580ce None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:05.726145 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7fee4-c01b-4c65-af62-d7416ffe2e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:05.726928 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7fee4-c01b-4c65-af62-d7416ffe2e6a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:05.727257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7fee4-c01b-4c65-af62-d7416ffe2e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:05.727650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7fee4-c01b-4c65-af62-d7416ffe2e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:05.741457 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7fee4-c01b-4c65-af62-d7416ffe2e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:05.743121 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7fee4-c01b-4c65-af62-d7416ffe2e6a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:05.762139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-01b7fee4-c01b-4c65-af62-d7416ffe2e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:19:05.762139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:05.762139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:05.762139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:05.762139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:05.762139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:05.762139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:05.762139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:05.762139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:05.762139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:05.762139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:05.762139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:05.762139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:19:05.762139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:19:05.762139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:19:05.762139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:19:05.763207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:05.763207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:05.763207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:05.763207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:05.763207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:05.763207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:05.763207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:05.763207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:05.763207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:05.763207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:05.763207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:05.763207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:05.763207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:05.763207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:05.763207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:05.763207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:05.763207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:19:05.764451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:19:05.764451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:19:05.764451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:19:05.765894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 556/1091] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:19:05.770278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b610e1-ceff-4e80-9102-212ea3eeb573 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:05.781188 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:05.875952 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7fee4-c01b-4c65-af62-d7416ffe2e6a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:05.892304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b610e1-ceff-4e80-9102-212ea3eeb573 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:05.940087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ae1ba-61c4-4ca3-98e5-3243a08bb159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:05.940951 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ae1ba-61c4-4ca3-98e5-3243a08bb159 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:05.941490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ae1ba-61c4-4ca3-98e5-3243a08bb159 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:05.941964 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ae1ba-61c4-4ca3-98e5-3243a08bb159 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:05.943094 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ae1ba-61c4-4ca3-98e5-3243a08bb159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:05.943375 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ae1ba-61c4-4ca3-98e5-3243a08bb159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:05.945492 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ae1ba-61c4-4ca3-98e5-3243a08bb159 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:05.968633 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 536/1092] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:05.970157 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ae1ba-61c4-4ca3-98e5-3243a08bb159 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:06.006087 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7fee4-c01b-4c65-af62-d7416ffe2e6a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:06.008604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:06.044774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3a1a1-3198-4b06-91cd-1e6b4b91379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:06.045439 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3a1a1-3198-4b06-91cd-1e6b4b91379e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:06.045721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3a1a1-3198-4b06-91cd-1e6b4b91379e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:06.045979 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3a1a1-3198-4b06-91cd-1e6b4b91379e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:06.058273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3a1a1-3198-4b06-91cd-1e6b4b91379e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:19:06.062073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:06.063242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-11b3a1a1-3198-4b06-91cd-1e6b4b91379e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:19:06.063242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:06.063242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:06.063242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:06.063242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:06.063242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:06.063242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:06.063242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:06.063242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:06.063242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:06.063242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:06.063242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:06.063242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:19:06.063242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:19:06.063242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:19:06.063242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:19:06.064767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:19:06.064767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:19:06.064767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:19:06.064767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:19:06.064767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:06.064767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:06.064767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:06.064767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:06.064767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:06.064767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:06.064767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:06.064767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:06.064767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:06.064767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:06.064767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:06.064767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:06.065833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:06.065833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:06.065833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:06.065833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:06.065833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:19:06.065833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:19:06.065833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:19:06.065833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:19:06.065833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:19:06.065833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:19:06.065833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:19:06.065833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:19:06.065833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 557/1093] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:19:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:19:06.074255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3a1a1-3198-4b06-91cd-1e6b4b91379e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:06.117990 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ae1ba-61c4-4ca3-98e5-3243a08bb159 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:06.161430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d22c4f-5875-462e-97e1-e053ac253325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:06.162190 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d22c4f-5875-462e-97e1-e053ac253325 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:06.162467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d22c4f-5875-462e-97e1-e053ac253325 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:06.162740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d22c4f-5875-462e-97e1-e053ac253325 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:06.174255 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d22c4f-5875-462e-97e1-e053ac253325 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:06.176032 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d22c4f-5875-462e-97e1-e053ac253325 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:06.190385 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3a1a1-3198-4b06-91cd-1e6b4b91379e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:06.192763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-b1d22c4f-5875-462e-97e1-e053ac253325 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:19:06.192763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:06.192763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:06.192763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:06.192763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:06.192763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:06.192763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:06.192763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:06.192763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:06.192763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:06.192763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:06.192763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:06.192763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:19:06.192763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:19:06.192763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:19:06.192763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:06.194015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:06.195043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:06.195043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:06.195043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:19:06.195043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:19:06.195043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:19:06.195043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:19:06.195043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:19:06.195043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:19:06.195043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:19:06.195043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:19:06.195043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 537/1094] 10.222.0.52 () {56 vars in 1093 bytes} [Mon Aug 29 20:19:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:19:06.199947 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d22c4f-5875-462e-97e1-e053ac253325 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:06.238401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5aab9-9061-4a06-9eb2-648e5fb6ef02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:06.239017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5aab9-9061-4a06-9eb2-648e5fb6ef02 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:06.239295 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5aab9-9061-4a06-9eb2-648e5fb6ef02 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:06.239560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5aab9-9061-4a06-9eb2-648e5fb6ef02 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:06.240265 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5aab9-9061-4a06-9eb2-648e5fb6ef02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:06.240585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5aab9-9061-4a06-9eb2-648e5fb6ef02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:06.241999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5aab9-9061-4a06-9eb2-648e5fb6ef02 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:06.258784 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 558/1095] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:19:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:19:06.268928 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5aab9-9061-4a06-9eb2-648e5fb6ef02 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:06.300105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:06.359537 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d22c4f-5875-462e-97e1-e053ac253325 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:06.392603 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:06.397697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5aab9-9061-4a06-9eb2-648e5fb6ef02 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:06.402597 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83a161-25d5-472b-b33a-a6888492c1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:06.403204 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83a161-25d5-472b-b33a-a6888492c1aa None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:06.403479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83a161-25d5-472b-b33a-a6888492c1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:06.403750 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83a161-25d5-472b-b33a-a6888492c1aa None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:06.404482 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83a161-25d5-472b-b33a-a6888492c1aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:06.404778 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83a161-25d5-472b-b33a-a6888492c1aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:06.406256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83a161-25d5-472b-b33a-a6888492c1aa None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:06.425202 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 538/1096] 10.222.0.52 () {56 vars in 1133 bytes} [Mon Aug 29 20:19:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:06.431138 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83a161-25d5-472b-b33a-a6888492c1aa None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:06.438793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127a0ca-e676-4583-9f0f-ba848bb42763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:06.439435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127a0ca-e676-4583-9f0f-ba848bb42763 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:06.439784 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127a0ca-e676-4583-9f0f-ba848bb42763 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:06.440536 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127a0ca-e676-4583-9f0f-ba848bb42763 None admin] PATH_INFO: `/v3/users/2b4f04d746784c7aba907e6c142f29ce` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:06.441575 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127a0ca-e676-4583-9f0f-ba848bb42763 None admin] RBAC: Authorizing `identity:get_user(user_id=2b4f04d746784c7aba907e6c142f29ce)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:06.443072 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127a0ca-e676-4583-9f0f-ba848bb42763 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:06.444732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 559/1097] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:19:06 2022] GET /identity/v3/users/2b4f04d746784c7aba907e6c142f29ce => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:06.451516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127a0ca-e676-4583-9f0f-ba848bb42763 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:06.552293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83a161-25d5-472b-b33a-a6888492c1aa None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:06.572499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:06.585748 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127a0ca-e676-4583-9f0f-ba848bb42763 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:06.596013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0f890-9de1-46a5-83fe-79a6300f0ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:06.596781 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0f890-9de1-46a5-83fe-79a6300f0ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:06.597059 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0f890-9de1-46a5-83fe-79a6300f0ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:06.597329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0f890-9de1-46a5-83fe-79a6300f0ff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:06.642979 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25971d1-5f33-4866-9e79-850258f47dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:06.643770 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25971d1-5f33-4866-9e79-850258f47dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:06.644215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25971d1-5f33-4866-9e79-850258f47dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:06.644579 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25971d1-5f33-4866-9e79-850258f47dd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:06.665890 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:06.688643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0f890-9de1-46a5-83fe-79a6300f0ff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:06.690160 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0f890-9de1-46a5-83fe-79a6300f0ff3 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:06.731037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25971d1-5f33-4866-9e79-850258f47dd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:06.732673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25971d1-5f33-4866-9e79-850258f47dd2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:06.802063 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 539/1098] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:19:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 20:19:06.808389 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0f890-9de1-46a5-83fe-79a6300f0ff3 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:06.842086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:06.850277 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 560/1099] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:19:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:19:06.857621 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25971d1-5f33-4866-9e79-850258f47dd2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:06.914558 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:06.934182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0f890-9de1-46a5-83fe-79a6300f0ff3 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:06.973548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12408c9-e6fc-452f-9cc4-76b9aa66bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:06.974188 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12408c9-e6fc-452f-9cc4-76b9aa66bf3e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:06.974460 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12408c9-e6fc-452f-9cc4-76b9aa66bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:06.974722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12408c9-e6fc-452f-9cc4-76b9aa66bf3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:06.979185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25971d1-5f33-4866-9e79-850258f47dd2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:06.987197 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12408c9-e6fc-452f-9cc4-76b9aa66bf3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:06.988673 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12408c9-e6fc-452f-9cc4-76b9aa66bf3e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:07.006498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-d12408c9-e6fc-452f-9cc4-76b9aa66bf3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:19:07.006498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:07.006498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:07.006498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:07.006498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:07.006498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:07.006498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:07.006498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:07.006498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:07.006498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:07.006498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:07.006498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:07.006498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:19:07.006498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:19:07.006498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:19:07.006498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:19:07.007577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:07.007577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:07.007577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:07.007577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:07.007577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:07.007577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:07.007577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:07.007577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:07.007577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:07.007577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:07.007577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:07.007577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:07.007577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:07.007577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:07.007577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:07.007577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:07.007577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:19:07.008484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:19:07.008484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:19:07.008484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:19:07.008484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 540/1100] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:19:07.013321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12408c9-e6fc-452f-9cc4-76b9aa66bf3e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:07.039128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7585758-6641-4e24-94c4-591c2e1bb3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:07.039773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7585758-6641-4e24-94c4-591c2e1bb3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:07.040053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7585758-6641-4e24-94c4-591c2e1bb3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:07.040321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7585758-6641-4e24-94c4-591c2e1bb3e7 None admin] PATH_INFO: `/v3/projects/c5c8b30d8bf149a899729983c2b8cc27` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:07.041605 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7585758-6641-4e24-94c4-591c2e1bb3e7 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c8b30d8bf149a899729983c2b8cc27)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:07.043144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7585758-6641-4e24-94c4-591c2e1bb3e7 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:07.045055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 561/1101] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:19:06 2022] GET /identity/v3/projects/c5c8b30d8bf149a899729983c2b8cc27 => generated 311 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:19:07.052144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7585758-6641-4e24-94c4-591c2e1bb3e7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:07.124312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:07.148727 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12408c9-e6fc-452f-9cc4-76b9aa66bf3e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:07.179813 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7585758-6641-4e24-94c4-591c2e1bb3e7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:07.194346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba577ab-4a4a-43a0-b0e2-d3ef0a9d6808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:07.195007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba577ab-4a4a-43a0-b0e2-d3ef0a9d6808 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:07.195290 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba577ab-4a4a-43a0-b0e2-d3ef0a9d6808 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:07.195565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba577ab-4a4a-43a0-b0e2-d3ef0a9d6808 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:07.196322 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba577ab-4a4a-43a0-b0e2-d3ef0a9d6808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:07.196844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba577ab-4a4a-43a0-b0e2-d3ef0a9d6808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:07.198821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba577ab-4a4a-43a0-b0e2-d3ef0a9d6808 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:07.201535 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:07.215198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 541/1102] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:19:07.217947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f012611-6b03-4c1f-b3c0-354d80691558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:07.218556 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f012611-6b03-4c1f-b3c0-354d80691558 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:07.218829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f012611-6b03-4c1f-b3c0-354d80691558 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:07.219093 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f012611-6b03-4c1f-b3c0-354d80691558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:07.219824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f012611-6b03-4c1f-b3c0-354d80691558 None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=c5c8b30d8bf149a899729983c2b8cc27, user.id=2b4f04d746784c7aba907e6c142f29ce) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:07.220119 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f012611-6b03-4c1f-b3c0-354d80691558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:07.222988 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba577ab-4a4a-43a0-b0e2-d3ef0a9d6808 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:07.223325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f012611-6b03-4c1f-b3c0-354d80691558 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:07.231796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 562/1103] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:19:07 2022] GET /identity/v3/role_assignments?user.id=2b4f04d746784c7aba907e6c142f29ce&scope.project.id=c5c8b30d8bf149a899729983c2b8cc27&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:07.362471 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba577ab-4a4a-43a0-b0e2-d3ef0a9d6808 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:07.405474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2026ff8-efed-4f8a-8a5f-e39b41670d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:07.406595 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2026ff8-efed-4f8a-8a5f-e39b41670d0d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:07.407124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2026ff8-efed-4f8a-8a5f-e39b41670d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:07.407630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2026ff8-efed-4f8a-8a5f-e39b41670d0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:07.419855 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2026ff8-efed-4f8a-8a5f-e39b41670d0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:07.422451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2026ff8-efed-4f8a-8a5f-e39b41670d0d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:07.438198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-b2026ff8-efed-4f8a-8a5f-e39b41670d0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:19:07.438198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:07.438198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:07.438198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:07.438198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:07.438198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:07.438198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:07.438198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:07.438198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:07.438198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:07.438198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:07.438198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:07.438198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:19:07.438198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:19:07.438198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:19:07.439792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:19:07.439792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:07.439792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:07.439792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:07.439792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:07.439792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:07.439792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:07.439792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:07.439792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:07.439792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:07.439792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:07.439792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:07.439792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:07.439792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:07.439792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:07.439792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:07.439792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:07.441432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:19:07.441432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:19:07.441432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:19:07.441432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:19:07.441432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:19:07.441432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:19:07.441432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:19:07.441432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:19:07.441432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 542/1104] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:19:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:19:07.454558 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f012611-6b03-4c1f-b3c0-354d80691558 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:07.619130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f012611-6b03-4c1f-b3c0-354d80691558 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:07.654411 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:07.667035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff7c89-a8b2-46dd-9971-8ac39147a55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:07.668610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff7c89-a8b2-46dd-9971-8ac39147a55d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:07.668898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff7c89-a8b2-46dd-9971-8ac39147a55d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:07.669160 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff7c89-a8b2-46dd-9971-8ac39147a55d None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:07.669910 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff7c89-a8b2-46dd-9971-8ac39147a55d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:07.670221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff7c89-a8b2-46dd-9971-8ac39147a55d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:07.671750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff7c89-a8b2-46dd-9971-8ac39147a55d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:07.690481 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 563/1105] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:19:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:07.698320 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2026ff8-efed-4f8a-8a5f-e39b41670d0d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:07.777916 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:07.836462 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2026ff8-efed-4f8a-8a5f-e39b41670d0d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:07.880720 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdfaca-38e8-487f-ac4a-16d460d4f0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:07.881308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdfaca-38e8-487f-ac4a-16d460d4f0dc None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:07.881636 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdfaca-38e8-487f-ac4a-16d460d4f0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:07.881981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdfaca-38e8-487f-ac4a-16d460d4f0dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:07.883301 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdfaca-38e8-487f-ac4a-16d460d4f0dc None admin] RBAC: Adding query filter params (role.id=5a2fa8fc43094a0f9bed98b6e5c4504a, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=9c95d16fd4da4fa7987b893eae0b3ef5) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:07.883695 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdfaca-38e8-487f-ac4a-16d460d4f0dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:07.885452 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdfaca-38e8-487f-ac4a-16d460d4f0dc None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:07.894992 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 543/1106] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:19:07 2022] GET /identity/v3/role_assignments?user.id=9c95d16fd4da4fa7987b893eae0b3ef5&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=5a2fa8fc43094a0f9bed98b6e5c4504a => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:19:09.329618 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afdcb9-1117-4af6-9838-0a52d8dc111f None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:09.330566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afdcb9-1117-4af6-9838-0a52d8dc111f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:09.330566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afdcb9-1117-4af6-9838-0a52d8dc111f None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:09.332634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 564/1107] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:09.339443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b93e1-d598-48ce-a5ba-3aa7c22aab65 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:09.339899 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b93e1-d598-48ce-a5ba-3aa7c22aab65 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:09.340011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b93e1-d598-48ce-a5ba-3aa7c22aab65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:09.367876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e93b93e1-d598-48ce-a5ba-3aa7c22aab65 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:09.369614 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e93b93e1-d598-48ce-a5ba-3aa7c22aab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:09.454451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 544/1108] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:19:09.726257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afdcb9-1117-4af6-9838-0a52d8dc111f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:09.839441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afdcb9-1117-4af6-9838-0a52d8dc111f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:09.875472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c5879-31f1-4eec-90f1-91952c56440b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:09.876101 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c5879-31f1-4eec-90f1-91952c56440b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:09.876367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c5879-31f1-4eec-90f1-91952c56440b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:09.876634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c5879-31f1-4eec-90f1-91952c56440b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:09.877771 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c5879-31f1-4eec-90f1-91952c56440b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:09.879276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c5879-31f1-4eec-90f1-91952c56440b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:09.880908 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 565/1109] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:19:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:09.887191 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b93e1-d598-48ce-a5ba-3aa7c22aab65 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:09.940280 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:09.994418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b93e1-d598-48ce-a5ba-3aa7c22aab65 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:10.032920 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272e346-652f-4091-b37f-d738f5af01e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:10.033616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272e346-652f-4091-b37f-d738f5af01e9 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:10.034370 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272e346-652f-4091-b37f-d738f5af01e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:10.034645 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272e346-652f-4091-b37f-d738f5af01e9 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:10.035312 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272e346-652f-4091-b37f-d738f5af01e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:10.036765 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272e346-652f-4091-b37f-d738f5af01e9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:10.061590 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 545/1110] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:19:09 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:19:12.033490 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df49c39-8712-43f5-967b-8416ce5fe77b None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:12.034050 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df49c39-8712-43f5-967b-8416ce5fe77b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:12.034050 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df49c39-8712-43f5-967b-8416ce5fe77b None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:12.035321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 566/1111] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:12.041206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f230de-740e-46a8-806f-fd272c16269e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:12.041763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f230de-740e-46a8-806f-fd272c16269e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:12.041763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f230de-740e-46a8-806f-fd272c16269e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:12.061778 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b1f230de-740e-46a8-806f-fd272c16269e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:12.063010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b1f230de-740e-46a8-806f-fd272c16269e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:12.137815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 546/1112] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:19:12.408946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df49c39-8712-43f5-967b-8416ce5fe77b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:12.472880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:12.543714 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df49c39-8712-43f5-967b-8416ce5fe77b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:12.580881 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed422f4e-90c9-4ee7-9fc1-4a000e62ed22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:12.581550 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed422f4e-90c9-4ee7-9fc1-4a000e62ed22 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:12.581826 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed422f4e-90c9-4ee7-9fc1-4a000e62ed22 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:12.582099 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed422f4e-90c9-4ee7-9fc1-4a000e62ed22 None admin] PATH_INFO: `/v3/roles/2ae4df0c2db34d5092a5a05f3e512fdc` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:12.583515 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed422f4e-90c9-4ee7-9fc1-4a000e62ed22 None admin] RBAC: Authorizing `identity:get_role(role_id=2ae4df0c2db34d5092a5a05f3e512fdc)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:12.584905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed422f4e-90c9-4ee7-9fc1-4a000e62ed22 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:12.586316 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 567/1113] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:19:12 2022] GET /identity/v3/roles/2ae4df0c2db34d5092a5a05f3e512fdc => generated 223 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:12.592669 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f230de-740e-46a8-806f-fd272c16269e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:12.627173 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:12.701303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f230de-740e-46a8-806f-fd272c16269e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:12.739004 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4527c-5191-4703-8298-51e0b99ba072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:12.739630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4527c-5191-4703-8298-51e0b99ba072 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:12.739979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4527c-5191-4703-8298-51e0b99ba072 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:12.740329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4527c-5191-4703-8298-51e0b99ba072 None admin] PATH_INFO: `/v3/users/0afa1c1ec17241a0aefe1fb5ea3128e9` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:12.754912 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4527c-5191-4703-8298-51e0b99ba072 None admin] RBAC: Authorizing `identity:get_user(user_id=0afa1c1ec17241a0aefe1fb5ea3128e9)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:12.756363 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4527c-5191-4703-8298-51e0b99ba072 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:12.758057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 547/1114] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:19:12 2022] GET /identity/v3/users/0afa1c1ec17241a0aefe1fb5ea3128e9 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:12.764243 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed422f4e-90c9-4ee7-9fc1-4a000e62ed22 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:12.868375 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed422f4e-90c9-4ee7-9fc1-4a000e62ed22 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:12.891764 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:12.905945 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0391d13-ec0a-4a51-a651-ae2c273a2f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:12.906665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0391d13-ec0a-4a51-a651-ae2c273a2f5b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:12.906942 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0391d13-ec0a-4a51-a651-ae2c273a2f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:12.907220 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0391d13-ec0a-4a51-a651-ae2c273a2f5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:12.982587 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0391d13-ec0a-4a51-a651-ae2c273a2f5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:12.984138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0391d13-ec0a-4a51-a651-ae2c273a2f5b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:13.108737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 568/1115] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:19:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:19:13.115388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4527c-5191-4703-8298-51e0b99ba072 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:13.229450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:13.237297 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4527c-5191-4703-8298-51e0b99ba072 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:13.273747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3909aa7-bfb3-41a6-aadb-33a0977dc00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:13.274396 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3909aa7-bfb3-41a6-aadb-33a0977dc00a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:13.274677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3909aa7-bfb3-41a6-aadb-33a0977dc00a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:13.274987 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3909aa7-bfb3-41a6-aadb-33a0977dc00a None admin] PATH_INFO: `/v3/projects/c5c8b30d8bf149a899729983c2b8cc27` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:13.276236 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3909aa7-bfb3-41a6-aadb-33a0977dc00a None admin] RBAC: Authorizing `identity:get_project(project_id=c5c8b30d8bf149a899729983c2b8cc27)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:13.277844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3909aa7-bfb3-41a6-aadb-33a0977dc00a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:13.279573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 548/1116] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:19:13 2022] GET /identity/v3/projects/c5c8b30d8bf149a899729983c2b8cc27 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:13.286278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0391d13-ec0a-4a51-a651-ae2c273a2f5b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:13.312159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:13.402381 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0391d13-ec0a-4a51-a651-ae2c273a2f5b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:13.451373 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716e7c3-6096-49a9-9a44-e863393876f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:13.452069 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e7c3-6096-49a9-9a44-e863393876f4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:13.452491 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e7c3-6096-49a9-9a44-e863393876f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:13.452885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e7c3-6096-49a9-9a44-e863393876f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:13.453725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716e7c3-6096-49a9-9a44-e863393876f4 None admin] RBAC: Adding query filter params (role.id=2ae4df0c2db34d5092a5a05f3e512fdc, scope.project.id=c5c8b30d8bf149a899729983c2b8cc27, user.id=0afa1c1ec17241a0aefe1fb5ea3128e9) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:13.454036 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716e7c3-6096-49a9-9a44-e863393876f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:13.455462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716e7c3-6096-49a9-9a44-e863393876f4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:13.461809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 569/1117] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:19:13 2022] GET /identity/v3/role_assignments?user.id=0afa1c1ec17241a0aefe1fb5ea3128e9&scope.project.id=c5c8b30d8bf149a899729983c2b8cc27&role.id=2ae4df0c2db34d5092a5a05f3e512fdc => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:15.351711 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4d5f0-37e9-41f3-91e4-36ec6cc4499d None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:15.352192 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4d5f0-37e9-41f3-91e4-36ec6cc4499d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:15.352192 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4d5f0-37e9-41f3-91e4-36ec6cc4499d None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:15.353740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 549/1118] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:15.359750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2da013-9d6b-47a6-9c1c-3f230498d328 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:15.360271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2da013-9d6b-47a6-9c1c-3f230498d328 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:15.360271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2da013-9d6b-47a6-9c1c-3f230498d328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:15.379289 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7b2da013-9d6b-47a6-9c1c-3f230498d328 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:15.380480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7b2da013-9d6b-47a6-9c1c-3f230498d328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:15.466737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 570/1119] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:19:15.735687 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4d5f0-37e9-41f3-91e4-36ec6cc4499d None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:15.847023 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4d5f0-37e9-41f3-91e4-36ec6cc4499d None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:15.881052 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff48cc3-6f39-4158-9f5b-1638f91d683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:15.881710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff48cc3-6f39-4158-9f5b-1638f91d683b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:15.881985 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff48cc3-6f39-4158-9f5b-1638f91d683b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:15.882255 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff48cc3-6f39-4158-9f5b-1638f91d683b None admin] PATH_INFO: `/v3/roles/2ae4df0c2db34d5092a5a05f3e512fdc` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:15.883647 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff48cc3-6f39-4158-9f5b-1638f91d683b None admin] RBAC: Authorizing `identity:get_role(role_id=2ae4df0c2db34d5092a5a05f3e512fdc)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:15.885080 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff48cc3-6f39-4158-9f5b-1638f91d683b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:15.886436 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 550/1120] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:19:15 2022] GET /identity/v3/roles/2ae4df0c2db34d5092a5a05f3e512fdc => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:15.892724 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2da013-9d6b-47a6-9c1c-3f230498d328 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:15.911643 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:16.018241 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2da013-9d6b-47a6-9c1c-3f230498d328 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:16.056623 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd09f8a-cde4-4de5-9258-5ace5e20cf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:16.057263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd09f8a-cde4-4de5-9258-5ace5e20cf56 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:16.057576 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd09f8a-cde4-4de5-9258-5ace5e20cf56 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:16.057845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd09f8a-cde4-4de5-9258-5ace5e20cf56 None admin] PATH_INFO: `/v3/users/0afa1c1ec17241a0aefe1fb5ea3128e9` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:16.059066 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd09f8a-cde4-4de5-9258-5ace5e20cf56 None admin] RBAC: Authorizing `identity:get_user(user_id=0afa1c1ec17241a0aefe1fb5ea3128e9)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:16.060536 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd09f8a-cde4-4de5-9258-5ace5e20cf56 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:16.062245 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 571/1121] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:19:15 2022] GET /identity/v3/users/0afa1c1ec17241a0aefe1fb5ea3128e9 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:16.068537 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff48cc3-6f39-4158-9f5b-1638f91d683b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:16.103233 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:16.185970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff48cc3-6f39-4158-9f5b-1638f91d683b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:16.223325 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b13b6-ebbc-4566-a40b-fdcdea5129f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:16.223958 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b13b6-ebbc-4566-a40b-fdcdea5129f3 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:16.224233 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b13b6-ebbc-4566-a40b-fdcdea5129f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:16.224502 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b13b6-ebbc-4566-a40b-fdcdea5129f3 None admin] PATH_INFO: `/v3/projects/c5c8b30d8bf149a899729983c2b8cc27` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:16.225704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b13b6-ebbc-4566-a40b-fdcdea5129f3 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c8b30d8bf149a899729983c2b8cc27)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:16.227154 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b13b6-ebbc-4566-a40b-fdcdea5129f3 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:16.228895 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 551/1122] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:19:16 2022] GET /identity/v3/projects/c5c8b30d8bf149a899729983c2b8cc27 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:16.235048 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd09f8a-cde4-4de5-9258-5ace5e20cf56 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:16.325036 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:16.342355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd09f8a-cde4-4de5-9258-5ace5e20cf56 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:16.379560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8184a-d3c0-45b6-9a44-5487023c1ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:16.380261 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8184a-d3c0-45b6-9a44-5487023c1ffc None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:16.380475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8184a-d3c0-45b6-9a44-5487023c1ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:16.380738 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8184a-d3c0-45b6-9a44-5487023c1ffc None admin] PATH_INFO: `/v3/projects/c5c8b30d8bf149a899729983c2b8cc27/users/0afa1c1ec17241a0aefe1fb5ea3128e9/roles/2ae4df0c2db34d5092a5a05f3e512fdc` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:16.383168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8184a-d3c0-45b6-9a44-5487023c1ffc None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c8b30d8bf149a899729983c2b8cc27, user_id=0afa1c1ec17241a0aefe1fb5ea3128e9, role_id=2ae4df0c2db34d5092a5a05f3e512fdc)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:16.384656 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8184a-d3c0-45b6-9a44-5487023c1ffc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:16.398910 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 572/1123] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:19:16 2022] PUT /identity/v3/projects/c5c8b30d8bf149a899729983c2b8cc27/users/0afa1c1ec17241a0aefe1fb5ea3128e9/roles/2ae4df0c2db34d5092a5a05f3e512fdc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:19:18.312213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258d49-90b3-4d79-a976-84d310be943f None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:18.312775 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258d49-90b3-4d79-a976-84d310be943f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:18.312775 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258d49-90b3-4d79-a976-84d310be943f None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:18.314155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 552/1124] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:18.320012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945d18c-238c-41f6-b93d-f9a5657a51c9 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:18.320460 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945d18c-238c-41f6-b93d-f9a5657a51c9 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:18.320546 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945d18c-238c-41f6-b93d-f9a5657a51c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:18.341022 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-8945d18c-238c-41f6-b93d-f9a5657a51c9 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:18.342443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8945d18c-238c-41f6-b93d-f9a5657a51c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:18.419157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 573/1125] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:19:18.701490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71258d49-90b3-4d79-a976-84d310be943f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:18.831731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:18.837492 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71258d49-90b3-4d79-a976-84d310be943f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:18.887321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bfe73-d974-46f5-88a4-43ef12ff77b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:18.887963 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bfe73-d974-46f5-88a4-43ef12ff77b5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:18.888242 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bfe73-d974-46f5-88a4-43ef12ff77b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:18.888515 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bfe73-d974-46f5-88a4-43ef12ff77b5 None admin] PATH_INFO: `/v3/roles/2ae4df0c2db34d5092a5a05f3e512fdc` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:18.890005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bfe73-d974-46f5-88a4-43ef12ff77b5 None admin] RBAC: Authorizing `identity:get_role(role_id=2ae4df0c2db34d5092a5a05f3e512fdc)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:18.891393 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bfe73-d974-46f5-88a4-43ef12ff77b5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:18.892770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 553/1126] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:19:18 2022] GET /identity/v3/roles/2ae4df0c2db34d5092a5a05f3e512fdc => generated 223 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:18.898918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945d18c-238c-41f6-b93d-f9a5657a51c9 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:18.977022 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:19.004299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945d18c-238c-41f6-b93d-f9a5657a51c9 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:19.040552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356ba46-80cd-4f31-8743-e926dd18a159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:19.041203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356ba46-80cd-4f31-8743-e926dd18a159 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:19.041521 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356ba46-80cd-4f31-8743-e926dd18a159 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:19.041797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356ba46-80cd-4f31-8743-e926dd18a159 None admin] PATH_INFO: `/v3/users/0afa1c1ec17241a0aefe1fb5ea3128e9` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:19.042957 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356ba46-80cd-4f31-8743-e926dd18a159 None admin] RBAC: Authorizing `identity:get_user(user_id=0afa1c1ec17241a0aefe1fb5ea3128e9)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:19.044439 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356ba46-80cd-4f31-8743-e926dd18a159 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:19.046086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 574/1127] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:19:18 2022] GET /identity/v3/users/0afa1c1ec17241a0aefe1fb5ea3128e9 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:19.052343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bfe73-d974-46f5-88a4-43ef12ff77b5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:19.165020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bfe73-d974-46f5-88a4-43ef12ff77b5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:19.204294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0270c-2612-4332-a300-cb092d9e6c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:19.204916 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0270c-2612-4332-a300-cb092d9e6c77 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:19.205197 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0270c-2612-4332-a300-cb092d9e6c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:19.205511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0270c-2612-4332-a300-cb092d9e6c77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:19.241821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:19.280109 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0270c-2612-4332-a300-cb092d9e6c77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:19.281641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0270c-2612-4332-a300-cb092d9e6c77 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:19.392057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 554/1128] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:19:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:19:19.398235 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356ba46-80cd-4f31-8743-e926dd18a159 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:19.507366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356ba46-80cd-4f31-8743-e926dd18a159 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:19.542293 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fe13c-76c0-4900-a43a-1456120f08fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:19.542944 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fe13c-76c0-4900-a43a-1456120f08fe None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:19.543197 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fe13c-76c0-4900-a43a-1456120f08fe None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:19.543471 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fe13c-76c0-4900-a43a-1456120f08fe None admin] PATH_INFO: `/v3/projects/c5c8b30d8bf149a899729983c2b8cc27` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:19.544638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fe13c-76c0-4900-a43a-1456120f08fe None admin] RBAC: Authorizing `identity:get_project(project_id=c5c8b30d8bf149a899729983c2b8cc27)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:19.546129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fe13c-76c0-4900-a43a-1456120f08fe None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:19.547790 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 575/1129] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:19:19 2022] GET /identity/v3/projects/c5c8b30d8bf149a899729983c2b8cc27 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:19.554181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0270c-2612-4332-a300-cb092d9e6c77 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:19.624483 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:19.667074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0270c-2612-4332-a300-cb092d9e6c77 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:19.722919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581e02c-dbfc-41f6-ad1c-8b4666a55bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:19.723723 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581e02c-dbfc-41f6-ad1c-8b4666a55bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:19.724021 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581e02c-dbfc-41f6-ad1c-8b4666a55bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:19.724461 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581e02c-dbfc-41f6-ad1c-8b4666a55bb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:19.725464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581e02c-dbfc-41f6-ad1c-8b4666a55bb1 None admin] RBAC: Adding query filter params (role.id=2ae4df0c2db34d5092a5a05f3e512fdc, scope.project.id=c5c8b30d8bf149a899729983c2b8cc27, user.id=0afa1c1ec17241a0aefe1fb5ea3128e9) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:19.725817 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581e02c-dbfc-41f6-ad1c-8b4666a55bb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:19.728026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581e02c-dbfc-41f6-ad1c-8b4666a55bb1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:19.738921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 555/1130] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:19:19 2022] GET /identity/v3/role_assignments?user.id=0afa1c1ec17241a0aefe1fb5ea3128e9&scope.project.id=c5c8b30d8bf149a899729983c2b8cc27&role.id=2ae4df0c2db34d5092a5a05f3e512fdc => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:21.695217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92333c-5355-4a2d-81a8-b5f3ec1010ae None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:21.695806 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92333c-5355-4a2d-81a8-b5f3ec1010ae None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:21.695806 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92333c-5355-4a2d-81a8-b5f3ec1010ae None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:21.697198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 576/1131] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:21.704822 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d5de8-fc6e-4725-88aa-30196dfeb646 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:21.705450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d5de8-fc6e-4725-88aa-30196dfeb646 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:21.705811 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d5de8-fc6e-4725-88aa-30196dfeb646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:21.727466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-a80d5de8-fc6e-4725-88aa-30196dfeb646 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:21.728879 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a80d5de8-fc6e-4725-88aa-30196dfeb646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:21.808398 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 556/1132] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:19:22.071442 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92333c-5355-4a2d-81a8-b5f3ec1010ae None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:22.084246 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:22.202708 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92333c-5355-4a2d-81a8-b5f3ec1010ae None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:22.245188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd835c-f723-4d45-907a-1852014cd8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:22.245882 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd835c-f723-4d45-907a-1852014cd8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:22.246141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd835c-f723-4d45-907a-1852014cd8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:22.246435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd835c-f723-4d45-907a-1852014cd8a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:22.247632 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd835c-f723-4d45-907a-1852014cd8a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:22.249093 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd835c-f723-4d45-907a-1852014cd8a3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:22.250748 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 577/1133] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:19:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:22.256783 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d5de8-fc6e-4725-88aa-30196dfeb646 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:22.320842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:22.365918 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d5de8-fc6e-4725-88aa-30196dfeb646 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:22.405994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169f56b-4c9f-4072-b0d0-eee87f4363ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:22.406589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169f56b-4c9f-4072-b0d0-eee87f4363ab None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:22.406864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169f56b-4c9f-4072-b0d0-eee87f4363ab None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:22.407156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169f56b-4c9f-4072-b0d0-eee87f4363ab None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:22.407815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169f56b-4c9f-4072-b0d0-eee87f4363ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:22.409286 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169f56b-4c9f-4072-b0d0-eee87f4363ab None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:22.440571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 557/1134] 10.222.0.52 () {60 vars in 1141 bytes} [Mon Aug 29 20:19:22 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:19:24.418912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058532d8-bfc3-44db-bef6-796faac4c615 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:24.419459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058532d8-bfc3-44db-bef6-796faac4c615 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:24.419459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058532d8-bfc3-44db-bef6-796faac4c615 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:24.420749 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 578/1135] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:24.426678 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49492f25-14d2-4f47-966b-2ac5573868ce None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:24.427244 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49492f25-14d2-4f47-966b-2ac5573868ce None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:24.427244 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49492f25-14d2-4f47-966b-2ac5573868ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:24.450230 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-49492f25-14d2-4f47-966b-2ac5573868ce None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:24.452269 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-49492f25-14d2-4f47-966b-2ac5573868ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:24.541177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 558/1136] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:19:24.812711 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058532d8-bfc3-44db-bef6-796faac4c615 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:24.907215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:24.934473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058532d8-bfc3-44db-bef6-796faac4c615 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:24.974389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258e0eb-3be9-47c5-842e-ea463a28d8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:24.975056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258e0eb-3be9-47c5-842e-ea463a28d8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:24.975336 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258e0eb-3be9-47c5-842e-ea463a28d8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:24.975603 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258e0eb-3be9-47c5-842e-ea463a28d8b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:24.977309 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258e0eb-3be9-47c5-842e-ea463a28d8b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:24.979419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258e0eb-3be9-47c5-842e-ea463a28d8b1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:24.981147 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 579/1137] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:19:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:24.990967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49492f25-14d2-4f47-966b-2ac5573868ce None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:25.039254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:25.104740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49492f25-14d2-4f47-966b-2ac5573868ce None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:25.144524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361a98b-28f7-4569-860f-482129abc2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:25.145136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361a98b-28f7-4569-860f-482129abc2c1 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:25.145447 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361a98b-28f7-4569-860f-482129abc2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:25.145717 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361a98b-28f7-4569-860f-482129abc2c1 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:25.146392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361a98b-28f7-4569-860f-482129abc2c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:25.147835 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361a98b-28f7-4569-860f-482129abc2c1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:25.170823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 559/1138] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:19:24 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:19:27.220352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41bd20-ebb2-4203-b837-9ba1ea33fd36 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:27.220929 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41bd20-ebb2-4203-b837-9ba1ea33fd36 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:27.220929 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41bd20-ebb2-4203-b837-9ba1ea33fd36 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:27.222306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 580/1139] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:27.228271 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e0db3-1bc3-455e-9f7a-c0ec5f41e7fe None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:27.228878 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e0db3-1bc3-455e-9f7a-c0ec5f41e7fe None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:27.228878 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e0db3-1bc3-455e-9f7a-c0ec5f41e7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:27.248131 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ae8e0db3-1bc3-455e-9f7a-c0ec5f41e7fe None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:27.249398 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ae8e0db3-1bc3-455e-9f7a-c0ec5f41e7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:27.320830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 560/1140] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:19:27.589508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41bd20-ebb2-4203-b837-9ba1ea33fd36 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:27.714847 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41bd20-ebb2-4203-b837-9ba1ea33fd36 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:27.758149 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2795a-21af-4e1d-813d-06daa5a623a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:27.758887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2795a-21af-4e1d-813d-06daa5a623a9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:27.759153 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2795a-21af-4e1d-813d-06daa5a623a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:27.759417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2795a-21af-4e1d-813d-06daa5a623a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:27.771529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2795a-21af-4e1d-813d-06daa5a623a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:19:27.776728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-9fd2795a-21af-4e1d-813d-06daa5a623a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:19:27.776728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:27.776728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:27.776728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:27.776728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:27.776728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:27.776728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:27.776728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:27.776728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:27.776728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:27.776728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:27.776728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:27.776728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:19:27.776728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:19:27.776728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:19:27.776728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:19:27.778628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:19:27.778628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:19:27.778628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:19:27.778628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:19:27.778628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:27.778628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:27.778628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:27.778628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:27.778628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:27.778628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:27.778628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:27.778628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:27.778628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:27.778628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:27.778628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:27.778628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:27.780254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:27.780254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:27.780254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:27.780254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:27.780254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:19:27.780254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:19:27.780254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:19:27.780254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:19:27.780254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:19:27.780254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:19:27.780254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:19:27.780254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:19:27.780254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 581/1141] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:19:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:19:27.785290 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e0db3-1bc3-455e-9f7a-c0ec5f41e7fe None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:27.816976 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:27.911638 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e0db3-1bc3-455e-9f7a-c0ec5f41e7fe None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:27.948735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f07d1-7269-44e7-8003-24f2d788f04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:27.949410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f07d1-7269-44e7-8003-24f2d788f04b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:27.949756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f07d1-7269-44e7-8003-24f2d788f04b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:27.950071 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f07d1-7269-44e7-8003-24f2d788f04b None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:27.950920 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f07d1-7269-44e7-8003-24f2d788f04b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:27.951292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f07d1-7269-44e7-8003-24f2d788f04b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:27.952760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f07d1-7269-44e7-8003-24f2d788f04b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:27.962759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 561/1142] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:19:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:27.968822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2795a-21af-4e1d-813d-06daa5a623a9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:27.978664 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:28.090230 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2795a-21af-4e1d-813d-06daa5a623a9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:28.137646 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449bddb-7a91-4596-a238-9af04748a4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:28.138499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449bddb-7a91-4596-a238-9af04748a4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:28.138831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449bddb-7a91-4596-a238-9af04748a4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:28.139157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449bddb-7a91-4596-a238-9af04748a4c3 None admin] PATH_INFO: `/v3/users/8069e77ef2ac4b62a6769fd0d2839297` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:28.156956 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449bddb-7a91-4596-a238-9af04748a4c3 None admin] RBAC: Authorizing `identity:get_user(user_id=8069e77ef2ac4b62a6769fd0d2839297)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:28.158458 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449bddb-7a91-4596-a238-9af04748a4c3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:28.160267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 582/1143] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:19:27 2022] GET /identity/v3/users/8069e77ef2ac4b62a6769fd0d2839297 => generated 286 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:28.167223 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f07d1-7269-44e7-8003-24f2d788f04b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:28.273431 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:28.285469 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f07d1-7269-44e7-8003-24f2d788f04b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:28.320966 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727076e-b46e-4133-9f35-da7e1d55e7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:28.321610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727076e-b46e-4133-9f35-da7e1d55e7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:28.321886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727076e-b46e-4133-9f35-da7e1d55e7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:28.322158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727076e-b46e-4133-9f35-da7e1d55e7e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:28.395632 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727076e-b46e-4133-9f35-da7e1d55e7e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:28.397120 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727076e-b46e-4133-9f35-da7e1d55e7e2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:28.495455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:28.507339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 562/1144] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:19:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:19:28.515988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449bddb-7a91-4596-a238-9af04748a4c3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:28.588058 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:28.632984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449bddb-7a91-4596-a238-9af04748a4c3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:28.683697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c5344-03c0-44db-bdba-359be6f5891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:28.684343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c5344-03c0-44db-bdba-359be6f5891a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:28.684616 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c5344-03c0-44db-bdba-359be6f5891a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:28.684910 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c5344-03c0-44db-bdba-359be6f5891a None admin] PATH_INFO: `/v3/projects/b9d12f864c4347f19f04024a48f670a9` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:28.686424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c5344-03c0-44db-bdba-359be6f5891a None admin] RBAC: Authorizing `identity:get_project(project_id=b9d12f864c4347f19f04024a48f670a9)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:28.687910 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c5344-03c0-44db-bdba-359be6f5891a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:28.689707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 583/1145] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:19:28 2022] GET /identity/v3/projects/b9d12f864c4347f19f04024a48f670a9 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:28.696425 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727076e-b46e-4133-9f35-da7e1d55e7e2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:28.814841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727076e-b46e-4133-9f35-da7e1d55e7e2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:28.862993 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5a7d2-be9c-47cc-85bb-bbcaf7ef85a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:28.863599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5a7d2-be9c-47cc-85bb-bbcaf7ef85a6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:28.863858 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5a7d2-be9c-47cc-85bb-bbcaf7ef85a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:28.864113 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5a7d2-be9c-47cc-85bb-bbcaf7ef85a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:28.864855 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5a7d2-be9c-47cc-85bb-bbcaf7ef85a6 None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=b9d12f864c4347f19f04024a48f670a9, user.id=8069e77ef2ac4b62a6769fd0d2839297) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:28.865148 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5a7d2-be9c-47cc-85bb-bbcaf7ef85a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:28.866634 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5a7d2-be9c-47cc-85bb-bbcaf7ef85a6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:28.873089 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 563/1146] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:19:28 2022] GET /identity/v3/role_assignments?user.id=8069e77ef2ac4b62a6769fd0d2839297&scope.project.id=b9d12f864c4347f19f04024a48f670a9&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:30.824921 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3bc93-1881-4a39-8242-2c97fa65b869 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:30.825612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3bc93-1881-4a39-8242-2c97fa65b869 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:30.825612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3bc93-1881-4a39-8242-2c97fa65b869 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:30.826830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 584/1147] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:30.833997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b77e95-2a96-4d79-b7b0-a8608710e6dd None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:30.834618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b77e95-2a96-4d79-b7b0-a8608710e6dd None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:30.834618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b77e95-2a96-4d79-b7b0-a8608710e6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:30.855215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-91b77e95-2a96-4d79-b7b0-a8608710e6dd None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:30.856436 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-91b77e95-2a96-4d79-b7b0-a8608710e6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:30.925964 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:30.953535 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 564/1148] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:19:31.224372 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3bc93-1881-4a39-8242-2c97fa65b869 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:31.356822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3bc93-1881-4a39-8242-2c97fa65b869 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:31.391361 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:31.397902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edae1f-1c71-4410-b9a2-27ce8483b440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:31.398553 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edae1f-1c71-4410-b9a2-27ce8483b440 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:31.398899 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edae1f-1c71-4410-b9a2-27ce8483b440 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:31.399168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edae1f-1c71-4410-b9a2-27ce8483b440 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:31.410531 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edae1f-1c71-4410-b9a2-27ce8483b440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:19:31.415483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-f0edae1f-1c71-4410-b9a2-27ce8483b440 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:19:31.415483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:31.415483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:31.415483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:31.415483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:31.415483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:31.415483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:31.415483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:31.415483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:31.415483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:31.415483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:31.415483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:31.415483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:19:31.415483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:19:31.415483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:19:31.415483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:19:31.417299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:19:31.417299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:19:31.417299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:19:31.417299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:19:31.417299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:31.417299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:31.417299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:31.417299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:31.417299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:31.417299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:31.417299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:31.417299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:31.417299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:31.417299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:31.417299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:31.417299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:31.418964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:31.418964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:31.418964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:31.418964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:31.418964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:19:31.418964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:19:31.418964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:19:31.418964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:19:31.418964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:19:31.418964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:19:31.418964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:19:31.418964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:19:31.418964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 585/1149] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:19:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:19:31.423390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b77e95-2a96-4d79-b7b0-a8608710e6dd None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:31.555655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b77e95-2a96-4d79-b7b0-a8608710e6dd None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:31.591988 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecb9e6-6a25-49cf-a4a2-f2d6bf533b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:31.592604 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecb9e6-6a25-49cf-a4a2-f2d6bf533b93 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:31.592880 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecb9e6-6a25-49cf-a4a2-f2d6bf533b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:31.593146 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecb9e6-6a25-49cf-a4a2-f2d6bf533b93 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:31.593858 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecb9e6-6a25-49cf-a4a2-f2d6bf533b93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:31.594153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecb9e6-6a25-49cf-a4a2-f2d6bf533b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:31.595540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecb9e6-6a25-49cf-a4a2-f2d6bf533b93 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:31.604530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 565/1150] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:19:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:31.611678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edae1f-1c71-4410-b9a2-27ce8483b440 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:31.740924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edae1f-1c71-4410-b9a2-27ce8483b440 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:31.780871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6c3ca-e68b-4ae0-aab1-6fd95b79ac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:31.781569 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6c3ca-e68b-4ae0-aab1-6fd95b79ac31 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:31.781851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6c3ca-e68b-4ae0-aab1-6fd95b79ac31 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:31.782120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6c3ca-e68b-4ae0-aab1-6fd95b79ac31 None admin] PATH_INFO: `/v3/users/8069e77ef2ac4b62a6769fd0d2839297` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:31.783377 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6c3ca-e68b-4ae0-aab1-6fd95b79ac31 None admin] RBAC: Authorizing `identity:get_user(user_id=8069e77ef2ac4b62a6769fd0d2839297)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:31.784857 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6c3ca-e68b-4ae0-aab1-6fd95b79ac31 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:31.786554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 586/1151] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:19:31 2022] GET /identity/v3/users/8069e77ef2ac4b62a6769fd0d2839297 => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:31.793854 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecb9e6-6a25-49cf-a4a2-f2d6bf533b93 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:31.856061 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:31.917009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecb9e6-6a25-49cf-a4a2-f2d6bf533b93 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:31.956310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a9e8a-dd7e-4325-879d-56749a43ec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:31.956962 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a9e8a-dd7e-4325-879d-56749a43ec28 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:31.957240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a9e8a-dd7e-4325-879d-56749a43ec28 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:31.957539 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a9e8a-dd7e-4325-879d-56749a43ec28 None admin] PATH_INFO: `/v3/projects/b9d12f864c4347f19f04024a48f670a9` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:31.958715 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a9e8a-dd7e-4325-879d-56749a43ec28 None admin] RBAC: Authorizing `identity:get_project(project_id=b9d12f864c4347f19f04024a48f670a9)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:31.960169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a9e8a-dd7e-4325-879d-56749a43ec28 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:31.962292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 566/1152] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:19:31 2022] GET /identity/v3/projects/b9d12f864c4347f19f04024a48f670a9 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:31.968676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6c3ca-e68b-4ae0-aab1-6fd95b79ac31 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:32.037565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:32.092529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6c3ca-e68b-4ae0-aab1-6fd95b79ac31 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:32.133815 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebd2c2-b542-4336-b55d-75930648c1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:32.134390 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebd2c2-b542-4336-b55d-75930648c1b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:32.134681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebd2c2-b542-4336-b55d-75930648c1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:32.134947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebd2c2-b542-4336-b55d-75930648c1b0 None admin] PATH_INFO: `/v3/projects/b9d12f864c4347f19f04024a48f670a9/users/8069e77ef2ac4b62a6769fd0d2839297/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:32.136877 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebd2c2-b542-4336-b55d-75930648c1b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9d12f864c4347f19f04024a48f670a9, user_id=8069e77ef2ac4b62a6769fd0d2839297, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:32.138356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebd2c2-b542-4336-b55d-75930648c1b0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:32.156321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 587/1153] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:19:31 2022] PUT /identity/v3/projects/b9d12f864c4347f19f04024a48f670a9/users/8069e77ef2ac4b62a6769fd0d2839297/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:19:34.172744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b073858-f9cc-45ad-b682-25334d37998e None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:34.173391 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b073858-f9cc-45ad-b682-25334d37998e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:34.173391 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b073858-f9cc-45ad-b682-25334d37998e None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:34.174707 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 567/1154] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:34.183037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef65b35-849c-4da3-ab58-ffb2eda9c8e3 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:34.183676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef65b35-849c-4da3-ab58-ffb2eda9c8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:34.183676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef65b35-849c-4da3-ab58-ffb2eda9c8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:34.210865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-fef65b35-849c-4da3-ab58-ffb2eda9c8e3 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:34.212620 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fef65b35-849c-4da3-ab58-ffb2eda9c8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:34.286756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 588/1155] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:19:34.552783 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b073858-f9cc-45ad-b682-25334d37998e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:34.688463 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b073858-f9cc-45ad-b682-25334d37998e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:34.705335 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:34.737780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cee577-7556-4b4a-8eec-defb4e7baaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:34.738438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cee577-7556-4b4a-8eec-defb4e7baaf2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:34.738717 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cee577-7556-4b4a-8eec-defb4e7baaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:34.738981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cee577-7556-4b4a-8eec-defb4e7baaf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:34.751656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cee577-7556-4b4a-8eec-defb4e7baaf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:19:34.756619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-c3cee577-7556-4b4a-8eec-defb4e7baaf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:19:34.756619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:34.756619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:34.756619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:34.756619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:34.756619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:34.756619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:34.756619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:34.756619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:34.756619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:34.756619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:34.756619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:34.756619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:19:34.756619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:19:34.756619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:19:34.756619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:19:34.758779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:19:34.758779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:19:34.758779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:19:34.758779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:19:34.758779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:34.758779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:34.758779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:34.758779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:34.758779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:34.758779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:34.758779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:34.758779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:34.758779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:34.758779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:34.758779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:34.758779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:34.760208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:34.760208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:34.760208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:34.760208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:34.760208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:19:34.760208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:19:34.760208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:19:34.760208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:19:34.760208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:19:34.760208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:19:34.760208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:19:34.760208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:19:34.761551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 568/1156] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:19:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:19:34.764184 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef65b35-849c-4da3-ab58-ffb2eda9c8e3 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:34.837054 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:34.925337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef65b35-849c-4da3-ab58-ffb2eda9c8e3 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:34.989820 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c2e05-6906-41fc-981f-1d50324eed8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:34.990817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c2e05-6906-41fc-981f-1d50324eed8c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:34.991308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c2e05-6906-41fc-981f-1d50324eed8c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:34.991759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c2e05-6906-41fc-981f-1d50324eed8c None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:34.993063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c2e05-6906-41fc-981f-1d50324eed8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:34.993601 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c2e05-6906-41fc-981f-1d50324eed8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:34.996252 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c2e05-6906-41fc-981f-1d50324eed8c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:35.010070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 589/1157] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:19:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:19:35.016401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cee577-7556-4b4a-8eec-defb4e7baaf2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:35.139589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cee577-7556-4b4a-8eec-defb4e7baaf2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:35.185149 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be571718-9f4b-4020-afec-8667887213e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:35.186046 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be571718-9f4b-4020-afec-8667887213e0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:35.186415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be571718-9f4b-4020-afec-8667887213e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:35.186860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be571718-9f4b-4020-afec-8667887213e0 None admin] PATH_INFO: `/v3/users/8069e77ef2ac4b62a6769fd0d2839297` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:35.188871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be571718-9f4b-4020-afec-8667887213e0 None admin] RBAC: Authorizing `identity:get_user(user_id=8069e77ef2ac4b62a6769fd0d2839297)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:35.191444 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be571718-9f4b-4020-afec-8667887213e0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:35.193338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 569/1158] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:19:35 2022] GET /identity/v3/users/8069e77ef2ac4b62a6769fd0d2839297 => generated 286 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:19:35.200074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c2e05-6906-41fc-981f-1d50324eed8c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:35.333443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c2e05-6906-41fc-981f-1d50324eed8c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:35.350438 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:35.374829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9678bb9-403f-4aa3-b452-c040f405e366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:35.375495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9678bb9-403f-4aa3-b452-c040f405e366 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:35.375896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9678bb9-403f-4aa3-b452-c040f405e366 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:35.376188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9678bb9-403f-4aa3-b452-c040f405e366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:35.470683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9678bb9-403f-4aa3-b452-c040f405e366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:35.472172 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9678bb9-403f-4aa3-b452-c040f405e366 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:35.618181 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 590/1159] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:19:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:19:35.624486 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be571718-9f4b-4020-afec-8667887213e0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:35.685689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:35.759805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be571718-9f4b-4020-afec-8667887213e0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:35.798669 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4596-f544-44dd-b075-0e2fe17adf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:35.799313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4596-f544-44dd-b075-0e2fe17adf15 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:35.799588 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4596-f544-44dd-b075-0e2fe17adf15 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:35.799889 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4596-f544-44dd-b075-0e2fe17adf15 None admin] PATH_INFO: `/v3/projects/b9d12f864c4347f19f04024a48f670a9` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:35.801255 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4596-f544-44dd-b075-0e2fe17adf15 None admin] RBAC: Authorizing `identity:get_project(project_id=b9d12f864c4347f19f04024a48f670a9)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:35.802928 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4596-f544-44dd-b075-0e2fe17adf15 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:35.804560 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 570/1160] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:19:35 2022] GET /identity/v3/projects/b9d12f864c4347f19f04024a48f670a9 => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:35.811410 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9678bb9-403f-4aa3-b452-c040f405e366 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:35.826610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:35.926589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9678bb9-403f-4aa3-b452-c040f405e366 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:35.965215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15ec34-73d7-476f-8b37-2dbcffdb1c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:35.965886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15ec34-73d7-476f-8b37-2dbcffdb1c46 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:35.966161 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15ec34-73d7-476f-8b37-2dbcffdb1c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:35.966429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15ec34-73d7-476f-8b37-2dbcffdb1c46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:35.967351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15ec34-73d7-476f-8b37-2dbcffdb1c46 None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=b9d12f864c4347f19f04024a48f670a9, user.id=8069e77ef2ac4b62a6769fd0d2839297) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:35.967658 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15ec34-73d7-476f-8b37-2dbcffdb1c46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:35.969211 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15ec34-73d7-476f-8b37-2dbcffdb1c46 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:35.976345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 591/1161] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:19:35 2022] GET /identity/v3/role_assignments?user.id=8069e77ef2ac4b62a6769fd0d2839297&scope.project.id=b9d12f864c4347f19f04024a48f670a9&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:37.962975 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd4eb3-1650-40d5-aff3-c14c8a086768 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:37.963544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd4eb3-1650-40d5-aff3-c14c8a086768 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:37.963544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd4eb3-1650-40d5-aff3-c14c8a086768 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:37.964866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 571/1162] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:37.970616 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d1087-6c20-40f6-8d35-55df1fcba883 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:37.971113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d1087-6c20-40f6-8d35-55df1fcba883 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:37.971222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d1087-6c20-40f6-8d35-55df1fcba883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:37.990591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-cf5d1087-6c20-40f6-8d35-55df1fcba883 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:37.991852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cf5d1087-6c20-40f6-8d35-55df1fcba883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:38.063313 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 592/1163] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:19:38.327846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd4eb3-1650-40d5-aff3-c14c8a086768 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:38.462436 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd4eb3-1650-40d5-aff3-c14c8a086768 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:38.475432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:38.506055 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be4aed-5508-48b2-a2d7-ee79d856894e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:38.506806 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be4aed-5508-48b2-a2d7-ee79d856894e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:38.507081 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be4aed-5508-48b2-a2d7-ee79d856894e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:38.507339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be4aed-5508-48b2-a2d7-ee79d856894e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:38.594089 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be4aed-5508-48b2-a2d7-ee79d856894e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:38.595471 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be4aed-5508-48b2-a2d7-ee79d856894e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:38.708040 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 572/1164] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:19:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:19:38.715310 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d1087-6c20-40f6-8d35-55df1fcba883 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:38.724281 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:38.821040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d1087-6c20-40f6-8d35-55df1fcba883 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:38.855824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206125b-0325-4c25-ae9d-f9c55ac78599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:38.856370 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206125b-0325-4c25-ae9d-f9c55ac78599 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:38.856643 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206125b-0325-4c25-ae9d-f9c55ac78599 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:38.856914 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206125b-0325-4c25-ae9d-f9c55ac78599 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:38.864441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206125b-0325-4c25-ae9d-f9c55ac78599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:38.864441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206125b-0325-4c25-ae9d-f9c55ac78599 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:38.881687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-c206125b-0325-4c25-ae9d-f9c55ac78599 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 20:19:38.881687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:38.881687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 20:19:38.881687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 20:19:38.881687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:19:38.881687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:19:38.881687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:19:38.881687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:19:38.881687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 20:19:38.881687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:19:38.881687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:19:38.881687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:19:38.881687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:38.881687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:38.881687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:38.881687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:38.881687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:38.883568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:38.883568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:38.883568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:38.883568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:38.883568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:38.883568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:38.883568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:19:38.883568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:19:38.883568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:19:38.883568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:19:38.883568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:38.883568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:38.883568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:38.883568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:38.883568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:38.883568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:38.884707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:38.884707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:38.884707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:38.884707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:38.884707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:38.884707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:38.884707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:38.884707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:38.884707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:38.884707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:38.884707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 20:19:38.884707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:19:38.884707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 20:19:38.884707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:19:38.884707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 593/1165] 10.222.0.52 () {56 vars in 1117 bytes} [Mon Aug 29 20:19:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:19:38.890034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be4aed-5508-48b2-a2d7-ee79d856894e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:38.903481 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:38.999833 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be4aed-5508-48b2-a2d7-ee79d856894e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:39.036401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c924d8-b370-4c4c-aee0-3dd4d374956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:39.037060 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c924d8-b370-4c4c-aee0-3dd4d374956b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:39.037299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c924d8-b370-4c4c-aee0-3dd4d374956b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:39.037603 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c924d8-b370-4c4c-aee0-3dd4d374956b None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:39.038255 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c924d8-b370-4c4c-aee0-3dd4d374956b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:39.038559 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c924d8-b370-4c4c-aee0-3dd4d374956b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:39.040037 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c924d8-b370-4c4c-aee0-3dd4d374956b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:39.051999 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 573/1166] 10.222.0.52 () {56 vars in 1115 bytes} [Mon Aug 29 20:19:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:41.190941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91056a65-b253-4fb4-8ca0-3bc15523aef1 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:41.191530 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91056a65-b253-4fb4-8ca0-3bc15523aef1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:41.191530 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91056a65-b253-4fb4-8ca0-3bc15523aef1 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:41.192807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 594/1167] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:41.198415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716758-f24c-446f-bbaa-af2268de513e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:41.198870 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716758-f24c-446f-bbaa-af2268de513e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:41.198960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716758-f24c-446f-bbaa-af2268de513e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:41.218252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c6716758-f24c-446f-bbaa-af2268de513e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:41.219460 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c6716758-f24c-446f-bbaa-af2268de513e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:41.290623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 574/1168] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:19:41.555755 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91056a65-b253-4fb4-8ca0-3bc15523aef1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:41.628137 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:41.667383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91056a65-b253-4fb4-8ca0-3bc15523aef1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:41.705515 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9e7c3-96d8-4aea-a134-20086d3250d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:41.706171 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9e7c3-96d8-4aea-a134-20086d3250d1 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:41.706505 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9e7c3-96d8-4aea-a134-20086d3250d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:41.706853 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9e7c3-96d8-4aea-a134-20086d3250d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:41.707741 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9e7c3-96d8-4aea-a134-20086d3250d1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:41.709544 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9e7c3-96d8-4aea-a134-20086d3250d1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:41.730486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 595/1169] 10.222.0.52 () {60 vars in 1138 bytes} [Mon Aug 29 20:19:41 2022] POST /identity/v3/domains => generated 267 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:19:43.690896 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a543bed-c882-4308-a7d0-fb65029050ba None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:43.691494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a543bed-c882-4308-a7d0-fb65029050ba None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:43.691494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a543bed-c882-4308-a7d0-fb65029050ba None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:43.692928 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 575/1170] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:43.698356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf72e-4ee5-43e3-8c13-8b30abf4cc3f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:43.698801 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf72e-4ee5-43e3-8c13-8b30abf4cc3f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:43.698897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf72e-4ee5-43e3-8c13-8b30abf4cc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:43.717704 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-75ebf72e-4ee5-43e3-8c13-8b30abf4cc3f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:43.718905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-75ebf72e-4ee5-43e3-8c13-8b30abf4cc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:43.793813 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 596/1171] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:19:44.063597 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a543bed-c882-4308-a7d0-fb65029050ba None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:44.068336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:44.192675 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a543bed-c882-4308-a7d0-fb65029050ba None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:44.231401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ada73d-379f-4cdb-a56d-71ac90e08e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:44.232125 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ada73d-379f-4cdb-a56d-71ac90e08e8e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:44.232410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ada73d-379f-4cdb-a56d-71ac90e08e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:44.232695 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ada73d-379f-4cdb-a56d-71ac90e08e8e None admin] PATH_INFO: `/v3/domains/b1499a8153464b72a6bdc76edf4e544b` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:44.247992 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ada73d-379f-4cdb-a56d-71ac90e08e8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=b1499a8153464b72a6bdc76edf4e544b)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:44.249589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ada73d-379f-4cdb-a56d-71ac90e08e8e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:44.251307 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 576/1172] 10.222.0.52 () {56 vars in 1183 bytes} [Mon Aug 29 20:19:44 2022] GET /identity/v3/domains/b1499a8153464b72a6bdc76edf4e544b => generated 267 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:44.259689 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebf72e-4ee5-43e3-8c13-8b30abf4cc3f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:44.326603 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:44.384578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebf72e-4ee5-43e3-8c13-8b30abf4cc3f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:44.420627 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6525ff9-4e18-466a-8036-d65d694c9ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:44.421231 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6525ff9-4e18-466a-8036-d65d694c9ab5 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:44.421543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6525ff9-4e18-466a-8036-d65d694c9ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:44.421810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6525ff9-4e18-466a-8036-d65d694c9ab5 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:44.422474 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6525ff9-4e18-466a-8036-d65d694c9ab5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:44.423916 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6525ff9-4e18-466a-8036-d65d694c9ab5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:44.451305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 597/1173] 10.222.0.52 () {60 vars in 1141 bytes} [Mon Aug 29 20:19:44 2022] POST /identity/v3/projects => generated 361 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:19:46.390267 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc28b7-46ed-4c19-b59b-6f05f2db0946 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:46.390838 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc28b7-46ed-4c19-b59b-6f05f2db0946 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:46.390838 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc28b7-46ed-4c19-b59b-6f05f2db0946 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:46.392146 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 577/1174] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:46.398897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306aef91-957d-4058-ae66-d7734478294d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:46.399539 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306aef91-957d-4058-ae66-d7734478294d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:46.399539 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306aef91-957d-4058-ae66-d7734478294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:46.420654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-306aef91-957d-4058-ae66-d7734478294d None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:46.421871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-306aef91-957d-4058-ae66-d7734478294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:46.490524 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 598/1175] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:19:46.761555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc28b7-46ed-4c19-b59b-6f05f2db0946 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:46.853441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:46.901976 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc28b7-46ed-4c19-b59b-6f05f2db0946 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:46.945753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aae286-7fd8-4cea-b449-282881795186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:46.946443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aae286-7fd8-4cea-b449-282881795186 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:46.946748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aae286-7fd8-4cea-b449-282881795186 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:46.947037 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aae286-7fd8-4cea-b449-282881795186 None admin] PATH_INFO: `/v3/domains/b1499a8153464b72a6bdc76edf4e544b` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:46.948392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aae286-7fd8-4cea-b449-282881795186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b1499a8153464b72a6bdc76edf4e544b)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:46.950267 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aae286-7fd8-4cea-b449-282881795186 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:46.952072 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 578/1176] 10.222.0.52 () {56 vars in 1183 bytes} [Mon Aug 29 20:19:46 2022] GET /identity/v3/domains/b1499a8153464b72a6bdc76edf4e544b => generated 267 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:46.958565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306aef91-957d-4058-ae66-d7734478294d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:47.014681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:47.080187 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306aef91-957d-4058-ae66-d7734478294d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:47.116748 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4065be7-0edf-4239-aacc-ff9b9a245624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:47.117400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4065be7-0edf-4239-aacc-ff9b9a245624 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:47.117668 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4065be7-0edf-4239-aacc-ff9b9a245624 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:47.117936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4065be7-0edf-4239-aacc-ff9b9a245624 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:47.118598 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4065be7-0edf-4239-aacc-ff9b9a245624 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:47.120101 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4065be7-0edf-4239-aacc-ff9b9a245624 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:47.149181 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 599/1177] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:19:46 2022] POST /identity/v3/users => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:19:49.140963 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d83a76-5567-4527-b411-d296af1af68e None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:49.141646 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d83a76-5567-4527-b411-d296af1af68e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:49.141646 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d83a76-5567-4527-b411-d296af1af68e None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:49.142911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 579/1178] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:49.154500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179c87e-41da-4f87-a685-4a872f22dd20 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:49.155525 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179c87e-41da-4f87-a685-4a872f22dd20 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:49.155525 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179c87e-41da-4f87-a685-4a872f22dd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:49.177029 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-8179c87e-41da-4f87-a685-4a872f22dd20 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:49.178438 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8179c87e-41da-4f87-a685-4a872f22dd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:49.259385 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 600/1179] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:19:49.532367 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d83a76-5567-4527-b411-d296af1af68e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:49.652308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d83a76-5567-4527-b411-d296af1af68e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:49.683769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:49.689397 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fa9e8-2ebf-479b-8f3a-252d2e542725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:49.690119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fa9e8-2ebf-479b-8f3a-252d2e542725 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:49.690401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fa9e8-2ebf-479b-8f3a-252d2e542725 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:49.690748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fa9e8-2ebf-479b-8f3a-252d2e542725 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:49.701856 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fa9e8-2ebf-479b-8f3a-252d2e542725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:19:49.706745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-d94fa9e8-2ebf-479b-8f3a-252d2e542725 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:19:49.706745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:49.706745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:49.706745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:49.706745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:49.706745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:49.706745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:49.706745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:49.706745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:49.706745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:49.706745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:49.706745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:49.706745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:19:49.706745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:19:49.706745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:19:49.706745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:19:49.707921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:19:49.707921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:19:49.707921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:19:49.707921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:19:49.707921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:49.707921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:49.707921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:49.707921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:49.707921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:49.707921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:49.707921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:49.707921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:49.707921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:49.707921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:49.707921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:49.707921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:49.709135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:49.709135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:49.709135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:49.709135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:49.709135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:19:49.709135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:19:49.709135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:19:49.709135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:19:49.709135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:19:49.709135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:19:49.709135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:19:49.709135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:19:49.709135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 580/1180] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:19:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:19:49.716620 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179c87e-41da-4f87-a685-4a872f22dd20 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:49.750875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:49.831006 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179c87e-41da-4f87-a685-4a872f22dd20 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:49.868544 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14003b4d-ad3f-4909-ac78-18d04c95c17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:49.869154 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14003b4d-ad3f-4909-ac78-18d04c95c17c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:49.869456 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14003b4d-ad3f-4909-ac78-18d04c95c17c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:49.869734 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14003b4d-ad3f-4909-ac78-18d04c95c17c None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:49.870402 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14003b4d-ad3f-4909-ac78-18d04c95c17c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:49.870700 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14003b4d-ad3f-4909-ac78-18d04c95c17c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:49.872076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14003b4d-ad3f-4909-ac78-18d04c95c17c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:49.880265 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 601/1181] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:19:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:49.889074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fa9e8-2ebf-479b-8f3a-252d2e542725 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:50.000669 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fa9e8-2ebf-479b-8f3a-252d2e542725 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:50.040070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b773e-93ad-40c5-aa1a-3d7caa700870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:50.040738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b773e-93ad-40c5-aa1a-3d7caa700870 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:50.041016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b773e-93ad-40c5-aa1a-3d7caa700870 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:50.041285 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b773e-93ad-40c5-aa1a-3d7caa700870 None admin] PATH_INFO: `/v3/users/07aa1aa451014da2a12600501e2b24ab` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:50.056923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b773e-93ad-40c5-aa1a-3d7caa700870 None admin] RBAC: Authorizing `identity:get_user(user_id=07aa1aa451014da2a12600501e2b24ab)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:50.058452 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b773e-93ad-40c5-aa1a-3d7caa700870 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:50.060198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 581/1182] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:19:49 2022] GET /identity/v3/users/07aa1aa451014da2a12600501e2b24ab => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:50.066738 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14003b4d-ad3f-4909-ac78-18d04c95c17c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:50.173708 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:50.192080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14003b4d-ad3f-4909-ac78-18d04c95c17c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:50.230039 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30001f0f-aac9-4fc9-b776-d3c99edde08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:50.230664 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30001f0f-aac9-4fc9-b776-d3c99edde08c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:50.230948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30001f0f-aac9-4fc9-b776-d3c99edde08c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:50.231223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30001f0f-aac9-4fc9-b776-d3c99edde08c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:50.319750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30001f0f-aac9-4fc9-b776-d3c99edde08c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:50.321551 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30001f0f-aac9-4fc9-b776-d3c99edde08c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:50.425743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:50.444108 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 602/1183] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:19:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:19:50.452941 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b773e-93ad-40c5-aa1a-3d7caa700870 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:50.513602 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:50.568814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b773e-93ad-40c5-aa1a-3d7caa700870 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:50.606722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bb8ce-8f20-4446-bfe4-ea09d071eeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:50.607351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bb8ce-8f20-4446-bfe4-ea09d071eeac None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:50.607647 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bb8ce-8f20-4446-bfe4-ea09d071eeac None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:50.607917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bb8ce-8f20-4446-bfe4-ea09d071eeac None admin] PATH_INFO: `/v3/projects/f7668dd814614f868c74861cb4df3b9b` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:50.609121 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bb8ce-8f20-4446-bfe4-ea09d071eeac None admin] RBAC: Authorizing `identity:get_project(project_id=f7668dd814614f868c74861cb4df3b9b)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:50.610599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bb8ce-8f20-4446-bfe4-ea09d071eeac None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:50.612242 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 582/1184] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:19:50 2022] GET /identity/v3/projects/f7668dd814614f868c74861cb4df3b9b => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:50.619155 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30001f0f-aac9-4fc9-b776-d3c99edde08c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:50.741526 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30001f0f-aac9-4fc9-b776-d3c99edde08c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:50.779697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61081582-f596-451c-9a04-b900d5c0a2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:50.780300 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61081582-f596-451c-9a04-b900d5c0a2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:50.780593 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61081582-f596-451c-9a04-b900d5c0a2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:50.780843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61081582-f596-451c-9a04-b900d5c0a2a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:50.781602 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61081582-f596-451c-9a04-b900d5c0a2a5 None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=f7668dd814614f868c74861cb4df3b9b, user.id=07aa1aa451014da2a12600501e2b24ab) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:50.781907 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61081582-f596-451c-9a04-b900d5c0a2a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:50.783345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61081582-f596-451c-9a04-b900d5c0a2a5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:50.789303 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 603/1185] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:19:50 2022] GET /identity/v3/role_assignments?user.id=07aa1aa451014da2a12600501e2b24ab&scope.project.id=f7668dd814614f868c74861cb4df3b9b&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:52.676195 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561dd97-817f-4e08-b0ff-e4ebdac84c6a None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:52.676752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561dd97-817f-4e08-b0ff-e4ebdac84c6a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:52.676752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561dd97-817f-4e08-b0ff-e4ebdac84c6a None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:52.678063 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 583/1186] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:19:52.683809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154462ca-f1ee-4255-a853-bb92821486e1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:52.684414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154462ca-f1ee-4255-a853-bb92821486e1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:52.684414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154462ca-f1ee-4255-a853-bb92821486e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:52.704350 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-154462ca-f1ee-4255-a853-bb92821486e1 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:52.705587 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-154462ca-f1ee-4255-a853-bb92821486e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:52.756532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:52.779214 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 604/1187] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:19:53.044859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561dd97-817f-4e08-b0ff-e4ebdac84c6a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:53.164199 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561dd97-817f-4e08-b0ff-e4ebdac84c6a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:53.183779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:53.206240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6b9eb-9780-4def-8afc-d3981bb6ab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:53.206913 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6b9eb-9780-4def-8afc-d3981bb6ab3c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:53.207189 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6b9eb-9780-4def-8afc-d3981bb6ab3c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:53.207461 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6b9eb-9780-4def-8afc-d3981bb6ab3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:53.221884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6b9eb-9780-4def-8afc-d3981bb6ab3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:19:53.226763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-99f6b9eb-9780-4def-8afc-d3981bb6ab3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:19:53.226763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:53.226763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:53.226763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:53.226763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:53.226763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:53.226763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:53.226763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:53.226763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:53.226763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:53.226763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:53.226763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:53.226763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:19:53.226763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:19:53.226763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:19:53.226763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:19:53.227886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:19:53.227886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:19:53.227886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:19:53.227886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:19:53.227886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:53.227886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:53.227886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:53.227886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:53.227886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:53.227886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:53.227886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:53.227886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:53.227886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:53.227886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:53.227886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:53.227886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:53.228777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:53.228777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:53.228777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:53.228777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:53.228777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:19:53.228777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:19:53.228777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:19:53.228777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:19:53.228777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:19:53.228777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:19:53.228777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:19:53.228777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:19:53.228777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 584/1188] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:19:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:19:53.234124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154462ca-f1ee-4255-a853-bb92821486e1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:53.337531 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154462ca-f1ee-4255-a853-bb92821486e1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:53.374007 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fa8ab-50c6-4968-a389-679f285d2a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:53.374665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fa8ab-50c6-4968-a389-679f285d2a4f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:53.374943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fa8ab-50c6-4968-a389-679f285d2a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:53.375214 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fa8ab-50c6-4968-a389-679f285d2a4f None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:53.375891 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fa8ab-50c6-4968-a389-679f285d2a4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:53.376190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fa8ab-50c6-4968-a389-679f285d2a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:53.377655 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fa8ab-50c6-4968-a389-679f285d2a4f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:53.386977 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 605/1189] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:19:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:53.393251 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6b9eb-9780-4def-8afc-d3981bb6ab3c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:53.499840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6b9eb-9780-4def-8afc-d3981bb6ab3c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:53.535229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd13141-fe4e-4c81-a809-81dfee63855d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:53.535863 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd13141-fe4e-4c81-a809-81dfee63855d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:53.536140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd13141-fe4e-4c81-a809-81dfee63855d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:53.536420 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd13141-fe4e-4c81-a809-81dfee63855d None admin] PATH_INFO: `/v3/users/07aa1aa451014da2a12600501e2b24ab` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:53.537581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd13141-fe4e-4c81-a809-81dfee63855d None admin] RBAC: Authorizing `identity:get_user(user_id=07aa1aa451014da2a12600501e2b24ab)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:53.539077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd13141-fe4e-4c81-a809-81dfee63855d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:53.540665 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 585/1190] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:19:53 2022] GET /identity/v3/users/07aa1aa451014da2a12600501e2b24ab => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:53.546826 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fa8ab-50c6-4968-a389-679f285d2a4f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:53.593921 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:53.657219 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fa8ab-50c6-4968-a389-679f285d2a4f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:53.698246 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f5109-c25e-49d5-9458-ad176e0f70f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:53.699371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f5109-c25e-49d5-9458-ad176e0f70f6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:53.699371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f5109-c25e-49d5-9458-ad176e0f70f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:53.699737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f5109-c25e-49d5-9458-ad176e0f70f6 None admin] PATH_INFO: `/v3/projects/f7668dd814614f868c74861cb4df3b9b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:53.700790 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f5109-c25e-49d5-9458-ad176e0f70f6 None admin] RBAC: Authorizing `identity:get_project(project_id=f7668dd814614f868c74861cb4df3b9b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:53.702159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f5109-c25e-49d5-9458-ad176e0f70f6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:53.703866 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 606/1191] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:19:53 2022] GET /identity/v3/projects/f7668dd814614f868c74861cb4df3b9b => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:53.710605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd13141-fe4e-4c81-a809-81dfee63855d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:53.762627 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:53.831355 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd13141-fe4e-4c81-a809-81dfee63855d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:53.874704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d52e3-988c-43bc-bf7f-47835fae2dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:53.875369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d52e3-988c-43bc-bf7f-47835fae2dea None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:53.875696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d52e3-988c-43bc-bf7f-47835fae2dea None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:53.876011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d52e3-988c-43bc-bf7f-47835fae2dea None admin] PATH_INFO: `/v3/projects/f7668dd814614f868c74861cb4df3b9b/users/07aa1aa451014da2a12600501e2b24ab/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:53.878340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d52e3-988c-43bc-bf7f-47835fae2dea None admin] RBAC: Authorizing `identity:create_grant(project_id=f7668dd814614f868c74861cb4df3b9b, user_id=07aa1aa451014da2a12600501e2b24ab, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:53.880153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d52e3-988c-43bc-bf7f-47835fae2dea None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:53.897057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 586/1192] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:19:53 2022] PUT /identity/v3/projects/f7668dd814614f868c74861cb4df3b9b/users/07aa1aa451014da2a12600501e2b24ab/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:19:55.820268 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7980eae-9a46-44f5-9f41-00ddd75afa14 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:55.820867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7980eae-9a46-44f5-9f41-00ddd75afa14 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:55.820867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7980eae-9a46-44f5-9f41-00ddd75afa14 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:55.822144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 607/1193] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:55.828537 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bef48-71cc-4e95-81ce-20a66a3fd974 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:55.829046 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bef48-71cc-4e95-81ce-20a66a3fd974 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:55.829153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bef48-71cc-4e95-81ce-20a66a3fd974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:55.848971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-536bef48-71cc-4e95-81ce-20a66a3fd974 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:55.850306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-536bef48-71cc-4e95-81ce-20a66a3fd974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:55.923471 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 587/1194] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:19:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:19:56.199629 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7980eae-9a46-44f5-9f41-00ddd75afa14 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:56.315771 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7980eae-9a46-44f5-9f41-00ddd75afa14 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:56.327689 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:56.360192 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee09ca1-7701-4d9e-ac19-281ec7f45ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:56.360834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee09ca1-7701-4d9e-ac19-281ec7f45ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:56.361112 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee09ca1-7701-4d9e-ac19-281ec7f45ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:56.361405 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee09ca1-7701-4d9e-ac19-281ec7f45ba7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:56.373195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee09ca1-7701-4d9e-ac19-281ec7f45ba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:19:56.378133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-4ee09ca1-7701-4d9e-ac19-281ec7f45ba7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:19:56.378133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:19:56.378133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:19:56.378133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:19:56.378133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:19:56.378133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:19:56.378133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:19:56.378133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:19:56.378133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:19:56.378133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:19:56.378133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:19:56.378133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:19:56.378133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:19:56.378133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:19:56.378133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:19:56.378133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:19:56.381441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:19:56.381441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:19:56.381441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:19:56.381441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:19:56.381441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:19:56.381441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:19:56.381441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:19:56.381441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:19:56.381441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:19:56.381441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:19:56.381441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:19:56.381441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:19:56.381441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:19:56.381441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:19:56.381441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:19:56.381441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:19:56.382560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:19:56.382560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:19:56.382560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:19:56.382560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:19:56.382560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:19:56.382560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:19:56.382560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:19:56.382560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:19:56.382560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:19:56.382560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:19:56.382560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:19:56.382560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:19:56.382560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 608/1195] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:19:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:19:56.388220 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bef48-71cc-4e95-81ce-20a66a3fd974 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:56.435107 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:56.512053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bef48-71cc-4e95-81ce-20a66a3fd974 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:56.553743 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d699b-887f-4e97-9b9e-e3893bb8ddfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:56.554438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d699b-887f-4e97-9b9e-e3893bb8ddfb None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:56.554766 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d699b-887f-4e97-9b9e-e3893bb8ddfb None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:56.555084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d699b-887f-4e97-9b9e-e3893bb8ddfb None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:56.555957 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d699b-887f-4e97-9b9e-e3893bb8ddfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:56.556319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d699b-887f-4e97-9b9e-e3893bb8ddfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:56.557952 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d699b-887f-4e97-9b9e-e3893bb8ddfb None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:56.568419 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 588/1196] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:19:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:56.575147 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee09ca1-7701-4d9e-ac19-281ec7f45ba7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:56.688418 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee09ca1-7701-4d9e-ac19-281ec7f45ba7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:56.724461 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dc739-2594-4cfe-aab3-184ef96e3b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:56.725183 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dc739-2594-4cfe-aab3-184ef96e3b60 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:56.725493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dc739-2594-4cfe-aab3-184ef96e3b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:56.725760 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dc739-2594-4cfe-aab3-184ef96e3b60 None admin] PATH_INFO: `/v3/users/07aa1aa451014da2a12600501e2b24ab` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:56.727047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4dc739-2594-4cfe-aab3-184ef96e3b60 None admin] RBAC: Authorizing `identity:get_user(user_id=07aa1aa451014da2a12600501e2b24ab)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:56.728566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4dc739-2594-4cfe-aab3-184ef96e3b60 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:56.730242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 609/1197] 10.222.0.52 () {56 vars in 1177 bytes} [Mon Aug 29 20:19:56 2022] GET /identity/v3/users/07aa1aa451014da2a12600501e2b24ab => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:19:56.736589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d699b-887f-4e97-9b9e-e3893bb8ddfb None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:56.843811 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:56.850359 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d699b-887f-4e97-9b9e-e3893bb8ddfb None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:56.901555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7177a-7ecc-4d63-9361-4cd90f642a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:56.902177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7177a-7ecc-4d63-9361-4cd90f642a48 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:56.902454 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7177a-7ecc-4d63-9361-4cd90f642a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:56.902729 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7177a-7ecc-4d63-9361-4cd90f642a48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:56.975443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7177a-7ecc-4d63-9361-4cd90f642a48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:56.976939 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7177a-7ecc-4d63-9361-4cd90f642a48 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:57.076166 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:57.083206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 589/1198] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:19:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:19:57.089886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dc739-2594-4cfe-aab3-184ef96e3b60 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:57.137158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:57.201949 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dc739-2594-4cfe-aab3-184ef96e3b60 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:57.238988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e008e2-b419-464b-8a3f-805775e7d396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:57.239623 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e008e2-b419-464b-8a3f-805775e7d396 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:57.239908 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e008e2-b419-464b-8a3f-805775e7d396 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:57.240178 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e008e2-b419-464b-8a3f-805775e7d396 None admin] PATH_INFO: `/v3/projects/f7668dd814614f868c74861cb4df3b9b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:57.241457 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e008e2-b419-464b-8a3f-805775e7d396 None admin] RBAC: Authorizing `identity:get_project(project_id=f7668dd814614f868c74861cb4df3b9b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:57.242944 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e008e2-b419-464b-8a3f-805775e7d396 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:57.244586 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 610/1199] 10.222.0.52 () {56 vars in 1186 bytes} [Mon Aug 29 20:19:57 2022] GET /identity/v3/projects/f7668dd814614f868c74861cb4df3b9b => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:19:57.254517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7177a-7ecc-4d63-9361-4cd90f642a48 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:57.379161 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7177a-7ecc-4d63-9361-4cd90f642a48 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:57.418102 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40bbc0-70b0-462c-85fa-1dbeea1490be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:57.418603 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40bbc0-70b0-462c-85fa-1dbeea1490be None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:57.418829 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40bbc0-70b0-462c-85fa-1dbeea1490be None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:57.419129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40bbc0-70b0-462c-85fa-1dbeea1490be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:57.419849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40bbc0-70b0-462c-85fa-1dbeea1490be None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=f7668dd814614f868c74861cb4df3b9b, user.id=07aa1aa451014da2a12600501e2b24ab) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:19:57.420150 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40bbc0-70b0-462c-85fa-1dbeea1490be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:57.421592 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40bbc0-70b0-462c-85fa-1dbeea1490be None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:57.428193 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 590/1200] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:19:57 2022] GET /identity/v3/role_assignments?user.id=07aa1aa451014da2a12600501e2b24ab&scope.project.id=f7668dd814614f868c74861cb4df3b9b&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:20:07.234601 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=47 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:07.424864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=69 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:55.318254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b19b3-f6fd-411b-b6ff-f605e1016ea3 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:55.318254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b19b3-f6fd-411b-b6ff-f605e1016ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:55.318254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b19b3-f6fd-411b-b6ff-f605e1016ea3 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:55.318254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 611/1201] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:20:55.324843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7b171-b3db-4c82-9321-320ec61de792 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:55.325626 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7b171-b3db-4c82-9321-320ec61de792 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:55.325626 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7b171-b3db-4c82-9321-320ec61de792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:55.346111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-fdb7b171-b3db-4c82-9321-320ec61de792 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:55.347469 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fdb7b171-b3db-4c82-9321-320ec61de792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:55.457451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 591/1202] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:20:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:20:55.749109 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b19b3-f6fd-411b-b6ff-f605e1016ea3 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:55.958531 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b19b3-f6fd-411b-b6ff-f605e1016ea3 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:56.052274 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a797c-11e5-43c6-8132-6f085213fd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:56.053514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a797c-11e5-43c6-8132-6f085213fd40 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:56.054017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a797c-11e5-43c6-8132-6f085213fd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:56.054503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a797c-11e5-43c6-8132-6f085213fd40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:56.077519 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a797c-11e5-43c6-8132-6f085213fd40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:56.080385 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a797c-11e5-43c6-8132-6f085213fd40 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:56.118494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-789a797c-11e5-43c6-8132-6f085213fd40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:20:56.118494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:20:56.118494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:20:56.118494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:20:56.118494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:20:56.118494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:20:56.118494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:20:56.118494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:20:56.118494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:20:56.118494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:20:56.118494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:20:56.118494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:20:56.118494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:20:56.118494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:20:56.118494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:20:56.118494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:20:56.119836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:20:56.119836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:20:56.119836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:20:56.119836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:20:56.119836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:20:56.119836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:20:56.119836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:20:56.119836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:20:56.119836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:20:56.119836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:20:56.119836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:20:56.119836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:20:56.119836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:20:56.119836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:20:56.119836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:20:56.119836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:20:56.119836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:20:56.121027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:20:56.121027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:20:56.121027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:20:56.121027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 612/1203] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:20:56.131669 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7b171-b3db-4c82-9321-320ec61de792 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:56.299652 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7b171-b3db-4c82-9321-320ec61de792 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:56.364161 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:56.375290 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1deb579-a160-4ba4-aa47-c84a562d525f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:56.376229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deb579-a160-4ba4-aa47-c84a562d525f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:56.376760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deb579-a160-4ba4-aa47-c84a562d525f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:56.377536 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1deb579-a160-4ba4-aa47-c84a562d525f None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:56.378396 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1deb579-a160-4ba4-aa47-c84a562d525f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:20:56.378703 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1deb579-a160-4ba4-aa47-c84a562d525f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:56.380255 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1deb579-a160-4ba4-aa47-c84a562d525f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:56.399744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 592/1204] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:20:56.401305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a797c-11e5-43c6-8132-6f085213fd40 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:56.478163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:56.528596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a797c-11e5-43c6-8132-6f085213fd40 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:56.573849 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83403394-b644-4794-9735-da3bfa76e6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:56.574473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83403394-b644-4794-9735-da3bfa76e6f0 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:56.574746 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83403394-b644-4794-9735-da3bfa76e6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:56.575013 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83403394-b644-4794-9735-da3bfa76e6f0 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:56.575678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83403394-b644-4794-9735-da3bfa76e6f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:56.577386 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83403394-b644-4794-9735-da3bfa76e6f0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:56.613493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 613/1205] 10.222.0.52 () {60 vars in 1132 bytes} [Mon Aug 29 20:20:56 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:20:58.993027 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fda74-6468-4afe-84ab-1b508c7c8029 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:58.993744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fda74-6468-4afe-84ab-1b508c7c8029 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:58.993744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fda74-6468-4afe-84ab-1b508c7c8029 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:58.995020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 593/1206] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:20:59.003328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69739d-bbb6-4fd2-8804-430ae0fa57e6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:59.004019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69739d-bbb6-4fd2-8804-430ae0fa57e6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:59.004242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69739d-bbb6-4fd2-8804-430ae0fa57e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:59.036865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ff69739d-bbb6-4fd2-8804-430ae0fa57e6 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:59.038898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ff69739d-bbb6-4fd2-8804-430ae0fa57e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:59.153077 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 614/1207] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:20:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:20:59.498914 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fda74-6468-4afe-84ab-1b508c7c8029 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:59.666129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fda74-6468-4afe-84ab-1b508c7c8029 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:59.725799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c9306-476a-4d68-b5c3-ea41d6208b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:59.726475 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c9306-476a-4d68-b5c3-ea41d6208b2b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:59.726769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c9306-476a-4d68-b5c3-ea41d6208b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:59.727121 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c9306-476a-4d68-b5c3-ea41d6208b2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:59.740602 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c9306-476a-4d68-b5c3-ea41d6208b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:20:59.746381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-8a8c9306-476a-4d68-b5c3-ea41d6208b2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:20:59.746381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:20:59.746381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:20:59.746381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:20:59.746381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:20:59.746381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:20:59.746381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:20:59.746381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:20:59.746381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:20:59.746381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:20:59.746381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:20:59.746381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:20:59.746381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:20:59.746381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:20:59.746381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:20:59.746381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:20:59.747994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:20:59.747994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:20:59.747994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:20:59.747994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:20:59.747994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:20:59.747994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:20:59.747994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:20:59.747994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:20:59.747994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:20:59.747994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:20:59.747994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:20:59.747994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:20:59.747994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:20:59.747994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:20:59.747994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:20:59.747994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:20:59.748868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:20:59.748868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:20:59.748868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:20:59.748868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:20:59.748868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:20:59.748868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:20:59.748868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:20:59.748868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:20:59.748868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:20:59.748868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:20:59.748868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:20:59.748868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:20:59.748868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 594/1208] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:20:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:20:59.756386 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69739d-bbb6-4fd2-8804-430ae0fa57e6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:59.812498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:59.936693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69739d-bbb6-4fd2-8804-430ae0fa57e6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:00.007875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df194f0-be8d-4af5-a2f3-74cc2d934bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:00.009349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df194f0-be8d-4af5-a2f3-74cc2d934bdf None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:00.009879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df194f0-be8d-4af5-a2f3-74cc2d934bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:00.010429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df194f0-be8d-4af5-a2f3-74cc2d934bdf None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:00.011665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df194f0-be8d-4af5-a2f3-74cc2d934bdf None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:00.012358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df194f0-be8d-4af5-a2f3-74cc2d934bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:00.015165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df194f0-be8d-4af5-a2f3-74cc2d934bdf None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:00.032506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 615/1209] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:20:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:00.039232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c9306-476a-4d68-b5c3-ea41d6208b2b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:00.116594 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:00.215403 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c9306-476a-4d68-b5c3-ea41d6208b2b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:00.272879 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec45c1f-d05b-4be1-8be2-c5dd91f89a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:00.274032 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec45c1f-d05b-4be1-8be2-c5dd91f89a0f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:00.274522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec45c1f-d05b-4be1-8be2-c5dd91f89a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:00.275300 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec45c1f-d05b-4be1-8be2-c5dd91f89a0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:00.295756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec45c1f-d05b-4be1-8be2-c5dd91f89a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:00.297299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec45c1f-d05b-4be1-8be2-c5dd91f89a0f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:00.330031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-cec45c1f-d05b-4be1-8be2-c5dd91f89a0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:00.330031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:00.330031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:00.330031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:00.330031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:00.330031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:00.330031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:00.330031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:00.330031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:00.330031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:00.330031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:00.330031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:00.330031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:21:00.330031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:21:00.330031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:21:00.330031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:21:00.331869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:00.331869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:00.331869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:00.331869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:00.331869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:00.331869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:00.331869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:00.331869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:00.331869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:00.331869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:00.331869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:00.331869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:00.331869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:00.331869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:00.331869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:00.331869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:00.331869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:21:00.332783 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:21:00.332783 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:00.332783 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:00.332783 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 595/1210] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:00.341585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df194f0-be8d-4af5-a2f3-74cc2d934bdf None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:00.532195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:00.536388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df194f0-be8d-4af5-a2f3-74cc2d934bdf None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:00.599337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d32522-59fa-4fef-b646-39ecec255e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:00.600471 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d32522-59fa-4fef-b646-39ecec255e28 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:00.601011 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d32522-59fa-4fef-b646-39ecec255e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:00.601709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d32522-59fa-4fef-b646-39ecec255e28 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:00.603028 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d32522-59fa-4fef-b646-39ecec255e28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:00.603621 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d32522-59fa-4fef-b646-39ecec255e28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:00.605406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d32522-59fa-4fef-b646-39ecec255e28 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:00.622849 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 616/1211] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:00.632354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec45c1f-d05b-4be1-8be2-c5dd91f89a0f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:00.811806 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec45c1f-d05b-4be1-8be2-c5dd91f89a0f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:00.813445 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:00.860413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424420f3-1955-4407-aa27-beb530df9d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:00.861273 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424420f3-1955-4407-aa27-beb530df9d67 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:00.861890 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424420f3-1955-4407-aa27-beb530df9d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:00.862434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424420f3-1955-4407-aa27-beb530df9d67 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:00.873048 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424420f3-1955-4407-aa27-beb530df9d67 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:00.874579 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424420f3-1955-4407-aa27-beb530df9d67 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:00.888848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-424420f3-1955-4407-aa27-beb530df9d67 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:21:00.888848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:00.888848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:00.888848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:00.888848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:00.888848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:00.888848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:00.888848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:00.888848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:00.888848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:00.888848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:00.888848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:00.888848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:21:00.888848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:21:00.888848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:21:00.888848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:00.891252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:00.892484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:00.892484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:00.892484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:21:00.892484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:21:00.892484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:21:00.892484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:21:00.892484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:21:00.892484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:21:00.892484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:21:00.892484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:00.895266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 596/1212] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:00.897171 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d32522-59fa-4fef-b646-39ecec255e28 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:01.052820 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d32522-59fa-4fef-b646-39ecec255e28 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:01.101502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dabdb-9f61-451f-a0af-27ebe64c624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:01.102127 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dabdb-9f61-451f-a0af-27ebe64c624f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:01.102401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dabdb-9f61-451f-a0af-27ebe64c624f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:01.102800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dabdb-9f61-451f-a0af-27ebe64c624f None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:01.103717 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dabdb-9f61-451f-a0af-27ebe64c624f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:01.104026 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dabdb-9f61-451f-a0af-27ebe64c624f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:01.105855 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dabdb-9f61-451f-a0af-27ebe64c624f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:01.131672 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 617/1213] 10.222.0.52 () {56 vars in 1143 bytes} [Mon Aug 29 20:21:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:01.138365 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424420f3-1955-4407-aa27-beb530df9d67 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:01.271417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424420f3-1955-4407-aa27-beb530df9d67 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:01.324505 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be7929-966b-4d4e-b159-e2e6444d5180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:01.325696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be7929-966b-4d4e-b159-e2e6444d5180 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:01.326388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be7929-966b-4d4e-b159-e2e6444d5180 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:01.326834 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be7929-966b-4d4e-b159-e2e6444d5180 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:01.376149 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:01.430712 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be7929-966b-4d4e-b159-e2e6444d5180 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:01.432901 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be7929-966b-4d4e-b159-e2e6444d5180 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:01.596509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 597/1214] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:21:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:21:01.602809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dabdb-9f61-451f-a0af-27ebe64c624f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:01.627363 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:01.759539 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dabdb-9f61-451f-a0af-27ebe64c624f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:01.804840 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c5def-806a-40af-b693-cea6d2b88ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:01.805964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c5def-806a-40af-b693-cea6d2b88ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:01.806312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c5def-806a-40af-b693-cea6d2b88ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:01.806619 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c5def-806a-40af-b693-cea6d2b88ca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:01.821045 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c5def-806a-40af-b693-cea6d2b88ca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:01.822737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c5def-806a-40af-b693-cea6d2b88ca3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:01.841763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-658c5def-806a-40af-b693-cea6d2b88ca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:01.841763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:01.841763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:01.841763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:01.841763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:01.841763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:01.841763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:01.841763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:01.841763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:01.841763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:01.841763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:01.841763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:01.841763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:21:01.841763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:21:01.841763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:21:01.841763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:21:01.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:01.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:01.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:01.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:01.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:01.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:01.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:01.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:01.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:01.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:01.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:01.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:01.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:01.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:01.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:01.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:01.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:21:01.843931 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:21:01.843931 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:01.843931 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:21:01.843931 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 618/1215] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:01.850752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be7929-966b-4d4e-b159-e2e6444d5180 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:01.940984 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:01.999479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be7929-966b-4d4e-b159-e2e6444d5180 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:02.090610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c6ca4-5912-498c-80eb-aeef69d9aab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:02.091605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c6ca4-5912-498c-80eb-aeef69d9aab4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:02.091605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c6ca4-5912-498c-80eb-aeef69d9aab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:02.091605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c6ca4-5912-498c-80eb-aeef69d9aab4 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:02.093732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c6ca4-5912-498c-80eb-aeef69d9aab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:02.094225 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c6ca4-5912-498c-80eb-aeef69d9aab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:02.096813 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c6ca4-5912-498c-80eb-aeef69d9aab4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:02.123582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 598/1216] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:02.133091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c5def-806a-40af-b693-cea6d2b88ca3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:02.237099 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:02.283096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c5def-806a-40af-b693-cea6d2b88ca3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:02.343061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b92bb4-0bd0-4af1-a225-77ca76977e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:02.344139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b92bb4-0bd0-4af1-a225-77ca76977e4e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:02.346318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b92bb4-0bd0-4af1-a225-77ca76977e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:02.346318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b92bb4-0bd0-4af1-a225-77ca76977e4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:02.358442 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b92bb4-0bd0-4af1-a225-77ca76977e4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:02.361862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b92bb4-0bd0-4af1-a225-77ca76977e4e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:02.386837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-b4b92bb4-0bd0-4af1-a225-77ca76977e4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:21:02.386837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:02.386837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:02.386837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:02.386837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:02.386837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:02.386837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:02.386837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:02.386837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:02.386837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:02.386837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:02.386837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:02.386837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:21:02.386837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:21:02.386837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:21:02.387898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:21:02.387898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:02.387898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:02.387898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:02.387898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:02.387898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:02.387898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:02.387898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:02.387898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:02.387898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:02.387898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:02.387898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:02.387898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:02.387898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:02.387898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:02.387898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:02.387898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:02.388871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:21:02.388871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:21:02.388871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:21:02.388871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:21:02.388871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:21:02.388871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:21:02.388871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:21:02.388871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:21:02.389838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 619/1217] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:21:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:21:02.396893 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c6ca4-5912-498c-80eb-aeef69d9aab4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:02.545836 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c6ca4-5912-498c-80eb-aeef69d9aab4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:02.583686 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:02.599664 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89854feb-a000-4ac2-979e-7fa23e531e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:02.600547 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854feb-a000-4ac2-979e-7fa23e531e49 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:02.600983 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854feb-a000-4ac2-979e-7fa23e531e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:02.601463 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89854feb-a000-4ac2-979e-7fa23e531e49 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:02.604570 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89854feb-a000-4ac2-979e-7fa23e531e49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:02.604570 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89854feb-a000-4ac2-979e-7fa23e531e49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:02.604570 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89854feb-a000-4ac2-979e-7fa23e531e49 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:02.625074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 599/1218] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:21:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:02.635608 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b92bb4-0bd0-4af1-a225-77ca76977e4e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:02.790333 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b92bb4-0bd0-4af1-a225-77ca76977e4e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:02.829459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:02.839609 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa322c-5934-441b-b5a7-3b20f2c303e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:02.840502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa322c-5934-441b-b5a7-3b20f2c303e6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:02.840927 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa322c-5934-441b-b5a7-3b20f2c303e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:02.841328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa322c-5934-441b-b5a7-3b20f2c303e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:02.842476 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa322c-5934-441b-b5a7-3b20f2c303e6 None admin] RBAC: Adding query filter params (role.id=8352f2960aa74837804150f4c8774dbc, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=b8295272eec349f8aa38e44c861faa47) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:02.842937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa322c-5934-441b-b5a7-3b20f2c303e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:02.845240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa322c-5934-441b-b5a7-3b20f2c303e6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:02.869398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 620/1219] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:21:02 2022] GET /identity/v3/role_assignments?user.id=b8295272eec349f8aa38e44c861faa47&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=8352f2960aa74837804150f4c8774dbc => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:04.940074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae959649-b431-43dd-bcb6-06759c8e507c None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:04.940667 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae959649-b431-43dd-bcb6-06759c8e507c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:04.940779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae959649-b431-43dd-bcb6-06759c8e507c None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:04.942236 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 600/1220] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:21:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:21:04.948219 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0f86-1ea1-41e0-b205-07c5bc3486e9 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:04.948753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0f86-1ea1-41e0-b205-07c5bc3486e9 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:04.948753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0f86-1ea1-41e0-b205-07c5bc3486e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:04.971735 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-770f0f86-1ea1-41e0-b205-07c5bc3486e9 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:04.973534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-770f0f86-1ea1-41e0-b205-07c5bc3486e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:05.069867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 621/1221] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:21:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:21:05.362336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae959649-b431-43dd-bcb6-06759c8e507c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:05.507718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae959649-b431-43dd-bcb6-06759c8e507c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:05.569347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4164ec5-bf53-4c11-80ce-209309b0b617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:05.570480 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4164ec5-bf53-4c11-80ce-209309b0b617 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:05.570979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4164ec5-bf53-4c11-80ce-209309b0b617 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:05.571505 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4164ec5-bf53-4c11-80ce-209309b0b617 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:05.583950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4164ec5-bf53-4c11-80ce-209309b0b617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:21:05.589710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-c4164ec5-bf53-4c11-80ce-209309b0b617 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:21:05.589710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:05.589710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:05.589710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:05.589710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:05.589710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:05.589710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:05.589710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:05.589710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:05.589710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:05.589710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:05.589710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:05.589710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:21:05.589710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:21:05.589710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:21:05.589710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:21:05.590731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:21:05.590731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:21:05.590731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:21:05.590731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:21:05.590731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:05.590731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:05.590731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:05.590731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:05.590731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:05.590731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:05.590731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:05.590731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:05.590731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:05.590731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:05.590731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:05.590731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:05.591598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:05.591598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:05.591598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:05.591598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:05.591598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:21:05.591598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:21:05.591598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:21:05.591598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:21:05.591598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:21:05.591598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:21:05.591598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:21:05.591598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:05.591598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 601/1222] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:21:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:05.598606 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f0f86-1ea1-41e0-b205-07c5bc3486e9 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:05.746746 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f0f86-1ea1-41e0-b205-07c5bc3486e9 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:05.779330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:05.798510 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac1f1a-4b21-442e-bb38-3ddf4c76e0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:05.799139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac1f1a-4b21-442e-bb38-3ddf4c76e0be None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:05.799460 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac1f1a-4b21-442e-bb38-3ddf4c76e0be None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:05.799786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac1f1a-4b21-442e-bb38-3ddf4c76e0be None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:05.800491 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac1f1a-4b21-442e-bb38-3ddf4c76e0be None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:05.800901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac1f1a-4b21-442e-bb38-3ddf4c76e0be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:05.802309 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac1f1a-4b21-442e-bb38-3ddf4c76e0be None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:05.812163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 622/1223] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:21:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:05.818328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4164ec5-bf53-4c11-80ce-209309b0b617 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:05.871992 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:05.975690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4164ec5-bf53-4c11-80ce-209309b0b617 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:06.024448 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e908b4-8318-4930-90b8-90de2e3e3277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:06.025318 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e908b4-8318-4930-90b8-90de2e3e3277 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:06.025848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e908b4-8318-4930-90b8-90de2e3e3277 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:06.026310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e908b4-8318-4930-90b8-90de2e3e3277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:06.047606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e908b4-8318-4930-90b8-90de2e3e3277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:06.050309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e908b4-8318-4930-90b8-90de2e3e3277 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:06.068569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-b8e908b4-8318-4930-90b8-90de2e3e3277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:06.068569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:06.068569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:06.068569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:06.068569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:06.068569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:06.068569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:06.068569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:06.068569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:06.068569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:06.068569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:06.068569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:06.068569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:21:06.068569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:21:06.068569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:21:06.068569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:21:06.070392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:06.070392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:06.070392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:06.070392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:06.070392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:06.070392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:06.070392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:06.070392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:06.070392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:06.070392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:06.070392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:06.070392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:06.070392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:06.070392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:06.070392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:06.070392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:06.070392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:21:06.071730 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:21:06.071730 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:06.071730 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:06.071730 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 602/1224] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:06.076121 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac1f1a-4b21-442e-bb38-3ddf4c76e0be None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:06.202315 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac1f1a-4b21-442e-bb38-3ddf4c76e0be None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:06.244369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e4372-eca3-41d8-a5cf-83a6c9a2d8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:06.244973 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e4372-eca3-41d8-a5cf-83a6c9a2d8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:06.245250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e4372-eca3-41d8-a5cf-83a6c9a2d8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:06.245555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e4372-eca3-41d8-a5cf-83a6c9a2d8d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:06.246211 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e4372-eca3-41d8-a5cf-83a6c9a2d8d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:06.246512 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e4372-eca3-41d8-a5cf-83a6c9a2d8d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:06.247901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e4372-eca3-41d8-a5cf-83a6c9a2d8d1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:06.260817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 623/1225] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:06.266976 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e908b4-8318-4930-90b8-90de2e3e3277 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:06.422317 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:06.435476 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e908b4-8318-4930-90b8-90de2e3e3277 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:06.487313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24857d9-a558-4353-a386-5a3cc333f5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:06.487966 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24857d9-a558-4353-a386-5a3cc333f5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:06.488243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24857d9-a558-4353-a386-5a3cc333f5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:06.488514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24857d9-a558-4353-a386-5a3cc333f5c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:06.499997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24857d9-a558-4353-a386-5a3cc333f5c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:06.502199 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24857d9-a558-4353-a386-5a3cc333f5c4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:06.517792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-f24857d9-a558-4353-a386-5a3cc333f5c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:21:06.517792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:06.517792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:06.517792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:06.517792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:06.517792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:06.517792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:06.517792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:06.517792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:06.517792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:06.517792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:06.517792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:06.517792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:21:06.517792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:21:06.517792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:21:06.517792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:06.519328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:06.520530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:06.520530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:06.520530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:21:06.520530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:21:06.520530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:21:06.520530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:21:06.520530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:21:06.520530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:21:06.520530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:21:06.520530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:06.524815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 603/1226] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:06.526110 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e4372-eca3-41d8-a5cf-83a6c9a2d8d1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:06.599294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:06.671851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e4372-eca3-41d8-a5cf-83a6c9a2d8d1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:06.731212 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcf527-4fcb-48ec-a963-e46d200eb441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:06.731705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcf527-4fcb-48ec-a963-e46d200eb441 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:06.732035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcf527-4fcb-48ec-a963-e46d200eb441 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:06.732375 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcf527-4fcb-48ec-a963-e46d200eb441 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:06.733191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcf527-4fcb-48ec-a963-e46d200eb441 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:06.733597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcf527-4fcb-48ec-a963-e46d200eb441 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:06.735064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcf527-4fcb-48ec-a963-e46d200eb441 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:06.763544 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 624/1227] 10.222.0.52 () {56 vars in 1143 bytes} [Mon Aug 29 20:21:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:06.772703 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24857d9-a558-4353-a386-5a3cc333f5c4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:06.900420 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24857d9-a558-4353-a386-5a3cc333f5c4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:06.949314 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a745d-ebf1-4bed-83d3-e37ca9a285a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:06.950186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a745d-ebf1-4bed-83d3-e37ca9a285a3 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:06.951603 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a745d-ebf1-4bed-83d3-e37ca9a285a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:06.951603 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a745d-ebf1-4bed-83d3-e37ca9a285a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:06.964215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a745d-ebf1-4bed-83d3-e37ca9a285a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:06.965838 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a745d-ebf1-4bed-83d3-e37ca9a285a3 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:06.981227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-568a745d-ebf1-4bed-83d3-e37ca9a285a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:06.981227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:06.981227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:06.981227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:06.981227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:06.981227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:06.981227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:06.981227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:06.981227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:06.981227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:06.981227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:06.981227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:06.981227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:21:06.981227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:21:06.981227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:21:06.981227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:21:06.983293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:06.983293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:06.983293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:06.983293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:06.983293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:06.983293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:06.983293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:06.983293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:06.983293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:06.983293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:06.983293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:06.983293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:06.983293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:06.983293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:06.983293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:06.983293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:06.983293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:21:06.984479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:21:06.984479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:06.984479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:06.984479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 604/1228] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:06.989144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcf527-4fcb-48ec-a963-e46d200eb441 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:07.143326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcf527-4fcb-48ec-a963-e46d200eb441 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:07.147657 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:07.210637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f257a8c-9f07-41b5-ba42-f86417602cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:07.211565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f257a8c-9f07-41b5-ba42-f86417602cfc None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:07.211839 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f257a8c-9f07-41b5-ba42-f86417602cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:07.212197 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f257a8c-9f07-41b5-ba42-f86417602cfc None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:07.212927 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f257a8c-9f07-41b5-ba42-f86417602cfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:07.213164 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f257a8c-9f07-41b5-ba42-f86417602cfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:07.214699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f257a8c-9f07-41b5-ba42-f86417602cfc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:07.229556 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 625/1229] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:07.238957 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a745d-ebf1-4bed-83d3-e37ca9a285a3 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:07.250809 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:07.390291 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a745d-ebf1-4bed-83d3-e37ca9a285a3 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:07.438200 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27132e4f-459e-46f9-8798-3c6002977aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:07.439250 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27132e4f-459e-46f9-8798-3c6002977aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:07.439683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27132e4f-459e-46f9-8798-3c6002977aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:07.440089 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27132e4f-459e-46f9-8798-3c6002977aa6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:07.453164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27132e4f-459e-46f9-8798-3c6002977aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:07.456467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27132e4f-459e-46f9-8798-3c6002977aa6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:07.475105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-27132e4f-459e-46f9-8798-3c6002977aa6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:21:07.475105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:07.475105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:07.475105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:07.475105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:07.475105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:07.475105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:07.475105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:07.475105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:07.475105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:07.475105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:07.475105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:07.475105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:21:07.475105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:21:07.475105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:21:07.476782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:21:07.476782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:07.476782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:07.476782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:07.476782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:07.476782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:07.476782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:07.476782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:07.476782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:07.476782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:07.476782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:07.476782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:07.476782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:07.476782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:07.476782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:07.476782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:07.476782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:07.478849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:21:07.478849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:21:07.478849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:21:07.478849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:21:07.478849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:21:07.478849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:21:07.478849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:21:07.478849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:07.478849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 605/1230] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:21:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:07.483223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f257a8c-9f07-41b5-ba42-f86417602cfc None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:07.643540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f257a8c-9f07-41b5-ba42-f86417602cfc None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:07.694434 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281535d-87a0-4775-9ace-49ad01607733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:07.695460 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281535d-87a0-4775-9ace-49ad01607733 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:07.695938 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281535d-87a0-4775-9ace-49ad01607733 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:07.696408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281535d-87a0-4775-9ace-49ad01607733 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:07.697701 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281535d-87a0-4775-9ace-49ad01607733 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:07.698311 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281535d-87a0-4775-9ace-49ad01607733 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:07.700993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281535d-87a0-4775-9ace-49ad01607733 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:07.728707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 626/1231] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:21:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:07.737277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27132e4f-459e-46f9-8798-3c6002977aa6 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:07.834113 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:07.887932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27132e4f-459e-46f9-8798-3c6002977aa6 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:07.942649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc5b4c-8dca-4e5b-b3f2-6247e1787bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:07.943401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc5b4c-8dca-4e5b-b3f2-6247e1787bf8 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:07.943686 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc5b4c-8dca-4e5b-b3f2-6247e1787bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:07.943948 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc5b4c-8dca-4e5b-b3f2-6247e1787bf8 None admin] PATH_INFO: `/v3/projects/03ca2c70c46a477494884c9997540861/users/b8295272eec349f8aa38e44c861faa47/roles/8352f2960aa74837804150f4c8774dbc` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:07.968659 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc5b4c-8dca-4e5b-b3f2-6247e1787bf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=03ca2c70c46a477494884c9997540861, user_id=b8295272eec349f8aa38e44c861faa47, role_id=8352f2960aa74837804150f4c8774dbc)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:07.970218 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc5b4c-8dca-4e5b-b3f2-6247e1787bf8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:07.988752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 606/1232] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:21:07 2022] PUT /identity/v3/projects/03ca2c70c46a477494884c9997540861/users/b8295272eec349f8aa38e44c861faa47/roles/8352f2960aa74837804150f4c8774dbc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:10.105672 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9e58a-5a9f-4980-ad0e-02cdd1ac9d5c None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:10.106257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9e58a-5a9f-4980-ad0e-02cdd1ac9d5c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:10.106257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9e58a-5a9f-4980-ad0e-02cdd1ac9d5c None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:10.107681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 627/1233] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:21:10.114286 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5b81f-c4a9-4798-9c1e-e67768beaa3a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:10.115254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5b81f-c4a9-4798-9c1e-e67768beaa3a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:10.115254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5b81f-c4a9-4798-9c1e-e67768beaa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:10.140196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-93d5b81f-c4a9-4798-9c1e-e67768beaa3a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:10.141605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-93d5b81f-c4a9-4798-9c1e-e67768beaa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:10.245497 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 607/1234] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:21:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:21:10.532629 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9e58a-5a9f-4980-ad0e-02cdd1ac9d5c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:10.576972 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:10.694113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9e58a-5a9f-4980-ad0e-02cdd1ac9d5c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:10.756382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17501797-d43c-4151-8221-79d729cc6ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:10.756382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17501797-d43c-4151-8221-79d729cc6ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:10.756382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17501797-d43c-4151-8221-79d729cc6ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:10.756382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17501797-d43c-4151-8221-79d729cc6ed9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:10.774331 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17501797-d43c-4151-8221-79d729cc6ed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:21:10.783424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-17501797-d43c-4151-8221-79d729cc6ed9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:21:10.783424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:10.783424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:10.783424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:10.783424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:10.783424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:10.783424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:10.783424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:10.783424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:10.783424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:10.783424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:10.783424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:10.783424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:21:10.783424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:21:10.783424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:21:10.783424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:21:10.784732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:21:10.784732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:21:10.784732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:21:10.784732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:21:10.784732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:10.784732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:10.784732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:10.784732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:10.784732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:10.784732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:10.784732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:10.784732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:10.784732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:10.784732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:10.784732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:10.784732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:10.785721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:10.785721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:10.785721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:10.785721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:10.785721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:21:10.785721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:21:10.785721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:21:10.785721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:21:10.785721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:21:10.785721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:21:10.785721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:21:10.785721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:21:10.785721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 628/1235] 10.222.0.52 () {56 vars in 1102 bytes} [Mon Aug 29 20:21:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:10.792140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5b81f-c4a9-4798-9c1e-e67768beaa3a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:10.846585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:10.912661 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5b81f-c4a9-4798-9c1e-e67768beaa3a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:10.972608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd6c44-d507-4663-a2d5-ac5cf718483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:10.973690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd6c44-d507-4663-a2d5-ac5cf718483a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:10.974182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd6c44-d507-4663-a2d5-ac5cf718483a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:10.974663 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd6c44-d507-4663-a2d5-ac5cf718483a None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:10.975854 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd6c44-d507-4663-a2d5-ac5cf718483a None admin] RBAC: Adding query filter params (name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:10.976378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd6c44-d507-4663-a2d5-ac5cf718483a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:10.978966 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd6c44-d507-4663-a2d5-ac5cf718483a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:10.999596 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 608/1236] 10.222.0.52 () {56 vars in 1103 bytes} [Mon Aug 29 20:21:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:11.001238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17501797-d43c-4151-8221-79d729cc6ed9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:11.135573 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:11.158488 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17501797-d43c-4151-8221-79d729cc6ed9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:11.210795 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184836c-58ca-4956-a20a-2a8a47c58e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:11.211705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184836c-58ca-4956-a20a-2a8a47c58e4e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:11.212076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184836c-58ca-4956-a20a-2a8a47c58e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:11.212542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184836c-58ca-4956-a20a-2a8a47c58e4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:11.232220 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184836c-58ca-4956-a20a-2a8a47c58e4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:11.234919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184836c-58ca-4956-a20a-2a8a47c58e4e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:11.258347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-8184836c-58ca-4956-a20a-2a8a47c58e4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:11.258347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:11.258347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:11.258347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:11.258347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:11.258347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:11.258347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:11.258347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:11.258347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:11.258347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:11.258347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:11.258347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:11.258347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:21:11.258347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:21:11.258347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:21:11.258347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:21:11.260358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:11.260358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:11.260358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:11.260358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:11.260358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:11.260358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:11.260358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:11.260358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:11.260358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:11.260358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:11.260358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:11.260358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:11.260358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:11.260358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:11.260358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:11.260358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:11.260358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:21:11.262292 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:21:11.262292 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:11.262292 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:21:11.262292 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 629/1237] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:11.265491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd6c44-d507-4663-a2d5-ac5cf718483a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:11.418513 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd6c44-d507-4663-a2d5-ac5cf718483a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:11.433350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:11.466486 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c27e1-052d-4459-a7eb-daa2da0f9353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:11.467100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c27e1-052d-4459-a7eb-daa2da0f9353 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:11.467385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c27e1-052d-4459-a7eb-daa2da0f9353 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:11.467650 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c27e1-052d-4459-a7eb-daa2da0f9353 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:11.468299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c27e1-052d-4459-a7eb-daa2da0f9353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:11.468622 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c27e1-052d-4459-a7eb-daa2da0f9353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:11.470193 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c27e1-052d-4459-a7eb-daa2da0f9353 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:11.483736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 609/1238] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:11.489859 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184836c-58ca-4956-a20a-2a8a47c58e4e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:11.615180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184836c-58ca-4956-a20a-2a8a47c58e4e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:11.658474 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c9888-30bc-4dd2-8384-dec6cc35a603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:11.659137 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c9888-30bc-4dd2-8384-dec6cc35a603 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:11.659403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c9888-30bc-4dd2-8384-dec6cc35a603 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:11.659665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c9888-30bc-4dd2-8384-dec6cc35a603 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:11.662779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:11.672484 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c9888-30bc-4dd2-8384-dec6cc35a603 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:11.675320 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c9888-30bc-4dd2-8384-dec6cc35a603 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:11.693451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-bb8c9888-30bc-4dd2-8384-dec6cc35a603 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:21:11.693451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:11.693451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:11.693451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:11.693451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:11.693451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:11.693451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:11.693451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:11.693451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:11.693451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:11.693451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:11.693451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:11.693451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:21:11.693451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:21:11.693451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:21:11.693451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:11.694791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:11.696635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:11.696635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:11.696635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:21:11.696635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:21:11.696635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:21:11.696635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:21:11.696635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:21:11.696635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:21:11.696635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:21:11.696635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:21:11.696635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 630/1239] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:11.705898 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c27e1-052d-4459-a7eb-daa2da0f9353 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:11.848786 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c27e1-052d-4459-a7eb-daa2da0f9353 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:11.897583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40528b01-1e1b-48bf-b7ff-6ba81c181466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:11.898388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40528b01-1e1b-48bf-b7ff-6ba81c181466 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:11.898754 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40528b01-1e1b-48bf-b7ff-6ba81c181466 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:11.899220 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40528b01-1e1b-48bf-b7ff-6ba81c181466 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:11.900088 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40528b01-1e1b-48bf-b7ff-6ba81c181466 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:11.900477 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40528b01-1e1b-48bf-b7ff-6ba81c181466 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:11.902566 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40528b01-1e1b-48bf-b7ff-6ba81c181466 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:11.934825 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 610/1240] 10.222.0.52 () {56 vars in 1143 bytes} [Mon Aug 29 20:21:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:11.936779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c9888-30bc-4dd2-8384-dec6cc35a603 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:12.089102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c9888-30bc-4dd2-8384-dec6cc35a603 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:12.127213 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81465b32-e87c-4f4b-9e74-cfd6e4f19815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:12.128329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81465b32-e87c-4f4b-9e74-cfd6e4f19815 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:12.128329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81465b32-e87c-4f4b-9e74-cfd6e4f19815 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:12.128650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81465b32-e87c-4f4b-9e74-cfd6e4f19815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:12.207626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:12.218930 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81465b32-e87c-4f4b-9e74-cfd6e4f19815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:12.222090 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81465b32-e87c-4f4b-9e74-cfd6e4f19815 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:12.363857 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 631/1241] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:21:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 20:21:12.370826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40528b01-1e1b-48bf-b7ff-6ba81c181466 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:12.410257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:12.514763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40528b01-1e1b-48bf-b7ff-6ba81c181466 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:12.569199 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01143c3-d896-48bc-8f56-382415c5f76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:12.570278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01143c3-d896-48bc-8f56-382415c5f76e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:12.570626 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01143c3-d896-48bc-8f56-382415c5f76e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:12.571084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01143c3-d896-48bc-8f56-382415c5f76e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:12.589433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01143c3-d896-48bc-8f56-382415c5f76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:12.591183 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01143c3-d896-48bc-8f56-382415c5f76e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:12.608294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-b01143c3-d896-48bc-8f56-382415c5f76e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:12.608294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:12.608294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:12.608294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:12.608294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:12.608294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:12.608294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:12.608294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:12.608294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:12.608294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:12.608294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:12.608294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:12.608294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:21:12.608294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:21:12.608294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:21:12.608294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:21:12.609549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:12.609549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:12.609549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:12.609549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:12.609549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:12.609549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:12.609549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:12.609549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:12.609549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:12.609549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:12.609549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:12.609549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:12.609549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:12.609549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:12.609549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:12.609549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:12.609549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:21:12.610528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:21:12.610528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:12.610528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:12.610528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 611/1242] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:12.615953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81465b32-e87c-4f4b-9e74-cfd6e4f19815 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:12.763204 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:12.769421 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81465b32-e87c-4f4b-9e74-cfd6e4f19815 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:12.817875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46d936-c5a6-4917-a243-55942c2be47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:12.818928 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46d936-c5a6-4917-a243-55942c2be47f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:12.819221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46d936-c5a6-4917-a243-55942c2be47f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:12.819503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46d936-c5a6-4917-a243-55942c2be47f None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:12.820225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46d936-c5a6-4917-a243-55942c2be47f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:12.820811 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46d936-c5a6-4917-a243-55942c2be47f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:12.823523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46d936-c5a6-4917-a243-55942c2be47f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:12.843436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 632/1243] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:21:12.850927 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01143c3-d896-48bc-8f56-382415c5f76e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:12.950865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:12.979178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01143c3-d896-48bc-8f56-382415c5f76e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:13.029970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc50ed9-fa2c-49cd-84f9-9c7078510ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:13.030538 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc50ed9-fa2c-49cd-84f9-9c7078510ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:13.030809 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc50ed9-fa2c-49cd-84f9-9c7078510ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:13.031091 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc50ed9-fa2c-49cd-84f9-9c7078510ed8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:13.039869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc50ed9-fa2c-49cd-84f9-9c7078510ed8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:13.041500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc50ed9-fa2c-49cd-84f9-9c7078510ed8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:13.055017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-bfc50ed9-fa2c-49cd-84f9-9c7078510ed8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:21:13.055017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:13.055017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:13.055017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:13.055017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:13.055017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:13.055017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:13.055017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:13.055017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:13.055017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:13.055017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:13.055017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:13.055017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:21:13.055017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:21:13.055017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:21:13.056022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:21:13.056022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:13.056022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:13.056022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:13.056022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:13.056022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:13.056022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:13.056022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:13.056022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:13.056022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:13.056022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:13.056022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:13.056022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:13.056022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:13.056022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:13.056022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:13.056022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:13.057310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:21:13.057310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:21:13.057310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:21:13.057310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:21:13.057310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:21:13.057310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:21:13.057310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:21:13.057310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:13.057310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 612/1244] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:21:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:21:13.065552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46d936-c5a6-4917-a243-55942c2be47f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:13.206956 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46d936-c5a6-4917-a243-55942c2be47f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:13.255435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e756f41-7057-4b8d-8465-9e02553ed061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:13.256152 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e756f41-7057-4b8d-8465-9e02553ed061 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:13.256464 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e756f41-7057-4b8d-8465-9e02553ed061 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:13.256910 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e756f41-7057-4b8d-8465-9e02553ed061 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:13.258221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e756f41-7057-4b8d-8465-9e02553ed061 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:13.258754 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e756f41-7057-4b8d-8465-9e02553ed061 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:13.261381 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e756f41-7057-4b8d-8465-9e02553ed061 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:13.277508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 633/1245] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:21:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:13.284753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc50ed9-fa2c-49cd-84f9-9c7078510ed8 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:13.418691 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc50ed9-fa2c-49cd-84f9-9c7078510ed8 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:13.461862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b01f5-720d-470c-80bb-f69ec143ab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:13.462592 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b01f5-720d-470c-80bb-f69ec143ab0c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:13.462911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b01f5-720d-470c-80bb-f69ec143ab0c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:13.463262 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b01f5-720d-470c-80bb-f69ec143ab0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:13.464088 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b01f5-720d-470c-80bb-f69ec143ab0c None admin] RBAC: Adding query filter params (role.id=8352f2960aa74837804150f4c8774dbc, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=b8295272eec349f8aa38e44c861faa47) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:13.464516 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b01f5-720d-470c-80bb-f69ec143ab0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:13.466133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b01f5-720d-470c-80bb-f69ec143ab0c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:13.473669 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 613/1246] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:21:13 2022] GET /identity/v3/role_assignments?user.id=b8295272eec349f8aa38e44c861faa47&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=8352f2960aa74837804150f4c8774dbc => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:16.036398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a64177-3c56-4d57-9069-496630fc6511 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:16.037743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a64177-3c56-4d57-9069-496630fc6511 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:16.037743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a64177-3c56-4d57-9069-496630fc6511 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:16.038959 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 634/1247] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:21:16.047682 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cd262-2055-4eff-a9c7-e7def8ed859e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:16.048368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cd262-2055-4eff-a9c7-e7def8ed859e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:16.048675 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cd262-2055-4eff-a9c7-e7def8ed859e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:16.058607 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:16.083315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-8b4cd262-2055-4eff-a9c7-e7def8ed859e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:16.085749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8b4cd262-2055-4eff-a9c7-e7def8ed859e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:16.228745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 614/1248] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:21:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:21:16.648428 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a64177-3c56-4d57-9069-496630fc6511 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:16.688040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:16.801750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a64177-3c56-4d57-9069-496630fc6511 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:16.852708 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44087bb2-4c25-4aae-a29f-db88bcfdd8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:16.853618 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44087bb2-4c25-4aae-a29f-db88bcfdd8de None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:16.853988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44087bb2-4c25-4aae-a29f-db88bcfdd8de None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:16.854316 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44087bb2-4c25-4aae-a29f-db88bcfdd8de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:16.867323 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44087bb2-4c25-4aae-a29f-db88bcfdd8de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:21:16.872366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-44087bb2-4c25-4aae-a29f-db88bcfdd8de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:21:16.872366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:16.872366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:16.872366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:16.872366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:16.872366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:16.872366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:16.872366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:16.872366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:16.872366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:16.872366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:16.872366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:16.872366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:21:16.872366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:21:16.872366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:21:16.872366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:21:16.873615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:21:16.873615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:21:16.873615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:21:16.873615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:21:16.873615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:16.873615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:16.873615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:16.873615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:16.873615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:16.873615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:16.873615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:16.873615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:16.873615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:16.873615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:16.873615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:16.873615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:16.874631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:16.874631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:16.874631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:16.874631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:16.874631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:21:16.874631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:21:16.874631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:21:16.874631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:21:16.874631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:21:16.874631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:21:16.874631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:21:16.874631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:21:16.874631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 635/1249] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:21:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:16.882672 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cd262-2055-4eff-a9c7-e7def8ed859e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:17.036167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cd262-2055-4eff-a9c7-e7def8ed859e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:17.082178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:17.089869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2491b-dd1d-445e-b040-ad866134e2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:17.090596 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2491b-dd1d-445e-b040-ad866134e2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:17.090922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2491b-dd1d-445e-b040-ad866134e2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:17.091226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2491b-dd1d-445e-b040-ad866134e2b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:17.091971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2491b-dd1d-445e-b040-ad866134e2b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:17.092318 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2491b-dd1d-445e-b040-ad866134e2b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:17.094008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2491b-dd1d-445e-b040-ad866134e2b9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:17.107398 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 615/1250] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:21:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:17.113462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44087bb2-4c25-4aae-a29f-db88bcfdd8de None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:17.239668 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:17.275130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44087bb2-4c25-4aae-a29f-db88bcfdd8de None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:17.325139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce8b10-8363-4c41-ae0e-3ce7042dc093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:17.326170 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce8b10-8363-4c41-ae0e-3ce7042dc093 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:17.326634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce8b10-8363-4c41-ae0e-3ce7042dc093 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:17.327128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce8b10-8363-4c41-ae0e-3ce7042dc093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:17.346071 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce8b10-8363-4c41-ae0e-3ce7042dc093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:17.348740 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce8b10-8363-4c41-ae0e-3ce7042dc093 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:17.369276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-49ce8b10-8363-4c41-ae0e-3ce7042dc093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:17.369276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:17.369276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:17.369276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:17.369276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:17.369276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:17.369276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:17.369276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:17.369276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:17.369276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:17.369276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:17.369276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:17.369276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:21:17.369276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:21:17.369276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:21:17.369276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:21:17.371497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:17.371497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:17.371497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:17.371497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:17.371497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:17.371497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:17.371497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:17.371497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:17.371497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:17.371497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:17.371497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:17.371497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:17.371497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:17.371497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:17.371497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:17.371497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:17.371497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:21:17.373459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:21:17.373459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:17.373459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:21:17.373459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 636/1251] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:17.379070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2491b-dd1d-445e-b040-ad866134e2b9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:17.549392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2491b-dd1d-445e-b040-ad866134e2b9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:17.608035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b6213-4f3d-4b52-8232-fa7d59f2e82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:17.608787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b6213-4f3d-4b52-8232-fa7d59f2e82f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:17.609067 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b6213-4f3d-4b52-8232-fa7d59f2e82f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:17.609472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b6213-4f3d-4b52-8232-fa7d59f2e82f None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:17.610350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b6213-4f3d-4b52-8232-fa7d59f2e82f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:17.610694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b6213-4f3d-4b52-8232-fa7d59f2e82f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:17.612587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b6213-4f3d-4b52-8232-fa7d59f2e82f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:17.627636 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 616/1252] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:17.634829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce8b10-8363-4c41-ae0e-3ce7042dc093 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:17.793618 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce8b10-8363-4c41-ae0e-3ce7042dc093 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:17.840346 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:17.861806 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85908fad-1958-4903-b7d0-a9bce5e4325a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:17.862585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85908fad-1958-4903-b7d0-a9bce5e4325a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:17.862952 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85908fad-1958-4903-b7d0-a9bce5e4325a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:17.863146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85908fad-1958-4903-b7d0-a9bce5e4325a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:17.876814 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85908fad-1958-4903-b7d0-a9bce5e4325a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:17.879430 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85908fad-1958-4903-b7d0-a9bce5e4325a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:17.896824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-85908fad-1958-4903-b7d0-a9bce5e4325a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:21:17.896824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:17.896824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:17.896824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:17.896824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:17.896824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:17.896824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:17.896824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:17.896824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:17.896824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:17.896824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:17.896824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:17.896824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:21:17.896824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:21:17.896824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:21:17.896824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:17.906271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:17.908745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:17.908745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:17.908745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:21:17.908745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:21:17.908745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:21:17.908745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:21:17.908745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:21:17.908745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:21:17.908745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:21:17.908745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:21:17.908745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 637/1253] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:17.910772 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b6213-4f3d-4b52-8232-fa7d59f2e82f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:17.989932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:18.080867 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b6213-4f3d-4b52-8232-fa7d59f2e82f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:18.151312 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab6b8e-a5e7-44b1-b7bd-341c29175873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:18.152386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab6b8e-a5e7-44b1-b7bd-341c29175873 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:18.152386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab6b8e-a5e7-44b1-b7bd-341c29175873 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:18.152386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab6b8e-a5e7-44b1-b7bd-341c29175873 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:18.154677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab6b8e-a5e7-44b1-b7bd-341c29175873 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:18.155113 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab6b8e-a5e7-44b1-b7bd-341c29175873 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:18.157249 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab6b8e-a5e7-44b1-b7bd-341c29175873 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:18.179253 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 617/1254] 10.222.0.52 () {56 vars in 1143 bytes} [Mon Aug 29 20:21:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:18.187517 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85908fad-1958-4903-b7d0-a9bce5e4325a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:18.336373 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85908fad-1958-4903-b7d0-a9bce5e4325a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:18.391378 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b769c85-5bb1-4f5d-8ab2-0c84b4f1c40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:18.392235 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b769c85-5bb1-4f5d-8ab2-0c84b4f1c40f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:18.392615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b769c85-5bb1-4f5d-8ab2-0c84b4f1c40f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:18.392889 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b769c85-5bb1-4f5d-8ab2-0c84b4f1c40f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:18.484293 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:18.509816 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b769c85-5bb1-4f5d-8ab2-0c84b4f1c40f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:18.511335 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b769c85-5bb1-4f5d-8ab2-0c84b4f1c40f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:18.674462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 638/1255] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:21:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:21:18.681802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab6b8e-a5e7-44b1-b7bd-341c29175873 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:18.857570 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab6b8e-a5e7-44b1-b7bd-341c29175873 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:18.883325 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:18.918788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24573d5b-65bd-45c9-ab87-76b64b4e4cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:18.919892 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24573d5b-65bd-45c9-ab87-76b64b4e4cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:18.920345 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24573d5b-65bd-45c9-ab87-76b64b4e4cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:18.920787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24573d5b-65bd-45c9-ab87-76b64b4e4cd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:18.945788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24573d5b-65bd-45c9-ab87-76b64b4e4cd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:18.947435 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24573d5b-65bd-45c9-ab87-76b64b4e4cd4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:18.967245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-24573d5b-65bd-45c9-ab87-76b64b4e4cd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:18.967245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:18.967245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:18.967245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:18.967245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:18.967245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:18.967245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:18.967245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:18.967245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:18.967245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:18.967245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:18.967245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:18.967245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:21:18.967245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:21:18.967245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:21:18.967245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:21:18.969279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:18.969279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:18.969279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:18.969279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:18.969279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:18.969279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:18.969279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:18.969279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:18.969279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:18.969279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:18.969279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:18.969279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:18.969279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:18.969279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:18.969279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:18.969279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:18.969279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:21:18.970384 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:21:18.970384 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:18.970384 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:18.970384 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 618/1256] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:18.974723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b769c85-5bb1-4f5d-8ab2-0c84b4f1c40f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:19.105081 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:19.122887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b769c85-5bb1-4f5d-8ab2-0c84b4f1c40f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:19.181389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a93cb-2627-4f54-92c4-721bf5e27628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:19.182417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a93cb-2627-4f54-92c4-721bf5e27628 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:19.182902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a93cb-2627-4f54-92c4-721bf5e27628 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:19.183389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a93cb-2627-4f54-92c4-721bf5e27628 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:19.185089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a93cb-2627-4f54-92c4-721bf5e27628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:19.185609 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a93cb-2627-4f54-92c4-721bf5e27628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:19.188037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a93cb-2627-4f54-92c4-721bf5e27628 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:19.215080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 639/1257] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:21:19.216368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24573d5b-65bd-45c9-ab87-76b64b4e4cd4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:19.368894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24573d5b-65bd-45c9-ab87-76b64b4e4cd4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:19.423184 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5f175-be62-452a-ba00-89603dbe8ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:19.423889 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5f175-be62-452a-ba00-89603dbe8ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:19.424217 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5f175-be62-452a-ba00-89603dbe8ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:19.424525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5f175-be62-452a-ba00-89603dbe8ca8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:19.434671 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5f175-be62-452a-ba00-89603dbe8ca8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:19.436312 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5f175-be62-452a-ba00-89603dbe8ca8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:19.453749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-54e5f175-be62-452a-ba00-89603dbe8ca8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:21:19.453749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:19.453749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:19.453749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:19.453749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:19.453749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:19.453749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:19.453749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:19.453749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:19.453749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:19.453749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:19.453749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:19.453749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:21:19.453749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:21:19.453749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:21:19.455591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:21:19.455591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:19.455591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:19.455591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:19.455591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:19.455591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:19.455591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:19.455591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:19.455591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:19.455591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:19.455591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:19.455591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:19.455591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:19.455591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:19.455591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:19.455591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:19.455591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:19.456843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:21:19.456843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:21:19.456843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:21:19.456843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:21:19.456843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:21:19.456843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:21:19.456843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:21:19.456843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:19.456843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 619/1258] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:21:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:19.462161 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a93cb-2627-4f54-92c4-721bf5e27628 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:19.610726 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a93cb-2627-4f54-92c4-721bf5e27628 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:19.664828 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c32ea-cd88-4596-ac98-a6817bc11821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:19.665708 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c32ea-cd88-4596-ac98-a6817bc11821 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:19.666017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c32ea-cd88-4596-ac98-a6817bc11821 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:19.666302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c32ea-cd88-4596-ac98-a6817bc11821 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:19.667109 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c32ea-cd88-4596-ac98-a6817bc11821 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:19.667526 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c32ea-cd88-4596-ac98-a6817bc11821 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:19.669258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c32ea-cd88-4596-ac98-a6817bc11821 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:19.697194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5f175-be62-452a-ba00-89603dbe8ca8 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:19.697956 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 640/1259] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:21:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:19.743105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:19.878657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5f175-be62-452a-ba00-89603dbe8ca8 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:19.952845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d044a3-518e-4647-8deb-4f96d7a343d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:19.954195 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d044a3-518e-4647-8deb-4f96d7a343d5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:19.954694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d044a3-518e-4647-8deb-4f96d7a343d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:19.955175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d044a3-518e-4647-8deb-4f96d7a343d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:19.956544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d044a3-518e-4647-8deb-4f96d7a343d5 None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=b8295272eec349f8aa38e44c861faa47) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:19.957111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d044a3-518e-4647-8deb-4f96d7a343d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:19.959951 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d044a3-518e-4647-8deb-4f96d7a343d5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:19.971525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 620/1260] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:21:19 2022] GET /identity/v3/role_assignments?user.id=b8295272eec349f8aa38e44c861faa47&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:21:21.999360 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb31f13-44be-484e-8254-3b112f1585be None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:21.999922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb31f13-44be-484e-8254-3b112f1585be None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:21.999922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb31f13-44be-484e-8254-3b112f1585be None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:22.001290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 641/1261] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:21:22.006854 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1410a26-b968-4620-a7b6-334690b5ec96 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:22.007306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1410a26-b968-4620-a7b6-334690b5ec96 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:22.007405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1410a26-b968-4620-a7b6-334690b5ec96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:22.026333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b1410a26-b968-4620-a7b6-334690b5ec96 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:22.027540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b1410a26-b968-4620-a7b6-334690b5ec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:22.100880 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 621/1262] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:21:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:21:22.374546 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb31f13-44be-484e-8254-3b112f1585be None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:22.386557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:22.490043 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb31f13-44be-484e-8254-3b112f1585be None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:22.525859 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6549f-30db-4349-8184-b88a75519984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:22.526498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6549f-30db-4349-8184-b88a75519984 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:22.526774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6549f-30db-4349-8184-b88a75519984 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:22.527042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6549f-30db-4349-8184-b88a75519984 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:22.538196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6549f-30db-4349-8184-b88a75519984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:21:22.543057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-aeb6549f-30db-4349-8184-b88a75519984 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:21:22.543057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:22.543057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:22.543057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:22.543057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:22.543057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:22.543057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:22.543057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:22.543057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:22.543057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:22.543057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:22.543057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:22.543057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:21:22.543057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:21:22.543057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:21:22.543057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:21:22.544751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:21:22.544751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:21:22.544751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:21:22.544751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:21:22.544751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:22.544751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:22.544751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:22.544751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:22.544751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:22.544751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:22.544751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:22.544751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:22.544751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:22.544751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:22.544751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:22.544751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:22.546307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:22.546307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:22.546307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:22.546307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:22.546307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:21:22.546307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:21:22.546307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:21:22.546307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:21:22.546307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:21:22.546307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:21:22.546307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:21:22.546307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:21:22.546307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 642/1263] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:21:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:21:22.550812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1410a26-b968-4620-a7b6-334690b5ec96 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:22.571054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:22.679247 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1410a26-b968-4620-a7b6-334690b5ec96 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:22.726905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85acdf-f80d-470f-8d78-1faed493115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:22.727524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85acdf-f80d-470f-8d78-1faed493115f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:22.727801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85acdf-f80d-470f-8d78-1faed493115f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:22.728073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85acdf-f80d-470f-8d78-1faed493115f None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:22.728748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85acdf-f80d-470f-8d78-1faed493115f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:22.729054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85acdf-f80d-470f-8d78-1faed493115f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:22.730486 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85acdf-f80d-470f-8d78-1faed493115f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:22.750460 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 622/1264] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:21:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:22.760220 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6549f-30db-4349-8184-b88a75519984 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:22.838981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:22.874817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6549f-30db-4349-8184-b88a75519984 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:22.910752 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e513bd-dd07-4f2c-bba9-28e7206dc2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:22.911381 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e513bd-dd07-4f2c-bba9-28e7206dc2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:22.911685 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e513bd-dd07-4f2c-bba9-28e7206dc2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:22.911960 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e513bd-dd07-4f2c-bba9-28e7206dc2d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:22.923011 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e513bd-dd07-4f2c-bba9-28e7206dc2d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:22.924474 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e513bd-dd07-4f2c-bba9-28e7206dc2d5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:22.939737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-22e513bd-dd07-4f2c-bba9-28e7206dc2d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:22.939737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:22.939737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:22.939737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:22.939737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:22.939737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:22.939737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:22.939737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:22.939737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:22.939737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:22.939737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:22.939737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:22.939737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:21:22.939737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:21:22.939737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:21:22.939737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:21:22.940864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:22.940864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:22.940864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:22.940864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:22.940864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:22.940864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:22.940864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:22.940864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:22.940864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:22.940864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:22.940864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:22.940864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:22.940864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:22.940864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:22.940864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:22.940864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:22.940864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:21:22.941943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:21:22.941943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:22.941943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:21:22.941943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 643/1265] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:22.946738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85acdf-f80d-470f-8d78-1faed493115f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:23.040310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:23.061470 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85acdf-f80d-470f-8d78-1faed493115f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:23.098096 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431ad17-46c9-4831-a779-fe8686e6df3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:23.098737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431ad17-46c9-4831-a779-fe8686e6df3f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:23.099018 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431ad17-46c9-4831-a779-fe8686e6df3f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:23.099290 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431ad17-46c9-4831-a779-fe8686e6df3f None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:23.099940 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431ad17-46c9-4831-a779-fe8686e6df3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:23.100248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431ad17-46c9-4831-a779-fe8686e6df3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:23.101649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431ad17-46c9-4831-a779-fe8686e6df3f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:23.115207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 623/1266] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:23.124048 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e513bd-dd07-4f2c-bba9-28e7206dc2d5 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:23.234970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e513bd-dd07-4f2c-bba9-28e7206dc2d5 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:23.255074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:23.270290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c3282-ca3f-4ec0-9566-372dd487affd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:23.270933 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c3282-ca3f-4ec0-9566-372dd487affd None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:23.271212 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c3282-ca3f-4ec0-9566-372dd487affd None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:23.271484 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c3282-ca3f-4ec0-9566-372dd487affd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:23.279921 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c3282-ca3f-4ec0-9566-372dd487affd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:23.281387 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c3282-ca3f-4ec0-9566-372dd487affd None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:23.292583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-af2c3282-ca3f-4ec0-9566-372dd487affd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:21:23.292583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:23.292583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:23.292583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:23.292583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:23.292583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:23.292583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:23.292583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:23.292583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:23.292583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:23.292583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:23.292583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:23.292583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:21:23.292583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:21:23.292583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:21:23.292583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:23.293742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:23.294841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:23.294841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:23.294841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:21:23.294841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:21:23.294841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:21:23.294841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:21:23.294841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:21:23.294841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:21:23.294841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:21:23.294841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:21:23.294841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 644/1267] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:23.300049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431ad17-46c9-4831-a779-fe8686e6df3f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:23.416369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431ad17-46c9-4831-a779-fe8686e6df3f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:23.455439 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8f23b-181d-48e3-bae1-0593842d9562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:23.456056 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8f23b-181d-48e3-bae1-0593842d9562 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:23.456382 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8f23b-181d-48e3-bae1-0593842d9562 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:23.456653 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8f23b-181d-48e3-bae1-0593842d9562 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:23.457423 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8f23b-181d-48e3-bae1-0593842d9562 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:23.457703 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8f23b-181d-48e3-bae1-0593842d9562 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:23.459124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8f23b-181d-48e3-bae1-0593842d9562 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:23.468601 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:23.481908 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 624/1268] 10.222.0.52 () {56 vars in 1143 bytes} [Mon Aug 29 20:21:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:23.488176 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c3282-ca3f-4ec0-9566-372dd487affd None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:23.592427 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c3282-ca3f-4ec0-9566-372dd487affd None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:23.629542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e56c05-3920-4eac-931d-9d00171770c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:23.630260 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e56c05-3920-4eac-931d-9d00171770c1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:23.630444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e56c05-3920-4eac-931d-9d00171770c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:23.630710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e56c05-3920-4eac-931d-9d00171770c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:23.642740 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e56c05-3920-4eac-931d-9d00171770c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:23.644222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e56c05-3920-4eac-931d-9d00171770c1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:23.659356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-91e56c05-3920-4eac-931d-9d00171770c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:23.659356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:23.659356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:23.659356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:23.659356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:23.659356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:23.659356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:23.659356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:23.659356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:23.659356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:23.659356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:23.659356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:23.659356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:21:23.659356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:21:23.659356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:21:23.659356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:21:23.661124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:23.661124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:23.661124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:23.661124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:23.661124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:23.661124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:23.661124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:23.661124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:23.661124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:23.661124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:23.661124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:23.661124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:23.661124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:23.661124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:23.661124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:23.661124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:23.661124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:21:23.663157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:21:23.663157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:23.663157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:21:23.663157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 645/1269] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:23.667259 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8f23b-181d-48e3-bae1-0593842d9562 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:23.793318 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8f23b-181d-48e3-bae1-0593842d9562 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:23.837575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e107a-ea7a-40b2-95e7-a0bad9b95bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:23.838193 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e107a-ea7a-40b2-95e7-a0bad9b95bbf None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:23.838468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e107a-ea7a-40b2-95e7-a0bad9b95bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:23.838730 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e107a-ea7a-40b2-95e7-a0bad9b95bbf None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:23.839422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e107a-ea7a-40b2-95e7-a0bad9b95bbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:23.839813 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e107a-ea7a-40b2-95e7-a0bad9b95bbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:23.841424 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e107a-ea7a-40b2-95e7-a0bad9b95bbf None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:23.854894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 625/1270] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:21:23.862099 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e56c05-3920-4eac-931d-9d00171770c1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:23.897055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:23.977533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e56c05-3920-4eac-931d-9d00171770c1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:24.014500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70295cb5-8514-40e8-b689-b0a4fa933829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:24.015125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70295cb5-8514-40e8-b689-b0a4fa933829 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:24.015401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70295cb5-8514-40e8-b689-b0a4fa933829 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:24.015692 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70295cb5-8514-40e8-b689-b0a4fa933829 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:24.022618 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70295cb5-8514-40e8-b689-b0a4fa933829 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:24.024081 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70295cb5-8514-40e8-b689-b0a4fa933829 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:24.035208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-70295cb5-8514-40e8-b689-b0a4fa933829 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:21:24.035208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:24.035208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:24.035208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:24.035208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:24.035208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:24.035208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:24.035208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:24.035208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:24.035208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:24.035208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:24.035208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:24.035208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:21:24.035208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:21:24.035208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:21:24.036249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:21:24.036249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:24.036249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:24.036249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:24.036249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:24.036249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:24.036249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:24.036249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:24.036249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:24.036249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:24.036249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:24.036249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:24.036249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:24.036249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:24.036249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:24.036249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:24.036249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:24.037343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:21:24.037343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:21:24.037343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:21:24.037343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:21:24.037343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:21:24.037343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:21:24.037343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:21:24.037343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:21:24.037343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 646/1271] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:21:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:24.042315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e107a-ea7a-40b2-95e7-a0bad9b95bbf None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:24.103486 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:24.146891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e107a-ea7a-40b2-95e7-a0bad9b95bbf None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:24.185108 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19026c6-4230-4698-aed2-25535b645f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:24.185748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19026c6-4230-4698-aed2-25535b645f9b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:24.186028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19026c6-4230-4698-aed2-25535b645f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:24.186299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19026c6-4230-4698-aed2-25535b645f9b None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:24.186993 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19026c6-4230-4698-aed2-25535b645f9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:24.187290 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19026c6-4230-4698-aed2-25535b645f9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:24.188825 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19026c6-4230-4698-aed2-25535b645f9b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:24.201525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 626/1272] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:21:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:24.208144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70295cb5-8514-40e8-b689-b0a4fa933829 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:24.308517 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:24.319667 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70295cb5-8514-40e8-b689-b0a4fa933829 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:24.360267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67faa67-2473-4a6d-88de-592672ebbe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:24.360869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67faa67-2473-4a6d-88de-592672ebbe01 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:24.361127 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67faa67-2473-4a6d-88de-592672ebbe01 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:24.361490 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67faa67-2473-4a6d-88de-592672ebbe01 None admin] PATH_INFO: `/v3/projects/03ca2c70c46a477494884c9997540861/users/b8295272eec349f8aa38e44c861faa47/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:24.363634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67faa67-2473-4a6d-88de-592672ebbe01 None admin] RBAC: Authorizing `identity:create_grant(project_id=03ca2c70c46a477494884c9997540861, user_id=b8295272eec349f8aa38e44c861faa47, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:24.365185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67faa67-2473-4a6d-88de-592672ebbe01 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:24.380388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 647/1273] 10.222.0.52 () {58 vars in 1439 bytes} [Mon Aug 29 20:21:24 2022] PUT /identity/v3/projects/03ca2c70c46a477494884c9997540861/users/b8295272eec349f8aa38e44c861faa47/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:26.312625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f4229-b3db-4e6c-a3fc-efc1375c5a18 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:26.313198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f4229-b3db-4e6c-a3fc-efc1375c5a18 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:26.313198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f4229-b3db-4e6c-a3fc-efc1375c5a18 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:26.314624 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 627/1274] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:21:26.320194 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad9764-1d2d-4b4a-a9d3-8ead42afb8ee None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:26.320659 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad9764-1d2d-4b4a-a9d3-8ead42afb8ee None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:26.320773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad9764-1d2d-4b4a-a9d3-8ead42afb8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:26.341718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5cad9764-1d2d-4b4a-a9d3-8ead42afb8ee None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:26.342917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5cad9764-1d2d-4b4a-a9d3-8ead42afb8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:26.435327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 648/1275] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:21:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:21:26.707566 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f4229-b3db-4e6c-a3fc-efc1375c5a18 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:26.837794 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f4229-b3db-4e6c-a3fc-efc1375c5a18 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:26.857318 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:26.877428 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9579c-e9fe-440b-888f-c835faf8cef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:26.878089 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9579c-e9fe-440b-888f-c835faf8cef6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:26.878368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9579c-e9fe-440b-888f-c835faf8cef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:26.878636 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9579c-e9fe-440b-888f-c835faf8cef6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:26.889651 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9579c-e9fe-440b-888f-c835faf8cef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:21:26.894578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-75e9579c-e9fe-440b-888f-c835faf8cef6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:21:26.894578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:26.894578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:26.894578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:26.894578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:26.894578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:26.894578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:26.894578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:26.894578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:26.894578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:26.894578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:26.894578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:26.894578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:21:26.894578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:21:26.894578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:21:26.894578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:21:26.895722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:21:26.895722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:21:26.895722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:21:26.895722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:21:26.895722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:26.895722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:26.895722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:26.895722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:26.895722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:26.895722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:26.895722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:26.895722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:26.895722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:26.895722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:26.895722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:26.895722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:26.896569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:26.896569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:26.896569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:26.896569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:26.896569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:21:26.896569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:21:26.896569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:21:26.896569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:21:26.896569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:21:26.896569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:21:26.896569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:21:26.896569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:26.896569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 628/1276] 10.222.0.52 () {56 vars in 1096 bytes} [Mon Aug 29 20:21:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:26.902174 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad9764-1d2d-4b4a-a9d3-8ead42afb8ee None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:26.990484 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:27.009582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad9764-1d2d-4b4a-a9d3-8ead42afb8ee None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:27.046015 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dafe1c-ed15-46c9-8deb-24ba101f67ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:27.046480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dafe1c-ed15-46c9-8deb-24ba101f67ed None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:27.046775 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dafe1c-ed15-46c9-8deb-24ba101f67ed None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:27.047088 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dafe1c-ed15-46c9-8deb-24ba101f67ed None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:27.048139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dafe1c-ed15-46c9-8deb-24ba101f67ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:27.048139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dafe1c-ed15-46c9-8deb-24ba101f67ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:27.049477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dafe1c-ed15-46c9-8deb-24ba101f67ed None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:27.062045 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 649/1277] 10.222.0.52 () {56 vars in 1099 bytes} [Mon Aug 29 20:21:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:27.068062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9579c-e9fe-440b-888f-c835faf8cef6 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:27.181321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9579c-e9fe-440b-888f-c835faf8cef6 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:27.217790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205428d3-f2f5-4859-9b6c-5378e34a4acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:27.218446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205428d3-f2f5-4859-9b6c-5378e34a4acf None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:27.218785 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205428d3-f2f5-4859-9b6c-5378e34a4acf None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:27.219058 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205428d3-f2f5-4859-9b6c-5378e34a4acf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:27.232105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205428d3-f2f5-4859-9b6c-5378e34a4acf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:27.233770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205428d3-f2f5-4859-9b6c-5378e34a4acf None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:27.249832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-205428d3-f2f5-4859-9b6c-5378e34a4acf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:27.249832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:27.249832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:27.249832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:27.249832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:27.249832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:27.249832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:27.249832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:27.249832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:27.249832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:27.249832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:27.249832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:27.249832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:21:27.249832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:21:27.249832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:21:27.249832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:21:27.256105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:27.256105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:27.256105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:27.256105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:27.256105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:27.256105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:27.256105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:27.256105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:27.256105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:27.256105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:27.256105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:27.256105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:27.256105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:27.256105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:27.256105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:27.256105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:27.256105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:21:27.257390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:21:27.257390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:27.257390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:27.257390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 629/1278] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:27.257695 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dafe1c-ed15-46c9-8deb-24ba101f67ed None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:27.380273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dafe1c-ed15-46c9-8deb-24ba101f67ed None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:27.419645 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb379b1-2034-43f7-91b1-96088cd297d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:27.420375 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb379b1-2034-43f7-91b1-96088cd297d8 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:27.421269 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb379b1-2034-43f7-91b1-96088cd297d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:27.421567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb379b1-2034-43f7-91b1-96088cd297d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:27.422430 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb379b1-2034-43f7-91b1-96088cd297d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:27.422706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb379b1-2034-43f7-91b1-96088cd297d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:27.424098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb379b1-2034-43f7-91b1-96088cd297d8 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:27.437069 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 650/1279] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:27.443263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205428d3-f2f5-4859-9b6c-5378e34a4acf None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:27.476696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:27.556807 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205428d3-f2f5-4859-9b6c-5378e34a4acf None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:27.595045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cd787-525a-4744-8875-b1e44c3cfc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:27.595707 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cd787-525a-4744-8875-b1e44c3cfc0c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:27.595991 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cd787-525a-4744-8875-b1e44c3cfc0c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:27.596260 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cd787-525a-4744-8875-b1e44c3cfc0c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:27.605840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cd787-525a-4744-8875-b1e44c3cfc0c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:27.607321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cd787-525a-4744-8875-b1e44c3cfc0c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:27.619542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-9f0cd787-525a-4744-8875-b1e44c3cfc0c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:21:27.619542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:27.619542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:27.619542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:27.619542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:27.619542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:27.619542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:27.619542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:27.619542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:27.619542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:27.619542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:27.619542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:27.619542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:21:27.619542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:21:27.619542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:21:27.619542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:27.620770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:27.622207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:27.622207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:27.622207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:21:27.622207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:21:27.622207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:21:27.622207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:21:27.622207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:21:27.622207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:21:27.622207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:21:27.622207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:27.622207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 630/1280] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:27.626669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb379b1-2034-43f7-91b1-96088cd297d8 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:27.630845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:27.758712 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb379b1-2034-43f7-91b1-96088cd297d8 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:27.803681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1975e4f-b584-4153-8711-98e5c3a6ce65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:27.804807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1975e4f-b584-4153-8711-98e5c3a6ce65 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:27.805305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1975e4f-b584-4153-8711-98e5c3a6ce65 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:27.805851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1975e4f-b584-4153-8711-98e5c3a6ce65 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:27.807325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1975e4f-b584-4153-8711-98e5c3a6ce65 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:27.807832 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1975e4f-b584-4153-8711-98e5c3a6ce65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:27.810410 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1975e4f-b584-4153-8711-98e5c3a6ce65 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:27.842789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 651/1281] 10.222.0.52 () {56 vars in 1143 bytes} [Mon Aug 29 20:21:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:27.849067 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cd787-525a-4744-8875-b1e44c3cfc0c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:27.946220 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:27.956401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cd787-525a-4744-8875-b1e44c3cfc0c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:27.994582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb624f-8fe5-40c6-a8b3-8147f06d87a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:27.995198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb624f-8fe5-40c6-a8b3-8147f06d87a6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:27.995474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb624f-8fe5-40c6-a8b3-8147f06d87a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:27.995748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb624f-8fe5-40c6-a8b3-8147f06d87a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:28.077636 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb624f-8fe5-40c6-a8b3-8147f06d87a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:28.079479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb624f-8fe5-40c6-a8b3-8147f06d87a6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:28.179449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:28.190841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 631/1282] 10.222.0.52 () {58 vars in 1282 bytes} [Mon Aug 29 20:21:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:21:28.197021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1975e4f-b584-4153-8711-98e5c3a6ce65 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:28.273693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:28.315810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1975e4f-b584-4153-8711-98e5c3a6ce65 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:28.353383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c94d6a-00f2-45ac-aa43-55362db4cd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:28.354040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c94d6a-00f2-45ac-aa43-55362db4cd27 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:28.354302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c94d6a-00f2-45ac-aa43-55362db4cd27 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:28.354561 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c94d6a-00f2-45ac-aa43-55362db4cd27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:28.367092 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c94d6a-00f2-45ac-aa43-55362db4cd27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:28.371816 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c94d6a-00f2-45ac-aa43-55362db4cd27 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:28.388768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-23c94d6a-00f2-45ac-aa43-55362db4cd27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:28.388768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:28.388768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:28.388768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:28.388768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:28.388768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:28.388768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:28.388768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:28.388768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:28.388768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:28.388768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:28.388768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:28.388768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:21:28.388768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:21:28.388768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:21:28.388768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:21:28.390941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:28.390941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:28.390941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:28.390941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:28.390941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:28.390941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:28.390941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:28.390941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:28.390941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:28.390941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:28.390941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:28.390941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:28.390941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:28.390941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:28.390941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:28.390941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:28.390941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:21:28.392471 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:21:28.392471 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:21:28.392471 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:21:28.392471 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 652/1283] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:21:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:28.396507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb624f-8fe5-40c6-a8b3-8147f06d87a6 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:28.524086 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb624f-8fe5-40c6-a8b3-8147f06d87a6 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:28.573140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae62272-240e-4f1d-8203-fed8c430c5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:28.573789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae62272-240e-4f1d-8203-fed8c430c5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:28.574061 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae62272-240e-4f1d-8203-fed8c430c5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:28.574330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae62272-240e-4f1d-8203-fed8c430c5b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:28.574989 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae62272-240e-4f1d-8203-fed8c430c5b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:28.575285 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae62272-240e-4f1d-8203-fed8c430c5b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:28.577764 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae62272-240e-4f1d-8203-fed8c430c5b3 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:28.592939 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 632/1284] 10.222.0.52 () {56 vars in 1109 bytes} [Mon Aug 29 20:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:28.599080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c94d6a-00f2-45ac-aa43-55362db4cd27 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:28.720013 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c94d6a-00f2-45ac-aa43-55362db4cd27 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:28.743943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:28.770960 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7e38f-16f9-44b4-877b-aff07ecfbc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:28.771594 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7e38f-16f9-44b4-877b-aff07ecfbc88 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:28.771867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7e38f-16f9-44b4-877b-aff07ecfbc88 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:28.772131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7e38f-16f9-44b4-877b-aff07ecfbc88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:28.779723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7e38f-16f9-44b4-877b-aff07ecfbc88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:28.781407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7e38f-16f9-44b4-877b-aff07ecfbc88 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:28.794349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-67d7e38f-16f9-44b4-877b-aff07ecfbc88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:21:28.794349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:28.794349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:28.794349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:28.794349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:28.794349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:28.794349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:28.794349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:28.794349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:28.794349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:28.794349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:28.794349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:28.794349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:21:28.794349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:21:28.794349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:21:28.795560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:21:28.795560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:28.795560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:28.795560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:28.795560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:28.795560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:28.795560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:28.795560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:28.795560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:28.795560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:28.795560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:28.795560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:28.795560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:28.795560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:28.795560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:28.795560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:28.795560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:28.796733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:21:28.796733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:21:28.796733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:21:28.796733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:21:28.796733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:21:28.796733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:21:28.796733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:21:28.796733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 29 20:21:28.796733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 653/1285] 10.222.0.52 () {56 vars in 1111 bytes} [Mon Aug 29 20:21:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:28.801703 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae62272-240e-4f1d-8203-fed8c430c5b3 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:28.862942 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:28.920710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae62272-240e-4f1d-8203-fed8c430c5b3 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:28.958820 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068280ad-849b-4814-88b5-066a9d0bd7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:28.959616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068280ad-849b-4814-88b5-066a9d0bd7bc None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:28.959957 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068280ad-849b-4814-88b5-066a9d0bd7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:28.960292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068280ad-849b-4814-88b5-066a9d0bd7bc None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:28.961111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068280ad-849b-4814-88b5-066a9d0bd7bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:28.961679 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068280ad-849b-4814-88b5-066a9d0bd7bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:28.963338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068280ad-849b-4814-88b5-066a9d0bd7bc None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:28.978596 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 633/1286] 10.222.0.52 () {56 vars in 1148 bytes} [Mon Aug 29 20:21:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:28.985232 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7e38f-16f9-44b4-877b-aff07ecfbc88 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:29.110962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7e38f-16f9-44b4-877b-aff07ecfbc88 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:29.146379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cf69f-9601-400d-95e5-5a09a23bda0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:29.146896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cf69f-9601-400d-95e5-5a09a23bda0d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:29.147173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cf69f-9601-400d-95e5-5a09a23bda0d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:29.147438 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cf69f-9601-400d-95e5-5a09a23bda0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:29.148167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cf69f-9601-400d-95e5-5a09a23bda0d None admin] RBAC: Adding query filter params (role.id=0d06b071c6074137916bdac5a8ef4387, scope.project.id=03ca2c70c46a477494884c9997540861, user.id=b8295272eec349f8aa38e44c861faa47) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:29.148465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cf69f-9601-400d-95e5-5a09a23bda0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:29.149949 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cf69f-9601-400d-95e5-5a09a23bda0d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:29.156097 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 654/1287] 10.222.0.52 () {56 vars in 1374 bytes} [Mon Aug 29 20:21:28 2022] GET /identity/v3/role_assignments?user.id=b8295272eec349f8aa38e44c861faa47&scope.project.id=03ca2c70c46a477494884c9997540861&role.id=0d06b071c6074137916bdac5a8ef4387 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:31.123893 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeac57-d989-489c-aa7a-75b40cd88cd4 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:31.124509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeac57-d989-489c-aa7a-75b40cd88cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:31.124509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeac57-d989-489c-aa7a-75b40cd88cd4 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:31.125857 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 634/1288] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:21:31.131961 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f018836-17cc-466a-89db-3b1f20d3dd2c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:31.132508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f018836-17cc-466a-89db-3b1f20d3dd2c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:31.132508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f018836-17cc-466a-89db-3b1f20d3dd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:31.156372 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-0f018836-17cc-466a-89db-3b1f20d3dd2c None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:31.157614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0f018836-17cc-466a-89db-3b1f20d3dd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:31.190462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:31.233473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 655/1289] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:21:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:21:31.497977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeeac57-d989-489c-aa7a-75b40cd88cd4 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:31.613211 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeeac57-d989-489c-aa7a-75b40cd88cd4 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:31.625489 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:31.654313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55befed-b9f1-42cc-b92b-1ff900463432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:31.655014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55befed-b9f1-42cc-b92b-1ff900463432 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:31.655271 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55befed-b9f1-42cc-b92b-1ff900463432 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:31.655567 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55befed-b9f1-42cc-b92b-1ff900463432 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:31.656402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55befed-b9f1-42cc-b92b-1ff900463432 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:31.657987 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55befed-b9f1-42cc-b92b-1ff900463432 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:31.668508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-a55befed-b9f1-42cc-b92b-1ff900463432 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:21:31.668508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:31.668508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:21:31.668508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:21:31.668508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:21:31.668508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:21:31.668508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:21:31.668508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:21:31.668508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:21:31.668508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:31.668508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:21:31.668508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:31.668508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:31.668508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:31.668508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:31.668508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:31.668508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:31.670049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:31.670049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:31.670049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:31.670049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:31.670049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:31.670049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:31.670049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:21:31.670049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:21:31.670049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:21:31.670049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:21:31.670049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:31.670049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:31.670049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:31.670049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:31.670049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:31.670049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:31.671522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:31.671522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:31.671522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:31.671522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:31.671522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:31.671522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:31.671522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:31.671522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:31.671522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:31.671522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:31.671522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:21:31.671522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:21:31.671522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:21:31.671522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:31.671522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 635/1290] 10.222.0.52 () {56 vars in 1117 bytes} [Mon Aug 29 20:21:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:31.678191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f018836-17cc-466a-89db-3b1f20d3dd2c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:31.813504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f018836-17cc-466a-89db-3b1f20d3dd2c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:31.852919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b5de6-580a-4ea2-bf08-953120f6844d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:31.853611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b5de6-580a-4ea2-bf08-953120f6844d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:31.853892 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b5de6-580a-4ea2-bf08-953120f6844d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:31.854157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b5de6-580a-4ea2-bf08-953120f6844d None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:31.854797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b5de6-580a-4ea2-bf08-953120f6844d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:31.855099 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b5de6-580a-4ea2-bf08-953120f6844d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:31.856534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b5de6-580a-4ea2-bf08-953120f6844d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:31.862342 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 656/1291] 10.222.0.52 () {56 vars in 1116 bytes} [Mon Aug 29 20:21:31 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:31.869234 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55befed-b9f1-42cc-b92b-1ff900463432 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:31.985797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55befed-b9f1-42cc-b92b-1ff900463432 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:32.030991 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da9f7e-e0de-46ef-bf61-5393f66cc88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:32.032047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da9f7e-e0de-46ef-bf61-5393f66cc88e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:32.032542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da9f7e-e0de-46ef-bf61-5393f66cc88e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:32.033031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da9f7e-e0de-46ef-bf61-5393f66cc88e None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:32.034244 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da9f7e-e0de-46ef-bf61-5393f66cc88e None admin] RBAC: Adding query filter params (type=placement) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:32.034881 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da9f7e-e0de-46ef-bf61-5393f66cc88e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:32.037166 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da9f7e-e0de-46ef-bf61-5393f66cc88e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:32.043739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 636/1292] 10.222.0.52 () {56 vars in 1116 bytes} [Mon Aug 29 20:21:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:33.982842 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037df405-9423-44bb-ba2c-479b422e24c6 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:33.983495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037df405-9423-44bb-ba2c-479b422e24c6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:33.983495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037df405-9423-44bb-ba2c-479b422e24c6 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:33.984756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 657/1293] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:21:33.990686 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051b0f-6b77-428d-ab42-36a6ffd23651 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:33.991216 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051b0f-6b77-428d-ab42-36a6ffd23651 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:33.991323 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051b0f-6b77-428d-ab42-36a6ffd23651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:34.011668 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-2c051b0f-6b77-428d-ab42-36a6ffd23651 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:34.012931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2c051b0f-6b77-428d-ab42-36a6ffd23651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:34.051485 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:34.095337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 637/1294] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:21:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:21:34.366977 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037df405-9423-44bb-ba2c-479b422e24c6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:34.402250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:34.494535 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037df405-9423-44bb-ba2c-479b422e24c6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:34.538807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec1e67-07b1-47f4-8b29-308c0fd170de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:34.539472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec1e67-07b1-47f4-8b29-308c0fd170de None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:34.539751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec1e67-07b1-47f4-8b29-308c0fd170de None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:34.540021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec1e67-07b1-47f4-8b29-308c0fd170de None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:34.540682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec1e67-07b1-47f4-8b29-308c0fd170de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:34.542098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec1e67-07b1-47f4-8b29-308c0fd170de None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:34.559757 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 658/1295] 10.222.0.52 () {60 vars in 1141 bytes} [Mon Aug 29 20:21:34 2022] POST /identity/v3/services => generated 246 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:21:36.578907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27215e5-c386-42a3-8cab-0fd089aa259e None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:36.579746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27215e5-c386-42a3-8cab-0fd089aa259e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:36.579746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27215e5-c386-42a3-8cab-0fd089aa259e None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:36.581342 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 638/1296] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:21:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:21:36.587054 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6aa9e-0058-4507-ac5f-b8a415cadc8f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:36.587530 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6aa9e-0058-4507-ac5f-b8a415cadc8f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:36.587629 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6aa9e-0058-4507-ac5f-b8a415cadc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:36.606969 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ebd6aa9e-0058-4507-ac5f-b8a415cadc8f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:36.608144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ebd6aa9e-0058-4507-ac5f-b8a415cadc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:36.693095 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 659/1297] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:21:36 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:21:36.967260 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27215e5-c386-42a3-8cab-0fd089aa259e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:37.075893 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27215e5-c386-42a3-8cab-0fd089aa259e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:37.112306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0f8be-1ef5-4ed0-a613-b1afb3603bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:37.112922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f8be-1ef5-4ed0-a613-b1afb3603bff None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:37.113199 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f8be-1ef5-4ed0-a613-b1afb3603bff None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:37.113568 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f8be-1ef5-4ed0-a613-b1afb3603bff None admin] PATH_INFO: `/v3/services/placement` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:37.114153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0f8be-1ef5-4ed0-a613-b1afb3603bff None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:37.115528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0f8be-1ef5-4ed0-a613-b1afb3603bff None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:37.124490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-70a0f8be-1ef5-4ed0-a613-b1afb3603bff None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:21:37.124490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:37.124490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:21:37.124490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:21:37.124490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:21:37.124490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:21:37.124490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:21:37.124490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:21:37.124490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:21:37.124490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:37.124490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:21:37.124490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:37.124490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:37.124490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:37.124490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:37.124490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:37.124490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:37.125934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:37.125934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:37.125934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:37.125934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:37.125934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:37.125934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:37.125934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:21:37.125934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:21:37.125934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:21:37.125934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:21:37.125934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:37.125934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:37.125934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:37.125934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:37.125934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:37.125934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:37.126861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:37.126861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:37.126861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:37.126861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:37.126861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:37.126861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:37.126861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:37.126861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:37.126861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:37.126861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:37.126861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:21:37.126861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:21:37.126861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:21:37.126861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:37.126861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 639/1298] 10.222.0.52 () {56 vars in 1117 bytes} [Mon Aug 29 20:21:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:37.131926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6aa9e-0058-4507-ac5f-b8a415cadc8f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:37.157195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:37.245996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6aa9e-0058-4507-ac5f-b8a415cadc8f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:37.281731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c690248-1e77-45f7-ba1d-f71c3e7e9559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:37.282356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c690248-1e77-45f7-ba1d-f71c3e7e9559 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:37.282628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c690248-1e77-45f7-ba1d-f71c3e7e9559 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:37.282901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c690248-1e77-45f7-ba1d-f71c3e7e9559 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:37.283536 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c690248-1e77-45f7-ba1d-f71c3e7e9559 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:37.283835 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c690248-1e77-45f7-ba1d-f71c3e7e9559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:37.285224 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c690248-1e77-45f7-ba1d-f71c3e7e9559 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:37.290800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 660/1299] 10.222.0.52 () {56 vars in 1116 bytes} [Mon Aug 29 20:21:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:37.297266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0f8be-1ef5-4ed0-a613-b1afb3603bff None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:37.332441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:37.405720 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0f8be-1ef5-4ed0-a613-b1afb3603bff None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:37.451927 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf786e92-a12e-481f-b2f2-5058a9def4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:37.452910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf786e92-a12e-481f-b2f2-5058a9def4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:37.453212 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf786e92-a12e-481f-b2f2-5058a9def4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:37.453507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf786e92-a12e-481f-b2f2-5058a9def4b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:37.454206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf786e92-a12e-481f-b2f2-5058a9def4b8 None admin] RBAC: Adding query filter params (interface=public, service_id=018fb66efa9748569bd524c7510b0c82, region_id=RegionOne) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:37.454488 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf786e92-a12e-481f-b2f2-5058a9def4b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:37.455859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf786e92-a12e-481f-b2f2-5058a9def4b8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:37.461220 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 640/1300] 10.222.0.52 () {56 vars in 1251 bytes} [Mon Aug 29 20:21:37 2022] GET /identity/v3/endpoints?service_id=018fb66efa9748569bd524c7510b0c82&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:37.467409 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c690248-1e77-45f7-ba1d-f71c3e7e9559 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:37.561414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:37.580611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c690248-1e77-45f7-ba1d-f71c3e7e9559 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:37.615095 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb94a7-fcfc-4199-8249-3efb42e610a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:37.615757 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb94a7-fcfc-4199-8249-3efb42e610a2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:37.615955 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb94a7-fcfc-4199-8249-3efb42e610a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:37.616196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb94a7-fcfc-4199-8249-3efb42e610a2 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:37.616798 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb94a7-fcfc-4199-8249-3efb42e610a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:37.618206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb94a7-fcfc-4199-8249-3efb42e610a2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:37.625003 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 661/1301] 10.222.0.52 () {56 vars in 1087 bytes} [Mon Aug 29 20:21:37 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:21:39.530254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c490f7-a989-406f-85cf-c3c937a13f71 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:39.530861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c490f7-a989-406f-85cf-c3c937a13f71 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:39.530861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c490f7-a989-406f-85cf-c3c937a13f71 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:39.532132 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 641/1302] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:21:39.537907 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33f01f-c35b-44e9-9f57-9fe9ff2be3c6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:39.538371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33f01f-c35b-44e9-9f57-9fe9ff2be3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:39.538480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33f01f-c35b-44e9-9f57-9fe9ff2be3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:39.561076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6f33f01f-c35b-44e9-9f57-9fe9ff2be3c6 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:39.562322 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6f33f01f-c35b-44e9-9f57-9fe9ff2be3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:39.635779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 662/1303] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:21:39 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:21:39.909998 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c490f7-a989-406f-85cf-c3c937a13f71 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:40.016474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:40.026205 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c490f7-a989-406f-85cf-c3c937a13f71 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:40.066961 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda1b0e-d1ab-423a-9de2-8e7931c1ada8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:40.067601 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda1b0e-d1ab-423a-9de2-8e7931c1ada8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:40.067883 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda1b0e-d1ab-423a-9de2-8e7931c1ada8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:40.068150 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda1b0e-d1ab-423a-9de2-8e7931c1ada8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:40.068751 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda1b0e-d1ab-423a-9de2-8e7931c1ada8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:40.070156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda1b0e-d1ab-423a-9de2-8e7931c1ada8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:40.080085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-1bda1b0e-d1ab-423a-9de2-8e7931c1ada8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:21:40.080085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:40.080085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:21:40.080085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:21:40.080085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:21:40.080085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:21:40.080085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:21:40.080085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:21:40.080085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:21:40.080085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:40.080085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:21:40.080085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:40.080085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:21:40.080085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:21:40.080085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:21:40.080085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:21:40.080085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:21:40.081294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:21:40.081294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:21:40.081294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:21:40.081294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:21:40.081294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:21:40.081294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:21:40.081294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:21:40.081294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:21:40.081294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:21:40.081294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:21:40.081294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:21:40.081294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:21:40.081294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:21:40.081294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:21:40.081294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:21:40.081294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:21:40.082350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:21:40.082350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 29 20:21:40.082350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:21:40.082350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:21:40.082350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:21:40.082350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:21:40.082350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:21:40.082350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:21:40.082350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:21:40.082350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:21:40.082350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:21:40.082350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:21:40.082350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:21:40.082350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 29 20:21:40.085547 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 642/1304] 10.222.0.52 () {56 vars in 1117 bytes} [Mon Aug 29 20:21:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:21:40.087628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33f01f-c35b-44e9-9f57-9fe9ff2be3c6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:40.172479 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:40.197156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33f01f-c35b-44e9-9f57-9fe9ff2be3c6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:40.240500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe27d7-e5c7-4cbc-add5-0a2a61143085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:40.241125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe27d7-e5c7-4cbc-add5-0a2a61143085 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:40.241432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe27d7-e5c7-4cbc-add5-0a2a61143085 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:40.241703 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe27d7-e5c7-4cbc-add5-0a2a61143085 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:40.242343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe27d7-e5c7-4cbc-add5-0a2a61143085 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:40.242645 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe27d7-e5c7-4cbc-add5-0a2a61143085 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:40.244042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe27d7-e5c7-4cbc-add5-0a2a61143085 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:40.250107 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 663/1305] 10.222.0.52 () {56 vars in 1116 bytes} [Mon Aug 29 20:21:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:40.257184 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda1b0e-d1ab-423a-9de2-8e7931c1ada8 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:40.388614 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda1b0e-d1ab-423a-9de2-8e7931c1ada8 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:40.442721 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec1e0d-1cb1-451a-9ecc-d1c681b23893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:40.443770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec1e0d-1cb1-451a-9ecc-d1c681b23893 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:40.444267 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec1e0d-1cb1-451a-9ecc-d1c681b23893 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:40.444678 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec1e0d-1cb1-451a-9ecc-d1c681b23893 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:40.445567 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec1e0d-1cb1-451a-9ecc-d1c681b23893 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:40.446979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec1e0d-1cb1-451a-9ecc-d1c681b23893 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:40.468825 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 643/1306] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:21:40 2022] POST /identity/v3/endpoints => generated 331 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:21:50.246541 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=30 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:50.463905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:48.649310 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659f769-8b06-4a18-b8e7-90489d7c2913 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:48.649900 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659f769-8b06-4a18-b8e7-90489d7c2913 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:48.650470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659f769-8b06-4a18-b8e7-90489d7c2913 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:48.653618 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 664/1307] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:22:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:48.659285 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a8670-faeb-4411-bf58-a3508b4a7351 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:48.659855 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a8670-faeb-4411-bf58-a3508b4a7351 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:48.659855 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a8670-faeb-4411-bf58-a3508b4a7351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:48.848603 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-a37a8670-faeb-4411-bf58-a3508b4a7351 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:48.849978 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a37a8670-faeb-4411-bf58-a3508b4a7351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:49.083637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 644/1308] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:49.422739 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ccb1f-a630-4c91-bc2f-0a322c0b5ceb None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:49.423395 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ccb1f-a630-4c91-bc2f-0a322c0b5ceb None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:49.423867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ccb1f-a630-4c91-bc2f-0a322c0b5ceb None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:49.425961 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 665/1309] 10.222.0.52 () {54 vars in 965 bytes} [Mon Aug 29 20:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:49.433475 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662b446-efd2-4261-a4d2-4992fbe66c5c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:49.433734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662b446-efd2-4261-a4d2-4992fbe66c5c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:49.434016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662b446-efd2-4261-a4d2-4992fbe66c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:49.533219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-2662b446-efd2-4261-a4d2-4992fbe66c5c None None] MFA Rules not processed for user `382b0ee3bd634cc8800f1769c91b7a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:49.534919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2662b446-efd2-4261-a4d2-4992fbe66c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:49.560513 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:49.652621 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 645/1310] 10.222.0.52 () {58 vars in 1062 bytes} [Mon Aug 29 20:22:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:49.662163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ccb1f-a630-4c91-bc2f-0a322c0b5ceb None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:49.664747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3e2ccb1f-a630-4c91-bc2f-0a322c0b5ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:49.810692 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ccb1f-a630-4c91-bc2f-0a322c0b5ceb None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:49.890783 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ceac5-2e13-4af9-a715-06d83e95e21b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:49.891661 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ceac5-2e13-4af9-a715-06d83e95e21b service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:49.892105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ceac5-2e13-4af9-a715-06d83e95e21b service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:49.892524 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ceac5-2e13-4af9-a715-06d83e95e21b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:49.894304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9a6ceac5-2e13-4af9-a715-06d83e95e21b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:49.968903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:50.061851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ceac5-2e13-4af9-a715-06d83e95e21b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:50.065152 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ceac5-2e13-4af9-a715-06d83e95e21b service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:50.094742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 666/1311] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:52.415083 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfa012-847c-4d51-8af4-87f521b4345d None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:52.415670 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfa012-847c-4d51-8af4-87f521b4345d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:52.415757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfa012-847c-4d51-8af4-87f521b4345d None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:52.417218 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 646/1312] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:22:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:52.423650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf23398-2b01-4eb0-ade2-d12ba51bb6b4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:52.424222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf23398-2b01-4eb0-ade2-d12ba51bb6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:52.424339 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf23398-2b01-4eb0-ade2-d12ba51bb6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:52.523631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7cf23398-2b01-4eb0-ade2-d12ba51bb6b4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:52.525182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7cf23398-2b01-4eb0-ade2-d12ba51bb6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:52.687485 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 667/1313] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:53.002866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfa012-847c-4d51-8af4-87f521b4345d None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:53.004602 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0ccfa012-847c-4d51-8af4-87f521b4345d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:53.128813 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfa012-847c-4d51-8af4-87f521b4345d None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:53.216826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:53.220359 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacec1f-8347-465a-9692-2968c50990b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:53.221174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacec1f-8347-465a-9692-2968c50990b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:53.221551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacec1f-8347-465a-9692-2968c50990b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:53.221984 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacec1f-8347-465a-9692-2968c50990b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:53.223945 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-baacec1f-8347-465a-9692-2968c50990b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:53.353207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baacec1f-8347-465a-9692-2968c50990b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:53.354741 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baacec1f-8347-465a-9692-2968c50990b7 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:53.377157 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 647/1314] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:55.780120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e85718-fb0e-4b4d-8931-ca57d5afb521 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:55.780754 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e85718-fb0e-4b4d-8931-ca57d5afb521 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:55.780754 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e85718-fb0e-4b4d-8931-ca57d5afb521 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:55.782083 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 668/1315] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:55.787993 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a95e9-30f9-4146-b07c-90eed325a57c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:55.788549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a95e9-30f9-4146-b07c-90eed325a57c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:55.788549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a95e9-30f9-4146-b07c-90eed325a57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:55.859437 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-fc4a95e9-30f9-4146-b07c-90eed325a57c None None] MFA Rules not processed for user `1646a508a727421c8e569118d78f0ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:55.860710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fc4a95e9-30f9-4146-b07c-90eed325a57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:55.916682 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:55.964813 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 648/1316] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:22:55 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:56.260878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61216f-bf17-48ac-81c2-ad20b8a890ea None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:56.260878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61216f-bf17-48ac-81c2-ad20b8a890ea None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:56.261164 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61216f-bf17-48ac-81c2-ad20b8a890ea None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:56.262397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 669/1317] 10.222.0.52 () {54 vars in 965 bytes} [Mon Aug 29 20:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:56.268415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285a0a-6eb8-48db-a5ae-03f72ef48059 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:56.268700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285a0a-6eb8-48db-a5ae-03f72ef48059 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:56.268968 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285a0a-6eb8-48db-a5ae-03f72ef48059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:56.358903 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1b285a0a-6eb8-48db-a5ae-03f72ef48059 None None] MFA Rules not processed for user `382b0ee3bd634cc8800f1769c91b7a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:56.360397 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1b285a0a-6eb8-48db-a5ae-03f72ef48059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:56.442801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 649/1318] 10.222.0.52 () {58 vars in 1062 bytes} [Mon Aug 29 20:22:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:56.452840 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61216f-bf17-48ac-81c2-ad20b8a890ea None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:56.454454 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4d61216f-bf17-48ac-81c2-ad20b8a890ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:56.465170 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:56.575005 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61216f-bf17-48ac-81c2-ad20b8a890ea None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:56.663951 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3012f9-f6ba-4535-94d8-893e807b24bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:56.664627 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3012f9-f6ba-4535-94d8-893e807b24bf service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:56.664907 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3012f9-f6ba-4535-94d8-893e807b24bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:56.665177 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3012f9-f6ba-4535-94d8-893e807b24bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:56.666913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3e3012f9-f6ba-4535-94d8-893e807b24bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:56.748287 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:56.803717 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3012f9-f6ba-4535-94d8-893e807b24bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:56.805386 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3012f9-f6ba-4535-94d8-893e807b24bf service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:56.834811 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 670/1319] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:59.868048 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a21421-da0e-4aa0-b977-9222e406bdda None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:59.868901 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a21421-da0e-4aa0-b977-9222e406bdda None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:59.868901 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a21421-da0e-4aa0-b977-9222e406bdda None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:59.870171 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 650/1320] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:22:59.876294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7129a8-d6f2-4da7-9f34-4194a6533e5a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:59.876830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7129a8-d6f2-4da7-9f34-4194a6533e5a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:59.876830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7129a8-d6f2-4da7-9f34-4194a6533e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:59.960989 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-cf7129a8-d6f2-4da7-9f34-4194a6533e5a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:59.962573 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cf7129a8-d6f2-4da7-9f34-4194a6533e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:00.084420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 671/1321] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:22:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:00.368506 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a21421-da0e-4aa0-b977-9222e406bdda None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:00.371368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f6a21421-da0e-4aa0-b977-9222e406bdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:00.431153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:00.498285 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a21421-da0e-4aa0-b977-9222e406bdda None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:00.580291 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe01cd6-019f-47cc-8ac2-02a72bbae901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:00.580908 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe01cd6-019f-47cc-8ac2-02a72bbae901 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:00.581182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe01cd6-019f-47cc-8ac2-02a72bbae901 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:00.581487 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe01cd6-019f-47cc-8ac2-02a72bbae901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:00.583125 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fbe01cd6-019f-47cc-8ac2-02a72bbae901 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:00.698340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:00.716096 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe01cd6-019f-47cc-8ac2-02a72bbae901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:00.719257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe01cd6-019f-47cc-8ac2-02a72bbae901 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:00.740609 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 651/1322] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:03.733743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a5403-6078-4e2d-b0a4-f061d425994c None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:03.734749 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a5403-6078-4e2d-b0a4-f061d425994c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:03.735237 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a5403-6078-4e2d-b0a4-f061d425994c None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:03.738014 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 672/1323] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:23:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:03.743839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aa1c4-0209-479b-9aca-bd6e9b382460 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:03.744508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aa1c4-0209-479b-9aca-bd6e9b382460 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:03.744508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aa1c4-0209-479b-9aca-bd6e9b382460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:03.843498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-cf9aa1c4-0209-479b-9aca-bd6e9b382460 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:03.844765 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-cf9aa1c4-0209-479b-9aca-bd6e9b382460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:03.974869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 652/1324] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:04.343080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a5403-6078-4e2d-b0a4-f061d425994c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:04.346406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b98a5403-6078-4e2d-b0a4-f061d425994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:04.383286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:04.500085 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a5403-6078-4e2d-b0a4-f061d425994c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:04.601770 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42072207-2348-4157-990c-82fa37535dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:04.602261 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42072207-2348-4157-990c-82fa37535dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:04.602566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42072207-2348-4157-990c-82fa37535dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:04.602844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42072207-2348-4157-990c-82fa37535dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:04.604551 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-42072207-2348-4157-990c-82fa37535dc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:04.696920 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:04.748382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42072207-2348-4157-990c-82fa37535dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:04.750321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42072207-2348-4157-990c-82fa37535dc4 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:04.777305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 673/1325] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:06.857290 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129041f-359d-4100-8ac1-b2949471413f None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:06.857968 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129041f-359d-4100-8ac1-b2949471413f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:06.857968 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129041f-359d-4100-8ac1-b2949471413f None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:06.859404 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 653/1326] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:06.866191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2402a4-0437-49b0-b0a9-9ffe07f76319 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:06.867122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2402a4-0437-49b0-b0a9-9ffe07f76319 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:06.867294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2402a4-0437-49b0-b0a9-9ffe07f76319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:06.980954 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5a2402a4-0437-49b0-b0a9-9ffe07f76319 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:06.982242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5a2402a4-0437-49b0-b0a9-9ffe07f76319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:07.156217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 674/1327] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:07.461458 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129041f-359d-4100-8ac1-b2949471413f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:07.464451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0129041f-359d-4100-8ac1-b2949471413f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:07.543897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:07.611462 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129041f-359d-4100-8ac1-b2949471413f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:07.755806 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2b28d-6643-4fca-8342-b85b7ea8385c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:07.756534 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2b28d-6643-4fca-8342-b85b7ea8385c service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:07.757067 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2b28d-6643-4fca-8342-b85b7ea8385c service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:07.757610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2b28d-6643-4fca-8342-b85b7ea8385c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:07.760917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-07d2b28d-6643-4fca-8342-b85b7ea8385c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:07.973456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:07.980237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2b28d-6643-4fca-8342-b85b7ea8385c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:07.983726 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2b28d-6643-4fca-8342-b85b7ea8385c service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:08.017933 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 654/1328] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:10.420878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2fe2-5afa-4be6-8996-0b3e1447ad51 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:10.421813 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2fe2-5afa-4be6-8996-0b3e1447ad51 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:10.421813 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2fe2-5afa-4be6-8996-0b3e1447ad51 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:10.422784 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 675/1329] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:23:10.428860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7603ddf-25c6-4ee7-9e14-e80a0978917c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:10.429477 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7603ddf-25c6-4ee7-9e14-e80a0978917c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:10.429477 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7603ddf-25c6-4ee7-9e14-e80a0978917c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:10.518409 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e7603ddf-25c6-4ee7-9e14-e80a0978917c None None] MFA Rules not processed for user `1646a508a727421c8e569118d78f0ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:10.519789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e7603ddf-25c6-4ee7-9e14-e80a0978917c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:10.696230 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 655/1330] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:10 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:11.006988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa2fe2-5afa-4be6-8996-0b3e1447ad51 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:11.008646 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-feaa2fe2-5afa-4be6-8996-0b3e1447ad51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:11.049639 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:11.160542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa2fe2-5afa-4be6-8996-0b3e1447ad51 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:11.262201 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80167375-ce1e-44c9-a2ba-859660b18f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:11.262929 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80167375-ce1e-44c9-a2ba-859660b18f27 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.263430 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80167375-ce1e-44c9-a2ba-859660b18f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.263838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80167375-ce1e-44c9-a2ba-859660b18f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.265794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-80167375-ce1e-44c9-a2ba-859660b18f27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:11.372946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:11.424025 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80167375-ce1e-44c9-a2ba-859660b18f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:11.425575 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80167375-ce1e-44c9-a2ba-859660b18f27 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:11.447937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 676/1331] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:11 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:23:13.756480 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77134d9-b934-4400-91a5-54b0cde97c33 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.757315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77134d9-b934-4400-91a5-54b0cde97c33 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.757315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77134d9-b934-4400-91a5-54b0cde97c33 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.758522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 656/1332] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:13.765426 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899b12b-6b29-445a-817b-03857ee7a125 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.766027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899b12b-6b29-445a-817b-03857ee7a125 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.766310 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899b12b-6b29-445a-817b-03857ee7a125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.862856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2899b12b-6b29-445a-817b-03857ee7a125 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:13.864123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2899b12b-6b29-445a-817b-03857ee7a125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:13.995086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 677/1333] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:14.276243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77134d9-b934-4400-91a5-54b0cde97c33 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:14.277837 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c77134d9-b934-4400-91a5-54b0cde97c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:14.356802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:14.400941 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77134d9-b934-4400-91a5-54b0cde97c33 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:14.487091 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7321e-53db-4a89-847f-d84eb2f554f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:14.487749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7321e-53db-4a89-847f-d84eb2f554f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:14.488027 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7321e-53db-4a89-847f-d84eb2f554f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:14.488300 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7321e-53db-4a89-847f-d84eb2f554f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:14.490016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-92a7321e-53db-4a89-847f-d84eb2f554f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:14.620453 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7321e-53db-4a89-847f-d84eb2f554f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:14.621893 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7321e-53db-4a89-847f-d84eb2f554f3 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:14.633411 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:14.647768 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 657/1334] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:16.644630 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a8da7-1565-4043-a3a8-1e70e1ff6ba0 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:16.645195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a8da7-1565-4043-a3a8-1e70e1ff6ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:16.645195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a8da7-1565-4043-a3a8-1e70e1ff6ba0 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:16.646469 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 678/1335] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:16.652748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdad84-c766-4902-8895-2a7f17d947ae None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:16.653300 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdad84-c766-4902-8895-2a7f17d947ae None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:16.653300 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdad84-c766-4902-8895-2a7f17d947ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:16.733458 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-a7fdad84-c766-4902-8895-2a7f17d947ae None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:16.734710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a7fdad84-c766-4902-8895-2a7f17d947ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:16.845754 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 658/1336] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:17.130766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a8da7-1565-4043-a3a8-1e70e1ff6ba0 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:17.132534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2d4a8da7-1565-4043-a3a8-1e70e1ff6ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:17.178317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:17.246690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a8da7-1565-4043-a3a8-1e70e1ff6ba0 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:17.325699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49014968-dd44-49a1-b42c-b008d25e536c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:17.326308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49014968-dd44-49a1-b42c-b008d25e536c service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:17.326581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49014968-dd44-49a1-b42c-b008d25e536c service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:17.326842 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49014968-dd44-49a1-b42c-b008d25e536c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:17.328456 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-49014968-dd44-49a1-b42c-b008d25e536c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:17.420807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:17.448546 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49014968-dd44-49a1-b42c-b008d25e536c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:17.450042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49014968-dd44-49a1-b42c-b008d25e536c service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:17.468405 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 679/1337] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:19.733789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33190f-fcd0-485c-9c72-fbd49649df93 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:19.734355 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33190f-fcd0-485c-9c72-fbd49649df93 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:19.734355 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33190f-fcd0-485c-9c72-fbd49649df93 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:19.735651 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 659/1338] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:23:19.741133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9f5a8-c908-4061-93e6-3f6f21e69137 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:19.741647 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9f5a8-c908-4061-93e6-3f6f21e69137 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:19.741749 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9f5a8-c908-4061-93e6-3f6f21e69137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:19.812370 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d5f9f5a8-c908-4061-93e6-3f6f21e69137 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:19.813516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d5f9f5a8-c908-4061-93e6-3f6f21e69137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:19.934765 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 680/1339] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:20.211719 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33190f-fcd0-485c-9c72-fbd49649df93 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:20.213308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3c33190f-fcd0-485c-9c72-fbd49649df93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:20.300479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:20.340902 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33190f-fcd0-485c-9c72-fbd49649df93 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:20.429372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1adbcc-f105-4a20-8738-8a1f36e0ab55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:20.430008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1adbcc-f105-4a20-8738-8a1f36e0ab55 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:20.430291 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1adbcc-f105-4a20-8738-8a1f36e0ab55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:20.430569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1adbcc-f105-4a20-8738-8a1f36e0ab55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:20.432240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bf1adbcc-f105-4a20-8738-8a1f36e0ab55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:20.571010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1adbcc-f105-4a20-8738-8a1f36e0ab55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:20.572474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1adbcc-f105-4a20-8738-8a1f36e0ab55 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:20.592606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 660/1340] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:24.819037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448710d1-037f-42c1-97cb-1d2374579232 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:24.819933 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448710d1-037f-42c1-97cb-1d2374579232 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:24.820037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448710d1-037f-42c1-97cb-1d2374579232 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:24.821466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 681/1341] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:23:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:24.827512 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789d948-270c-4333-b97e-da403568d230 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:24.828109 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789d948-270c-4333-b97e-da403568d230 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:24.828109 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789d948-270c-4333-b97e-da403568d230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:24.834035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:24.907396 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6789d948-270c-4333-b97e-da403568d230 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:24.908764 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6789d948-270c-4333-b97e-da403568d230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:25.033729 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 661/1342] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:25.319892 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448710d1-037f-42c1-97cb-1d2374579232 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:25.321508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-448710d1-037f-42c1-97cb-1d2374579232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:25.378185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:25.439479 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448710d1-037f-42c1-97cb-1d2374579232 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:25.519873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e7af9-3c7f-4adc-bf0e-d6c52224960f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:25.520493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e7af9-3c7f-4adc-bf0e-d6c52224960f service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:25.520767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e7af9-3c7f-4adc-bf0e-d6c52224960f service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:25.521008 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e7af9-3c7f-4adc-bf0e-d6c52224960f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:25.522713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-076e7af9-3c7f-4adc-bf0e-d6c52224960f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:25.622622 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:25.644287 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e7af9-3c7f-4adc-bf0e-d6c52224960f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:25.645817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e7af9-3c7f-4adc-bf0e-d6c52224960f service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:25.668145 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 682/1343] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:28.487029 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75100c-da4d-4492-b382-34b7f2257a7c None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:28.487608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75100c-da4d-4492-b382-34b7f2257a7c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:28.487608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75100c-da4d-4492-b382-34b7f2257a7c None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:28.488910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 662/1344] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:23:28.494311 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091d5ce-5769-4247-8a48-7cc40eeece97 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:28.494803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091d5ce-5769-4247-8a48-7cc40eeece97 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:28.494803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091d5ce-5769-4247-8a48-7cc40eeece97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:28.568356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2091d5ce-5769-4247-8a48-7cc40eeece97 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:28.569825 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2091d5ce-5769-4247-8a48-7cc40eeece97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:28.676360 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 683/1345] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:28.961918 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75100c-da4d-4492-b382-34b7f2257a7c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:28.963525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8e75100c-da4d-4492-b382-34b7f2257a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:29.058907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:29.078487 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75100c-da4d-4492-b382-34b7f2257a7c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:29.163693 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe291f-df82-4fcb-81dd-6a2777fbe255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:29.164304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe291f-df82-4fcb-81dd-6a2777fbe255 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:29.164579 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe291f-df82-4fcb-81dd-6a2777fbe255 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:29.164846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe291f-df82-4fcb-81dd-6a2777fbe255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:29.166510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5efe291f-df82-4fcb-81dd-6a2777fbe255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:29.298095 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe291f-df82-4fcb-81dd-6a2777fbe255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:29.299555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe291f-df82-4fcb-81dd-6a2777fbe255 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:29.318395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 663/1346] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:33.572989 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98239fe9-d005-4f20-8c7d-8a2b7b7d6df1 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.573753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98239fe9-d005-4f20-8c7d-8a2b7b7d6df1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.573753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98239fe9-d005-4f20-8c7d-8a2b7b7d6df1 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.575003 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 684/1347] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:33.580818 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac32c08-41f7-4c50-adcd-a16299fcaad1 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.581376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac32c08-41f7-4c50-adcd-a16299fcaad1 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.581376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac32c08-41f7-4c50-adcd-a16299fcaad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.598313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:33.655513 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-bac32c08-41f7-4c50-adcd-a16299fcaad1 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:33.656773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bac32c08-41f7-4c50-adcd-a16299fcaad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:33.772755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 664/1348] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:34.052646 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98239fe9-d005-4f20-8c7d-8a2b7b7d6df1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:34.057400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-98239fe9-d005-4f20-8c7d-8a2b7b7d6df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:34.119421 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:34.171913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98239fe9-d005-4f20-8c7d-8a2b7b7d6df1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:34.253517 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e2d0e-3ae8-4293-8d98-1c5f024400e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:34.254057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e2d0e-3ae8-4293-8d98-1c5f024400e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:34.254330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e2d0e-3ae8-4293-8d98-1c5f024400e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:34.254600 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e2d0e-3ae8-4293-8d98-1c5f024400e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:34.256362 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-643e2d0e-3ae8-4293-8d98-1c5f024400e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:34.384500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:34.389175 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e2d0e-3ae8-4293-8d98-1c5f024400e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:34.390676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e2d0e-3ae8-4293-8d98-1c5f024400e1 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:34.409319 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 685/1349] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:39.527635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369410f6-1ee3-47b9-9040-4c7f966e1439 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:39.528094 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369410f6-1ee3-47b9-9040-4c7f966e1439 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:39.528201 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369410f6-1ee3-47b9-9040-4c7f966e1439 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:39.529878 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 665/1350] 10.222.0.52 () {54 vars in 921 bytes} [Mon Aug 29 20:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:39.536238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c058a7-66b7-42e1-b3ac-08d3b3e725d7 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:39.536756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c058a7-66b7-42e1-b3ac-08d3b3e725d7 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:39.536844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c058a7-66b7-42e1-b3ac-08d3b3e725d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:39.669393 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f2c058a7-66b7-42e1-b3ac-08d3b3e725d7 None None] MFA Rules not processed for user `b8295272eec349f8aa38e44c861faa47`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:39.676085 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f2c058a7-66b7-42e1-b3ac-08d3b3e725d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:39.809725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 686/1351] 10.222.0.52 () {58 vars in 1018 bytes} [Mon Aug 29 20:23:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:43.774453 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=59 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:43.957723 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5686e51-128c-47ef-b0ef-a16d8fe6e9a0 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:43.957723 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5686e51-128c-47ef-b0ef-a16d8fe6e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:43.957723 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5686e51-128c-47ef-b0ef-a16d8fe6e9a0 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:43.959117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 666/1352] 10.222.0.52 () {54 vars in 921 bytes} [Mon Aug 29 20:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:43.964028 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed584063-9adf-4a8e-95b1-5cd23a3b4669 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:43.964537 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed584063-9adf-4a8e-95b1-5cd23a3b4669 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:43.964636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed584063-9adf-4a8e-95b1-5cd23a3b4669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:44.021390 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:44.049441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ed584063-9adf-4a8e-95b1-5cd23a3b4669 None None] MFA Rules not processed for user `b8295272eec349f8aa38e44c861faa47`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:44.050667 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ed584063-9adf-4a8e-95b1-5cd23a3b4669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:44.170114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 687/1353] 10.222.0.52 () {58 vars in 1018 bytes} [Mon Aug 29 20:23:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:45.631560 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a9801-b97c-44ec-9d19-05d18de23082 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:45.632449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a9801-b97c-44ec-9d19-05d18de23082 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:45.632449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a9801-b97c-44ec-9d19-05d18de23082 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:45.633349 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 667/1354] 10.222.0.52 () {54 vars in 921 bytes} [Mon Aug 29 20:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:45.639225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeaee7-ce28-410c-afcc-c5d39ac046d2 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:45.639687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeaee7-ce28-410c-afcc-c5d39ac046d2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:45.639781 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeaee7-ce28-410c-afcc-c5d39ac046d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:45.726762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-cdfeaee7-ce28-410c-afcc-c5d39ac046d2 None None] MFA Rules not processed for user `b8295272eec349f8aa38e44c861faa47`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:45.728078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cdfeaee7-ce28-410c-afcc-c5d39ac046d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:45.775680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:45.852922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 688/1355] 10.222.0.52 () {58 vars in 1018 bytes} [Mon Aug 29 20:23:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:49.172256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f6e08-a29d-4b77-8c4e-996824381e6e None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:49.172845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f6e08-a29d-4b77-8c4e-996824381e6e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:49.172845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f6e08-a29d-4b77-8c4e-996824381e6e None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:49.174080 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 668/1356] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:49.179397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379981d6-73a7-41f4-9f95-3d31021fb977 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:49.179896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379981d6-73a7-41f4-9f95-3d31021fb977 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:49.180002 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379981d6-73a7-41f4-9f95-3d31021fb977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:49.260109 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-379981d6-73a7-41f4-9f95-3d31021fb977 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:49.261666 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-379981d6-73a7-41f4-9f95-3d31021fb977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:49.381764 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 689/1357] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:49.690129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd854d6-2861-4fed-89ef-8e8b287f27de None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:49.690706 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd854d6-2861-4fed-89ef-8e8b287f27de None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:49.691732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd854d6-2861-4fed-89ef-8e8b287f27de None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:49.694313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 669/1358] 10.222.0.52 () {54 vars in 962 bytes} [Mon Aug 29 20:23:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:23:49.704939 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646e98b-ba10-418f-ad9a-e519200ebfd1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:49.705506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646e98b-ba10-418f-ad9a-e519200ebfd1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:49.705965 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646e98b-ba10-418f-ad9a-e519200ebfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:49.741886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:49.825875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6646e98b-ba10-418f-ad9a-e519200ebfd1 None None] MFA Rules not processed for user `9c95d16fd4da4fa7987b893eae0b3ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:49.827217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6646e98b-ba10-418f-ad9a-e519200ebfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:49.959000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 690/1359] 10.222.0.52 () {58 vars in 1059 bytes} [Mon Aug 29 20:23:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:49.967279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd854d6-2861-4fed-89ef-8e8b287f27de None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:49.968790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9fd854d6-2861-4fed-89ef-8e8b287f27de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:50.138762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd854d6-2861-4fed-89ef-8e8b287f27de None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:50.225865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:50.273534 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42392eca-79a5-47dd-98dd-cc7dc5cf3ac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:50.274327 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42392eca-79a5-47dd-98dd-cc7dc5cf3ac6 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:50.274701 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42392eca-79a5-47dd-98dd-cc7dc5cf3ac6 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:50.275069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42392eca-79a5-47dd-98dd-cc7dc5cf3ac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:50.276799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-42392eca-79a5-47dd-98dd-cc7dc5cf3ac6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:50.384512 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42392eca-79a5-47dd-98dd-cc7dc5cf3ac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:50.386203 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42392eca-79a5-47dd-98dd-cc7dc5cf3ac6 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:50.409562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 670/1360] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:52.643114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16e5c4-66fb-4520-af23-29346cafbb49 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:52.643657 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16e5c4-66fb-4520-af23-29346cafbb49 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:52.644188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16e5c4-66fb-4520-af23-29346cafbb49 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:52.645937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 691/1361] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:52.652175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf7978-9ee2-4cc0-90a8-65eee63bfabd None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:52.652685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf7978-9ee2-4cc0-90a8-65eee63bfabd None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:52.652788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf7978-9ee2-4cc0-90a8-65eee63bfabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:52.737850 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-bbaf7978-9ee2-4cc0-90a8-65eee63bfabd None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:52.739841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bbaf7978-9ee2-4cc0-90a8-65eee63bfabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:52.787544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:52.872931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 671/1362] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:53.166133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16e5c4-66fb-4520-af23-29346cafbb49 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:53.167860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3f16e5c4-66fb-4520-af23-29346cafbb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:53.255352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:53.378476 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16e5c4-66fb-4520-af23-29346cafbb49 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:53.521939 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaee05-aa0e-4996-80cc-e75cc307ceef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:53.522636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaee05-aa0e-4996-80cc-e75cc307ceef service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:53.522982 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaee05-aa0e-4996-80cc-e75cc307ceef service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:53.523478 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaee05-aa0e-4996-80cc-e75cc307ceef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:53.525126 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-afaaee05-aa0e-4996-80cc-e75cc307ceef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:53.555191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:53.643540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaee05-aa0e-4996-80cc-e75cc307ceef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:53.645335 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaee05-aa0e-4996-80cc-e75cc307ceef service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:53.667413 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 692/1363] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:55.995094 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894af5ed-f5c4-4e43-9296-d139b6597b00 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:55.995672 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894af5ed-f5c4-4e43-9296-d139b6597b00 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:55.995672 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894af5ed-f5c4-4e43-9296-d139b6597b00 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:55.997045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 672/1364] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:56.002761 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1aedb-d0fb-49b1-81a6-2e53f98df684 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:56.003578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1aedb-d0fb-49b1-81a6-2e53f98df684 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:56.003848 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1aedb-d0fb-49b1-81a6-2e53f98df684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:56.082552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-06f1aedb-d0fb-49b1-81a6-2e53f98df684 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:56.083808 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-06f1aedb-d0fb-49b1-81a6-2e53f98df684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:56.202867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:56.212390 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 693/1365] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:56.515961 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21e034-b7bf-4353-bb89-3a26f8a04b90 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:56.516310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21e034-b7bf-4353-bb89-3a26f8a04b90 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:56.516659 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21e034-b7bf-4353-bb89-3a26f8a04b90 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:56.519386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 673/1366] 10.222.0.52 () {54 vars in 962 bytes} [Mon Aug 29 20:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:56.526294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd54a3c-f9a1-4866-928f-a52b740246c2 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:56.526768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd54a3c-f9a1-4866-928f-a52b740246c2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:56.527184 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd54a3c-f9a1-4866-928f-a52b740246c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:56.617508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-0bd54a3c-f9a1-4866-928f-a52b740246c2 None None] MFA Rules not processed for user `9c95d16fd4da4fa7987b893eae0b3ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:56.618682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0bd54a3c-f9a1-4866-928f-a52b740246c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:56.754798 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 694/1367] 10.222.0.52 () {58 vars in 1059 bytes} [Mon Aug 29 20:23:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:56.762720 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21e034-b7bf-4353-bb89-3a26f8a04b90 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:56.765904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4a21e034-b7bf-4353-bb89-3a26f8a04b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:56.947883 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21e034-b7bf-4353-bb89-3a26f8a04b90 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:56.974994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:57.106166 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba2505-88fa-4e5d-8d89-f521ee92adb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:57.107202 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2505-88fa-4e5d-8d89-f521ee92adb8 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:57.107695 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2505-88fa-4e5d-8d89-f521ee92adb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:57.108185 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2505-88fa-4e5d-8d89-f521ee92adb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:57.111238 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f9ba2505-88fa-4e5d-8d89-f521ee92adb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:57.231828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba2505-88fa-4e5d-8d89-f521ee92adb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:57.233557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba2505-88fa-4e5d-8d89-f521ee92adb8 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:57.254104 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 674/1368] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:57.884594 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052e8ed-9b8c-4598-b3fe-123f2bb3bfba None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:57.885300 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052e8ed-9b8c-4598-b3fe-123f2bb3bfba None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:57.885300 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052e8ed-9b8c-4598-b3fe-123f2bb3bfba None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:57.887257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 695/1369] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:23:57.892712 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc92787-8a1e-4860-af63-7ca173b0ac44 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:57.893039 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc92787-8a1e-4860-af63-7ca173b0ac44 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:57.893330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc92787-8a1e-4860-af63-7ca173b0ac44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:57.929049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:57.970093 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-8bc92787-8a1e-4860-af63-7ca173b0ac44 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:57.971403 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8bc92787-8a1e-4860-af63-7ca173b0ac44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:58.090892 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 675/1370] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:58.677806 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6fa57-d43b-4aa8-9a57-fa5418a67f4b None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:58.678113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6fa57-d43b-4aa8-9a57-fa5418a67f4b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:58.678358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6fa57-d43b-4aa8-9a57-fa5418a67f4b None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:58.680579 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 696/1371] 10.222.0.52 () {54 vars in 964 bytes} [Mon Aug 29 20:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:58.685869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49571abb-8aff-4b04-b19b-1bae9dc8adab None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:58.686375 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49571abb-8aff-4b04-b19b-1bae9dc8adab None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:58.686470 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49571abb-8aff-4b04-b19b-1bae9dc8adab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:58.780588 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-49571abb-8aff-4b04-b19b-1bae9dc8adab None None] MFA Rules not processed for user `960a2be5cb58461fb9fb8e99094398d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:58.781830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-49571abb-8aff-4b04-b19b-1bae9dc8adab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:58.832457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:58.866592 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 676/1372] 10.222.0.52 () {58 vars in 1061 bytes} [Mon Aug 29 20:23:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:58.874106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6fa57-d43b-4aa8-9a57-fa5418a67f4b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:58.875788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5ed6fa57-d43b-4aa8-9a57-fa5418a67f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:58.931665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:59.012649 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6fa57-d43b-4aa8-9a57-fa5418a67f4b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:59.153968 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c9e6a-ba7c-4deb-86e3-594fefbefe54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:59.155030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c9e6a-ba7c-4deb-86e3-594fefbefe54 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:59.155515 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c9e6a-ba7c-4deb-86e3-594fefbefe54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:59.156018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c9e6a-ba7c-4deb-86e3-594fefbefe54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:59.159208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7b8c9e6a-ba7c-4deb-86e3-594fefbefe54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:59.325954 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252345a6-fb36-4969-9285-863e50a518a4 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:59.325954 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252345a6-fb36-4969-9285-863e50a518a4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:59.325954 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252345a6-fb36-4969-9285-863e50a518a4 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:59.328909 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 677/1373] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:23:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:59.338765 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20b380-5fec-442e-8b7b-1d7eabdf03d9 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:59.339348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20b380-5fec-442e-8b7b-1d7eabdf03d9 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:59.339806 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20b380-5fec-442e-8b7b-1d7eabdf03d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:59.367895 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:59.392483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c9e6a-ba7c-4deb-86e3-594fefbefe54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:59.394400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c9e6a-ba7c-4deb-86e3-594fefbefe54 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:59.419967 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 697/1374] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:59.505929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-be20b380-5fec-442e-8b7b-1d7eabdf03d9 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:59.507582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-be20b380-5fec-442e-8b7b-1d7eabdf03d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:59.654351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 678/1375] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:59.950758 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c9e6a-ba7c-4deb-86e3-594fefbefe54 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:59.952383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7b8c9e6a-ba7c-4deb-86e3-594fefbefe54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:00.086884 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c9e6a-ba7c-4deb-86e3-594fefbefe54 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:00.232293 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:00.246853 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe6142-526a-4af5-b13c-fb18f9be70d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:00.247472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe6142-526a-4af5-b13c-fb18f9be70d4 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:00.247752 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe6142-526a-4af5-b13c-fb18f9be70d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:00.248030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe6142-526a-4af5-b13c-fb18f9be70d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:00.249807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-09fe6142-526a-4af5-b13c-fb18f9be70d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:00.384456 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe6142-526a-4af5-b13c-fb18f9be70d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:00.386126 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe6142-526a-4af5-b13c-fb18f9be70d4 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:00.404605 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 698/1376] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:02.429198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6dbf2-d370-437d-bb64-2cd8733ac08d None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:02.429777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6dbf2-d370-437d-bb64-2cd8733ac08d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:02.429777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6dbf2-d370-437d-bb64-2cd8733ac08d None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:02.431057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 679/1377] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:02.436637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9a57-ebab-4327-a8df-8b7e63693978 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:02.437156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9a57-ebab-4327-a8df-8b7e63693978 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:02.437156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9a57-ebab-4327-a8df-8b7e63693978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:02.514734 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4bad9a57-ebab-4327-a8df-8b7e63693978 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:02.515962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4bad9a57-ebab-4327-a8df-8b7e63693978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:02.592133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:02.651856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 699/1378] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:02.940884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6dbf2-d370-437d-bb64-2cd8733ac08d None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:02.942474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-76c6dbf2-d370-437d-bb64-2cd8733ac08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:03.001757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:03.142585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6dbf2-d370-437d-bb64-2cd8733ac08d None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:03.288694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059fd38-f085-40c9-b678-690a9c4f545b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:03.289858 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059fd38-f085-40c9-b678-690a9c4f545b service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:03.290114 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059fd38-f085-40c9-b678-690a9c4f545b service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:03.290398 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059fd38-f085-40c9-b678-690a9c4f545b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:03.292366 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7059fd38-f085-40c9-b678-690a9c4f545b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:03.305749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:03.410049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059fd38-f085-40c9-b678-690a9c4f545b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:03.411668 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059fd38-f085-40c9-b678-690a9c4f545b service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:03.434293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 680/1379] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:05.489306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74a387-aaad-4c3e-859e-1464dfd7e681 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:05.489947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74a387-aaad-4c3e-859e-1464dfd7e681 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:05.489947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74a387-aaad-4c3e-859e-1464dfd7e681 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:05.491428 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 700/1380] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:05.496828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ac037-e8c2-4c09-90d5-9431855a1641 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:05.497379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ac037-e8c2-4c09-90d5-9431855a1641 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:05.497379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ac037-e8c2-4c09-90d5-9431855a1641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:05.569265 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ac9ac037-e8c2-4c09-90d5-9431855a1641 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:05.570855 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ac9ac037-e8c2-4c09-90d5-9431855a1641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:05.667832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:05.686900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 681/1381] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:06.020744 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74a387-aaad-4c3e-859e-1464dfd7e681 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:06.020744 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4d74a387-aaad-4c3e-859e-1464dfd7e681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:06.265437 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74a387-aaad-4c3e-859e-1464dfd7e681 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:06.350020 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:06.431047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d24e1-9228-4a82-96ee-1b0007c3216a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:06.431771 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d24e1-9228-4a82-96ee-1b0007c3216a service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:06.432120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d24e1-9228-4a82-96ee-1b0007c3216a service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:06.432465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d24e1-9228-4a82-96ee-1b0007c3216a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:06.434537 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-039d24e1-9228-4a82-96ee-1b0007c3216a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:06.540907 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d24e1-9228-4a82-96ee-1b0007c3216a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:06.542508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d24e1-9228-4a82-96ee-1b0007c3216a service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:06.564480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 701/1382] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:08.812991 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d21e34-3045-4f1c-8130-b0705ff60e44 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:08.813594 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d21e34-3045-4f1c-8130-b0705ff60e44 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:08.813904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d21e34-3045-4f1c-8130-b0705ff60e44 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:08.816205 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 682/1383] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:24:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:08.825494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d3af-92ca-44c3-b763-f346fbff76f3 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:08.826072 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d3af-92ca-44c3-b763-f346fbff76f3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:08.826444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d3af-92ca-44c3-b763-f346fbff76f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:08.917286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-dc37d3af-92ca-44c3-b763-f346fbff76f3 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:08.918772 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-dc37d3af-92ca-44c3-b763-f346fbff76f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:08.921179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:09.048116 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 702/1384] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:09.361894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d21e34-3045-4f1c-8130-b0705ff60e44 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:09.363566 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-45d21e34-3045-4f1c-8130-b0705ff60e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:09.549802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d21e34-3045-4f1c-8130-b0705ff60e44 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:09.628916 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:09.708644 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224c87a-6a57-4c43-962e-86adb834b941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:09.709685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224c87a-6a57-4c43-962e-86adb834b941 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:09.710191 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224c87a-6a57-4c43-962e-86adb834b941 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:09.710621 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224c87a-6a57-4c43-962e-86adb834b941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:09.713772 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6224c87a-6a57-4c43-962e-86adb834b941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:09.859039 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224c87a-6a57-4c43-962e-86adb834b941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:09.860860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224c87a-6a57-4c43-962e-86adb834b941 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:09.883167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 683/1385] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:12.435006 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9a08e-4745-402f-ab7f-0a640bb09ecb None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:12.435871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9a08e-4745-402f-ab7f-0a640bb09ecb None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:12.436243 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9a08e-4745-402f-ab7f-0a640bb09ecb None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:12.438356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 703/1386] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:24:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:12.445128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bf1e2-4d16-457a-9fd7-f677d3a51466 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:12.446065 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bf1e2-4d16-457a-9fd7-f677d3a51466 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:12.446065 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bf1e2-4d16-457a-9fd7-f677d3a51466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:12.523752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-051bf1e2-4d16-457a-9fd7-f677d3a51466 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:12.524993 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-051bf1e2-4d16-457a-9fd7-f677d3a51466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:12.563325 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:12.686491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 684/1387] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:24:13.053409 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9a08e-4745-402f-ab7f-0a640bb09ecb None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:13.055639 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-31e9a08e-4745-402f-ab7f-0a640bb09ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:13.208493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:13.227419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9a08e-4745-402f-ab7f-0a640bb09ecb None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:13.349637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffaf93-a3dd-4e2b-af9a-f5be76d43a0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:13.350129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffaf93-a3dd-4e2b-af9a-f5be76d43a0d service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:13.350402 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffaf93-a3dd-4e2b-af9a-f5be76d43a0d service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:13.350665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffaf93-a3dd-4e2b-af9a-f5be76d43a0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:13.352501 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c0ffaf93-a3dd-4e2b-af9a-f5be76d43a0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:13.451949 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffaf93-a3dd-4e2b-af9a-f5be76d43a0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:13.454365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffaf93-a3dd-4e2b-af9a-f5be76d43a0d service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:13.460190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:13.476849 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 704/1388] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:14.857525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c96d6a-b6d3-48fd-bf8f-934556c919bc None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:14.858132 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c96d6a-b6d3-48fd-bf8f-934556c919bc None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:14.858132 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c96d6a-b6d3-48fd-bf8f-934556c919bc None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:14.859505 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 685/1389] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:14.865011 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aacc8-78ec-48f0-9d7d-92c57a184d4e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:14.865472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aacc8-78ec-48f0-9d7d-92c57a184d4e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:14.865595 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aacc8-78ec-48f0-9d7d-92c57a184d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:14.939201 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-176aacc8-78ec-48f0-9d7d-92c57a184d4e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:14.940399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-176aacc8-78ec-48f0-9d7d-92c57a184d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:15.049107 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 705/1390] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:24:15.352583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73af13-0a22-4e3e-acf0-ab924a0f57d8 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:15.352954 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73af13-0a22-4e3e-acf0-ab924a0f57d8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:15.353227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73af13-0a22-4e3e-acf0-ab924a0f57d8 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:15.354922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 686/1391] 10.222.0.52 () {54 vars in 967 bytes} [Mon Aug 29 20:24:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:15.360668 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af41170-35cf-4b7e-88a9-4e8d6ad76b96 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:15.361029 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af41170-35cf-4b7e-88a9-4e8d6ad76b96 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:15.361426 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af41170-35cf-4b7e-88a9-4e8d6ad76b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:15.453633 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4af41170-35cf-4b7e-88a9-4e8d6ad76b96 None None] MFA Rules not processed for user `47429aec6d8a4339b4ec0fb32b25e90b`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:15.454849 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4af41170-35cf-4b7e-88a9-4e8d6ad76b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:15.469923 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:15.511887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3e125-5380-4e86-97f9-837b08eefb44 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:15.512374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3e125-5380-4e86-97f9-837b08eefb44 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:15.512775 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3e125-5380-4e86-97f9-837b08eefb44 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:15.514067 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 687/1392] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:15.519807 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cf98e-f235-44f5-9a7b-8fabac1e3666 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:15.520088 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cf98e-f235-44f5-9a7b-8fabac1e3666 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:15.520361 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cf98e-f235-44f5-9a7b-8fabac1e3666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:15.538074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 706/1393] 10.222.0.52 () {58 vars in 1064 bytes} [Mon Aug 29 20:24:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:24:15.546401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af41170-35cf-4b7e-88a9-4e8d6ad76b96 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:15.555244 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af41170-35cf-4b7e-88a9-4e8d6ad76b96 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:15.598006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-045cf98e-f235-44f5-9a7b-8fabac1e3666 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:15.599134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-045cf98e-f235-44f5-9a7b-8fabac1e3666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:15.636804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cbbf8-b49f-4373-a42c-288cb142e546 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47429aec6d8a4339b4ec0fb32b25e90b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:15.637389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cbbf8-b49f-4373-a42c-288cb142e546 service glance] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:15.637726 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cbbf8-b49f-4373-a42c-288cb142e546 service glance] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:15.637976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cbbf8-b49f-4373-a42c-288cb142e546 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:15.639679 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9a0cbbf8-b49f-4373-a42c-288cb142e546 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:15.710362 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 688/1394] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:15.731332 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:15.771211 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cbbf8-b49f-4373-a42c-288cb142e546 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:15.772888 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cbbf8-b49f-4373-a42c-288cb142e546 service glance] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:15.794477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 707/1395] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:15.998448 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cf98e-f235-44f5-9a7b-8fabac1e3666 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:15.999653 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-045cf98e-f235-44f5-9a7b-8fabac1e3666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:16.008613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:16.142598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cf98e-f235-44f5-9a7b-8fabac1e3666 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:16.303919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df6a1d-cdf3-44fc-a985-f1b4d3cf745a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:16.304533 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df6a1d-cdf3-44fc-a985-f1b4d3cf745a service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:16.304811 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df6a1d-cdf3-44fc-a985-f1b4d3cf745a service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:16.305081 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df6a1d-cdf3-44fc-a985-f1b4d3cf745a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:16.306819 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-75df6a1d-cdf3-44fc-a985-f1b4d3cf745a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:16.309303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:16.415312 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df6a1d-cdf3-44fc-a985-f1b4d3cf745a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:16.417020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df6a1d-cdf3-44fc-a985-f1b4d3cf745a service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:16.439654 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 689/1396] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:16.562036 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6a0cd-9b6e-497d-911a-702b4e729876 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:16.562698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6a0cd-9b6e-497d-911a-702b4e729876 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:16.562698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6a0cd-9b6e-497d-911a-702b4e729876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:16.642224 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-62f6a0cd-9b6e-497d-911a-702b4e729876 None None] MFA Rules not processed for user `0327aa38835f41a7a82802f9cad2e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:16.643796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-62f6a0cd-9b6e-497d-911a-702b4e729876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:16.737744 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 708/1397] 10.222.0.52 () {58 vars in 1009 bytes} [Mon Aug 29 20:24:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:16.783576 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d9f27-a747-4d0b-825d-18af5602b430 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:16.783899 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d9f27-a747-4d0b-825d-18af5602b430 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:16.784173 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d9f27-a747-4d0b-825d-18af5602b430 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:16.785617 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 690/1398] 10.222.0.52 () {54 vars in 943 bytes} [Mon Aug 29 20:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:16.792306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f1bbe-d3da-4251-80a6-e5917263e520 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:16.792583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f1bbe-d3da-4251-80a6-e5917263e520 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:16.793121 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f1bbe-d3da-4251-80a6-e5917263e520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:16.870301 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:16.887063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3e6f1bbe-d3da-4251-80a6-e5917263e520 None None] MFA Rules not processed for user `dcb9791ea73d46b191ad9fc146297565`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:16.888767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3e6f1bbe-d3da-4251-80a6-e5917263e520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:17.005302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 709/1399] 10.222.0.52 () {58 vars in 1040 bytes} [Mon Aug 29 20:24:16 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:17.015344 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d9f27-a747-4d0b-825d-18af5602b430 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:17.016903 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-962d9f27-a747-4d0b-825d-18af5602b430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:17.182334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:17.192069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d9f27-a747-4d0b-825d-18af5602b430 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:17.314421 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61706a95-d8f5-4d32-8925-0d02aab89ea1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9791ea73d46b191ad9fc146297565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:17.315034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61706a95-d8f5-4d32-8925-0d02aab89ea1 service swift] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:17.315309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61706a95-d8f5-4d32-8925-0d02aab89ea1 service swift] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:17.315594 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61706a95-d8f5-4d32-8925-0d02aab89ea1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:17.317205 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-61706a95-d8f5-4d32-8925-0d02aab89ea1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:17.409971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61706a95-d8f5-4d32-8925-0d02aab89ea1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:17.411623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61706a95-d8f5-4d32-8925-0d02aab89ea1 service swift] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:17.420299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 691/1400] 10.222.0.52 () {60 vars in 1384 bytes} [Mon Aug 29 20:24:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:24:18.487198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5414e98-37c0-46c9-ba27-89930f14d598 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:18.488108 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5414e98-37c0-46c9-ba27-89930f14d598 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:18.488108 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5414e98-37c0-46c9-ba27-89930f14d598 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:18.493913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 710/1401] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:24:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:24:18.496130 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548b089-3710-4cac-a55e-bf01d6dedb70 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:18.496790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548b089-3710-4cac-a55e-bf01d6dedb70 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:18.496963 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548b089-3710-4cac-a55e-bf01d6dedb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:18.551070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:18.599375 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6548b089-3710-4cac-a55e-bf01d6dedb70 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:18.600617 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6548b089-3710-4cac-a55e-bf01d6dedb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:18.749387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 692/1402] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:19.041133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5414e98-37c0-46c9-ba27-89930f14d598 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:19.043040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c5414e98-37c0-46c9-ba27-89930f14d598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:19.206265 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:19.260494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5414e98-37c0-46c9-ba27-89930f14d598 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:19.439600 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17101d-fe70-4403-b162-aa8a9ace1ff4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:19.440290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17101d-fe70-4403-b162-aa8a9ace1ff4 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:19.440540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17101d-fe70-4403-b162-aa8a9ace1ff4 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:19.440964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17101d-fe70-4403-b162-aa8a9ace1ff4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:19.442675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ff17101d-fe70-4403-b162-aa8a9ace1ff4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:19.575024 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:19.598297 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17101d-fe70-4403-b162-aa8a9ace1ff4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:19.600537 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17101d-fe70-4403-b162-aa8a9ace1ff4 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:19.622783 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 711/1403] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:21.992942 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4b341-96fb-4c40-9b48-553f48db1feb None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:21.993608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4b341-96fb-4c40-9b48-553f48db1feb None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:21.993737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4b341-96fb-4c40-9b48-553f48db1feb None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:21.995114 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 693/1404] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:22.006822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1951b17-f16c-4330-833e-d224e07251a2 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:22.007404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1951b17-f16c-4330-833e-d224e07251a2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:22.007867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1951b17-f16c-4330-833e-d224e07251a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:22.088764 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b1951b17-f16c-4330-833e-d224e07251a2 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:22.090009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b1951b17-f16c-4330-833e-d224e07251a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:22.228776 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 712/1405] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:24:22.583864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4b341-96fb-4c40-9b48-553f48db1feb None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:22.585513 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3ba4b341-96fb-4c40-9b48-553f48db1feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:22.740630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:22.806934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4b341-96fb-4c40-9b48-553f48db1feb None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:22.996970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba5ce2-8522-4bb4-815b-7fdc29ad94bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:22.997942 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba5ce2-8522-4bb4-815b-7fdc29ad94bc service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:22.997942 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba5ce2-8522-4bb4-815b-7fdc29ad94bc service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:22.998240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba5ce2-8522-4bb4-815b-7fdc29ad94bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:23.000393 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e1ba5ce2-8522-4bb4-815b-7fdc29ad94bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:23.117455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:23.160655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba5ce2-8522-4bb4-815b-7fdc29ad94bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:23.162419 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba5ce2-8522-4bb4-815b-7fdc29ad94bc service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:23.191355 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 694/1406] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:25.513558 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49d56-2c56-4591-80a9-6adc338d789f None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:25.514104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49d56-2c56-4591-80a9-6adc338d789f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:25.514104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49d56-2c56-4591-80a9-6adc338d789f None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:25.515429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 713/1407] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:25.521698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c8246-5c54-4423-9cc3-bd2941c0561d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:25.522620 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c8246-5c54-4423-9cc3-bd2941c0561d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:25.523100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c8246-5c54-4423-9cc3-bd2941c0561d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:25.612563 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-466c8246-5c54-4423-9cc3-bd2941c0561d None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:25.614120 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-466c8246-5c54-4423-9cc3-bd2941c0561d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:25.799723 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 695/1408] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:26.107967 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf49d56-2c56-4591-80a9-6adc338d789f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:26.110693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ccf49d56-2c56-4591-80a9-6adc338d789f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:26.178741 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:26.312559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf49d56-2c56-4591-80a9-6adc338d789f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:26.522893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019f60c-e7f3-41fe-a1ab-7ef3c22da496 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:26.522893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019f60c-e7f3-41fe-a1ab-7ef3c22da496 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:26.522893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019f60c-e7f3-41fe-a1ab-7ef3c22da496 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:26.522893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019f60c-e7f3-41fe-a1ab-7ef3c22da496 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:26.524105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7019f60c-e7f3-41fe-a1ab-7ef3c22da496 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:26.524105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:26.663898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019f60c-e7f3-41fe-a1ab-7ef3c22da496 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:26.665597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019f60c-e7f3-41fe-a1ab-7ef3c22da496 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:26.702118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 714/1409] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:35.795253 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=81 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:36.691524 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=40 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:40.208861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaffe0a-abf6-4f89-9e2e-e971757fa819 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:40.209474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaffe0a-abf6-4f89-9e2e-e971757fa819 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:40.209474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaffe0a-abf6-4f89-9e2e-e971757fa819 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:40.210777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 696/1410] 10.222.0.52 () {54 vars in 918 bytes} [Mon Aug 29 20:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:40.216148 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8ea9c-f7a7-457a-b4a8-8dc0b7dd17dc None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:40.216606 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8ea9c-f7a7-457a-b4a8-8dc0b7dd17dc None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:40.216723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8ea9c-f7a7-457a-b4a8-8dc0b7dd17dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:40.303470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-49c8ea9c-f7a7-457a-b4a8-8dc0b7dd17dc None None] MFA Rules not processed for user `b8295272eec349f8aa38e44c861faa47`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:40.304687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-49c8ea9c-f7a7-457a-b4a8-8dc0b7dd17dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:40.416695 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 715/1411] 10.222.0.52 () {58 vars in 1015 bytes} [Mon Aug 29 20:24:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:40.431080 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec2046-a328-48fc-9200-90bd0418d6c8 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:40.431353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec2046-a328-48fc-9200-90bd0418d6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:40.431622 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec2046-a328-48fc-9200-90bd0418d6c8 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:40.433007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 697/1412] 10.222.0.52 () {54 vars in 918 bytes} [Mon Aug 29 20:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:40.437942 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c2b69-0b70-4d73-9126-2de94cd0e084 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:40.438226 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c2b69-0b70-4d73-9126-2de94cd0e084 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:40.438500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c2b69-0b70-4d73-9126-2de94cd0e084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:40.525484 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:40.529234 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-154c2b69-0b70-4d73-9126-2de94cd0e084 None None] MFA Rules not processed for user `9c95d16fd4da4fa7987b893eae0b3ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:40.530864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-154c2b69-0b70-4d73-9126-2de94cd0e084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:40.652588 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 716/1413] 10.222.0.52 () {58 vars in 1015 bytes} [Mon Aug 29 20:24:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:43.181944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086ede2-5d0f-4daf-9faa-30c89474b712 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:43.182521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086ede2-5d0f-4daf-9faa-30c89474b712 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:43.182521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086ede2-5d0f-4daf-9faa-30c89474b712 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:43.183881 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 698/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:43.191090 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fac8b-18f9-43ce-ab99-f2e81d132a6a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:43.191702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fac8b-18f9-43ce-ab99-f2e81d132a6a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:43.191830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fac8b-18f9-43ce-ab99-f2e81d132a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:43.266854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d11fac8b-18f9-43ce-ab99-f2e81d132a6a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:43.268098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d11fac8b-18f9-43ce-ab99-f2e81d132a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:43.338801 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:43.406121 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 717/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:43.696287 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086ede2-5d0f-4daf-9faa-30c89474b712 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:43.699530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c086ede2-5d0f-4daf-9faa-30c89474b712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:43.876569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086ede2-5d0f-4daf-9faa-30c89474b712 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:43.958835 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:44.005867 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53208a78-fb8a-4d1a-a421-d1e0cf3f7f9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:44.006490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208a78-fb8a-4d1a-a421-d1e0cf3f7f9a service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:44.006762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208a78-fb8a-4d1a-a421-d1e0cf3f7f9a service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:44.007036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208a78-fb8a-4d1a-a421-d1e0cf3f7f9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:44.008704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-53208a78-fb8a-4d1a-a421-d1e0cf3f7f9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:44.113095 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53208a78-fb8a-4d1a-a421-d1e0cf3f7f9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:44.114763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53208a78-fb8a-4d1a-a421-d1e0cf3f7f9a service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:44.134219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 699/1416] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:45.035096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d398aad-f00c-4dc4-a3a9-082d46d9afd6 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:45.035707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d398aad-f00c-4dc4-a3a9-082d46d9afd6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:45.035707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d398aad-f00c-4dc4-a3a9-082d46d9afd6 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:45.037108 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 718/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:45.043170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccf91c-1466-4b22-b64b-80e7bd08217a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:45.043888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccf91c-1466-4b22-b64b-80e7bd08217a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:45.043888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccf91c-1466-4b22-b64b-80e7bd08217a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:45.137167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d4ccf91c-1466-4b22-b64b-80e7bd08217a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:45.138580 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d4ccf91c-1466-4b22-b64b-80e7bd08217a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:45.171980 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:45.268515 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 700/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:45.423053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d398aad-f00c-4dc4-a3a9-082d46d9afd6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:45.424572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1d398aad-f00c-4dc4-a3a9-082d46d9afd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:45.585056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d398aad-f00c-4dc4-a3a9-082d46d9afd6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:45.632236 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:45.712152 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61c40c-2cfe-4ee0-a392-6ecfa50c7aaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:45.712769 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61c40c-2cfe-4ee0-a392-6ecfa50c7aaf service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:45.713049 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61c40c-2cfe-4ee0-a392-6ecfa50c7aaf service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:45.713328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61c40c-2cfe-4ee0-a392-6ecfa50c7aaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:45.715154 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9e61c40c-2cfe-4ee0-a392-6ecfa50c7aaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:45.812232 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61c40c-2cfe-4ee0-a392-6ecfa50c7aaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:45.813901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61c40c-2cfe-4ee0-a392-6ecfa50c7aaf service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:45.833078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 719/1419] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:46.731536 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71d148-728f-48f9-8089-0b8da2de4e71 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:46.732131 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71d148-728f-48f9-8089-0b8da2de4e71 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:46.732415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71d148-728f-48f9-8089-0b8da2de4e71 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:46.733895 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 701/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:24:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:46.739173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040219d2-931b-4581-8915-3f8445605046 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:46.739681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040219d2-931b-4581-8915-3f8445605046 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:46.739777 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040219d2-931b-4581-8915-3f8445605046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:46.799263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:46.823801 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-040219d2-931b-4581-8915-3f8445605046 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:46.825400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-040219d2-931b-4581-8915-3f8445605046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:46.934062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 720/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:47.089808 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71d148-728f-48f9-8089-0b8da2de4e71 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:47.091228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9f71d148-728f-48f9-8089-0b8da2de4e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:47.281114 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71d148-728f-48f9-8089-0b8da2de4e71 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:47.294842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:47.429402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a78d0-5d7c-4db1-ad45-09fabc24413b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:47.429402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a78d0-5d7c-4db1-ad45-09fabc24413b service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:47.429402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a78d0-5d7c-4db1-ad45-09fabc24413b service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:47.429402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a78d0-5d7c-4db1-ad45-09fabc24413b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:47.431175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-574a78d0-5d7c-4db1-ad45-09fabc24413b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:47.543674 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a78d0-5d7c-4db1-ad45-09fabc24413b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:47.545322 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a78d0-5d7c-4db1-ad45-09fabc24413b service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:47.564470 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 702/1422] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:48.446842 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280482-83fb-494c-bcd9-8ab1a454e37c None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:48.447458 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280482-83fb-494c-bcd9-8ab1a454e37c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:48.447458 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280482-83fb-494c-bcd9-8ab1a454e37c None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:48.449290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 721/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:24:48.455215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c71b9d-323f-4ac3-aec3-245d7364c845 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:48.455722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c71b9d-323f-4ac3-aec3-245d7364c845 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:48.455828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c71b9d-323f-4ac3-aec3-245d7364c845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:48.483074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:48.553025 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-59c71b9d-323f-4ac3-aec3-245d7364c845 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:48.554290 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-59c71b9d-323f-4ac3-aec3-245d7364c845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:48.659930 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 703/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:48.810911 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36280482-83fb-494c-bcd9-8ab1a454e37c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:48.812473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-36280482-83fb-494c-bcd9-8ab1a454e37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:48.933076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:48.969525 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36280482-83fb-494c-bcd9-8ab1a454e37c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:49.101582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8979cd6-c38b-4a19-9e04-3eee82eca36a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:49.102200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8979cd6-c38b-4a19-9e04-3eee82eca36a service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.102472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8979cd6-c38b-4a19-9e04-3eee82eca36a service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.102740 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8979cd6-c38b-4a19-9e04-3eee82eca36a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.104401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e8979cd6-c38b-4a19-9e04-3eee82eca36a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:49.183330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:49.198314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8979cd6-c38b-4a19-9e04-3eee82eca36a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:49.200283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8979cd6-c38b-4a19-9e04-3eee82eca36a service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:49.218763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 722/1425] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:24:50.082937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6233c7-299b-49e2-8ff7-e9e29b8b57ae None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:50.083546 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6233c7-299b-49e2-8ff7-e9e29b8b57ae None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:50.083546 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6233c7-299b-49e2-8ff7-e9e29b8b57ae None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:50.084845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 704/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:50.090510 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e035bb0-ce4f-4698-9c8a-8c5a084995a8 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:50.091045 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e035bb0-ce4f-4698-9c8a-8c5a084995a8 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:50.091045 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e035bb0-ce4f-4698-9c8a-8c5a084995a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:50.173451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-9e035bb0-ce4f-4698-9c8a-8c5a084995a8 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:50.174866 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9e035bb0-ce4f-4698-9c8a-8c5a084995a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:50.296169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 723/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:50.481578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6233c7-299b-49e2-8ff7-e9e29b8b57ae None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:50.483175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ab6233c7-299b-49e2-8ff7-e9e29b8b57ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:50.603342 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:50.688625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6233c7-299b-49e2-8ff7-e9e29b8b57ae None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:50.840742 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527f660-2f2d-4304-a8ab-a05c7ad5c008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:50.841524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f660-2f2d-4304-a8ab-a05c7ad5c008 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:50.841843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f660-2f2d-4304-a8ab-a05c7ad5c008 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:50.842131 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f660-2f2d-4304-a8ab-a05c7ad5c008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:50.844007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c527f660-2f2d-4304-a8ab-a05c7ad5c008 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:50.910155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:50.965235 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527f660-2f2d-4304-a8ab-a05c7ad5c008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:50.966951 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527f660-2f2d-4304-a8ab-a05c7ad5c008 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:50.989983 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 705/1428] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:51.889908 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb1fb6-8976-496b-8822-fbbaab67441e None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:51.890495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb1fb6-8976-496b-8822-fbbaab67441e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:51.890495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb1fb6-8976-496b-8822-fbbaab67441e None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:51.891792 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 724/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:51.896971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa721325-4ee3-4ab8-8b78-dad4af208a2a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:51.897574 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa721325-4ee3-4ab8-8b78-dad4af208a2a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:51.897574 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa721325-4ee3-4ab8-8b78-dad4af208a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:51.986399 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-fa721325-4ee3-4ab8-8b78-dad4af208a2a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:51.987842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fa721325-4ee3-4ab8-8b78-dad4af208a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:52.098935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 706/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:52.257877 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb1fb6-8976-496b-8822-fbbaab67441e None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:52.259429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6bfb1fb6-8976-496b-8822-fbbaab67441e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:52.314928 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:52.422558 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb1fb6-8976-496b-8822-fbbaab67441e None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:52.541709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8389e8-956f-4794-8eb6-ab6ff18e7298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:52.542225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8389e8-956f-4794-8eb6-ab6ff18e7298 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:52.542502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8389e8-956f-4794-8eb6-ab6ff18e7298 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:52.542767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8389e8-956f-4794-8eb6-ab6ff18e7298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:52.544382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2d8389e8-956f-4794-8eb6-ab6ff18e7298 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:52.551652 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:52.643046 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8389e8-956f-4794-8eb6-ab6ff18e7298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:52.644698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8389e8-956f-4794-8eb6-ab6ff18e7298 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:52.668245 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 725/1431] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:53.500275 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48ae07-5663-4099-9406-01e320a45b60 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:53.500871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48ae07-5663-4099-9406-01e320a45b60 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:53.500871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48ae07-5663-4099-9406-01e320a45b60 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:53.502260 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 707/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:53.508187 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60717393-c723-497b-92ab-2de20975695a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:53.508741 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60717393-c723-497b-92ab-2de20975695a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:53.508741 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60717393-c723-497b-92ab-2de20975695a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:53.586794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-60717393-c723-497b-92ab-2de20975695a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:53.588101 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-60717393-c723-497b-92ab-2de20975695a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:53.663070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:53.697548 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 726/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:53.849050 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48ae07-5663-4099-9406-01e320a45b60 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:53.850668 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3c48ae07-5663-4099-9406-01e320a45b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:53.873672 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:54.015056 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48ae07-5663-4099-9406-01e320a45b60 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:54.109738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:54.138317 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6abaa-58d0-40c8-911e-ba89239c1a50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:54.138973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6abaa-58d0-40c8-911e-ba89239c1a50 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:54.139249 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6abaa-58d0-40c8-911e-ba89239c1a50 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:54.139509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6abaa-58d0-40c8-911e-ba89239c1a50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:54.141149 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-09d6abaa-58d0-40c8-911e-ba89239c1a50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:54.236589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6abaa-58d0-40c8-911e-ba89239c1a50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:54.238252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6abaa-58d0-40c8-911e-ba89239c1a50 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:54.256784 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 708/1434] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:55.094844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b2fff-42c6-4d4a-b9b4-e30571593d30 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:55.095760 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b2fff-42c6-4d4a-b9b4-e30571593d30 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:55.095760 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b2fff-42c6-4d4a-b9b4-e30571593d30 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:55.097684 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 727/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:24:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:55.105343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3cc66-d5e2-4e08-ad16-c3c4420b2814 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:55.105830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3cc66-d5e2-4e08-ad16-c3c4420b2814 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:55.105930 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3cc66-d5e2-4e08-ad16-c3c4420b2814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:55.201050 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3ff3cc66-d5e2-4e08-ad16-c3c4420b2814 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:55.202498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3ff3cc66-d5e2-4e08-ad16-c3c4420b2814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:55.245395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:55.301575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 709/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:55.467535 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b2fff-42c6-4d4a-b9b4-e30571593d30 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:55.469442 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-728b2fff-42c6-4d4a-b9b4-e30571593d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:55.658501 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b2fff-42c6-4d4a-b9b4-e30571593d30 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:55.715520 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:55.782667 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710cb3d-2655-4e60-80a7-6f2a947a54cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:55.783186 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710cb3d-2655-4e60-80a7-6f2a947a54cc service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:55.783453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710cb3d-2655-4e60-80a7-6f2a947a54cc service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:55.783721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710cb3d-2655-4e60-80a7-6f2a947a54cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:55.785441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0710cb3d-2655-4e60-80a7-6f2a947a54cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:55.892991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710cb3d-2655-4e60-80a7-6f2a947a54cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:55.894668 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710cb3d-2655-4e60-80a7-6f2a947a54cc service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:55.915083 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 728/1437] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:56.732028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cd28b-3caf-4c70-9696-fa143b3a99a5 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:56.732617 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cd28b-3caf-4c70-9696-fa143b3a99a5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:56.732790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cd28b-3caf-4c70-9696-fa143b3a99a5 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:56.734257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 710/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:24:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:56.741913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8243-8ecf-4cb4-95a8-1e6dfc49c660 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:56.742469 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8243-8ecf-4cb4-95a8-1e6dfc49c660 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:56.742469 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8243-8ecf-4cb4-95a8-1e6dfc49c660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:56.823346 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ec8c8243-8ecf-4cb4-95a8-1e6dfc49c660 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:56.824917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ec8c8243-8ecf-4cb4-95a8-1e6dfc49c660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:56.827224 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:56.937689 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 729/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:57.091856 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cd28b-3caf-4c70-9696-fa143b3a99a5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:57.093296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-cb5cd28b-3caf-4c70-9696-fa143b3a99a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:57.274613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cd28b-3caf-4c70-9696-fa143b3a99a5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:57.302780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:57.399345 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037bfeb7-087d-438d-9038-0fe73ab5bf60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:57.400299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bfeb7-087d-438d-9038-0fe73ab5bf60 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:57.400760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bfeb7-087d-438d-9038-0fe73ab5bf60 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:57.401171 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bfeb7-087d-438d-9038-0fe73ab5bf60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:57.404122 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-037bfeb7-087d-438d-9038-0fe73ab5bf60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:57.512367 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037bfeb7-087d-438d-9038-0fe73ab5bf60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:57.514657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037bfeb7-087d-438d-9038-0fe73ab5bf60 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:57.535693 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 711/1440] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:59.376276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a42cb6-82af-4423-bd7c-632fd497ff59 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:59.376847 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a42cb6-82af-4423-bd7c-632fd497ff59 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:59.376988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a42cb6-82af-4423-bd7c-632fd497ff59 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:59.378701 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 730/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:24:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:59.385472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665a4b5-70c4-4219-8bd7-e95edffc14e5 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:59.386011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665a4b5-70c4-4219-8bd7-e95edffc14e5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:59.386011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665a4b5-70c4-4219-8bd7-e95edffc14e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:59.447207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:59.474706 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-0665a4b5-70c4-4219-8bd7-e95edffc14e5 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:59.475940 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0665a4b5-70c4-4219-8bd7-e95edffc14e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:59.574442 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 712/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:24:59.861583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a42cb6-82af-4423-bd7c-632fd497ff59 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:59.863154 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a1a42cb6-82af-4423-bd7c-632fd497ff59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:59.972743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a42cb6-82af-4423-bd7c-632fd497ff59 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:00.008352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:00.052388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dd46c-0811-4d67-b02e-a8e4e22df230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:00.052999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dd46c-0811-4d67-b02e-a8e4e22df230 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:00.053273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dd46c-0811-4d67-b02e-a8e4e22df230 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:00.053572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dd46c-0811-4d67-b02e-a8e4e22df230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:00.055195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-186dd46c-0811-4d67-b02e-a8e4e22df230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:00.196459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dd46c-0811-4d67-b02e-a8e4e22df230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:00.197997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dd46c-0811-4d67-b02e-a8e4e22df230 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:00.218438 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 731/1443] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:02.343521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dc474-dc56-4316-8653-522c60c4d1c9 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:02.344167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dc474-dc56-4316-8653-522c60c4d1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:02.344167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dc474-dc56-4316-8653-522c60c4d1c9 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:02.345570 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:25:02.352505 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a9b4c-ec0a-45cd-9d1c-e685d60160eb None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:02.353042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a9b4c-ec0a-45cd-9d1c-e685d60160eb None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:02.353042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a9b4c-ec0a-45cd-9d1c-e685d60160eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:02.438236 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ba8a9b4c-ec0a-45cd-9d1c-e685d60160eb None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:02.439487 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ba8a9b4c-ec0a-45cd-9d1c-e685d60160eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:02.454382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:02.544559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:02.829874 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03dc474-dc56-4316-8653-522c60c4d1c9 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:02.831428 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b03dc474-dc56-4316-8653-522c60c4d1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:02.950265 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03dc474-dc56-4316-8653-522c60c4d1c9 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:02.964018 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:03.028895 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84bd65-19cf-4fd7-899c-d7699a633ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:03.029542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84bd65-19cf-4fd7-899c-d7699a633ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:03.029839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84bd65-19cf-4fd7-899c-d7699a633ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:03.030095 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84bd65-19cf-4fd7-899c-d7699a633ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:03.031754 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-be84bd65-19cf-4fd7-899c-d7699a633ca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:03.165964 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84bd65-19cf-4fd7-899c-d7699a633ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:03.167339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84bd65-19cf-4fd7-899c-d7699a633ca7 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:03.188289 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 714/1446] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:05.582547 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6911dd-885a-462e-abe9-c1fd3c9d73b0 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:05.583128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6911dd-885a-462e-abe9-c1fd3c9d73b0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:05.583128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6911dd-885a-462e-abe9-c1fd3c9d73b0 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:05.584498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:25:05.590406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0099c07-290e-4eaf-9b35-4020c1d0e6e2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:05.590827 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0099c07-290e-4eaf-9b35-4020c1d0e6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:05.590966 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0099c07-290e-4eaf-9b35-4020c1d0e6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:05.646524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:05.667036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f0099c07-290e-4eaf-9b35-4020c1d0e6e2 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:05.668334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f0099c07-290e-4eaf-9b35-4020c1d0e6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:05.773950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:06.053053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6911dd-885a-462e-abe9-c1fd3c9d73b0 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:06.054701 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-eb6911dd-885a-462e-abe9-c1fd3c9d73b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:06.169781 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6911dd-885a-462e-abe9-c1fd3c9d73b0 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:06.215874 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:06.257312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526513b-f706-48b8-8fa0-8dde7d5fb077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:06.257968 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526513b-f706-48b8-8fa0-8dde7d5fb077 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:06.258244 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526513b-f706-48b8-8fa0-8dde7d5fb077 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:06.258506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526513b-f706-48b8-8fa0-8dde7d5fb077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:06.260338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4526513b-f706-48b8-8fa0-8dde7d5fb077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:06.382644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526513b-f706-48b8-8fa0-8dde7d5fb077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:06.384078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526513b-f706-48b8-8fa0-8dde7d5fb077 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:06.403661 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 734/1449] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:08.504121 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfee89-649d-4bc1-9a1f-0f7e9cea4bd7 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:08.504717 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfee89-649d-4bc1-9a1f-0f7e9cea4bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:08.504717 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfee89-649d-4bc1-9a1f-0f7e9cea4bd7 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:08.506070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:08.511968 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc645b7-60b2-4468-820c-5d70c4dde718 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:08.512442 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc645b7-60b2-4468-820c-5d70c4dde718 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:08.512534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc645b7-60b2-4468-820c-5d70c4dde718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:08.589048 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-bcc645b7-60b2-4468-820c-5d70c4dde718 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:08.590386 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bcc645b7-60b2-4468-820c-5d70c4dde718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:08.611307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:08.692413 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:08.976489 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfee89-649d-4bc1-9a1f-0f7e9cea4bd7 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:08.978132 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ddbfee89-649d-4bc1-9a1f-0f7e9cea4bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:09.093957 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfee89-649d-4bc1-9a1f-0f7e9cea4bd7 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:09.114520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:09.173469 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58232217-c3fb-4ebe-a72d-1336e439a459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:09.174002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58232217-c3fb-4ebe-a72d-1336e439a459 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:09.174285 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58232217-c3fb-4ebe-a72d-1336e439a459 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:09.174553 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58232217-c3fb-4ebe-a72d-1336e439a459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:09.176168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-58232217-c3fb-4ebe-a72d-1336e439a459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:09.293522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58232217-c3fb-4ebe-a72d-1336e439a459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:09.294993 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58232217-c3fb-4ebe-a72d-1336e439a459 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:09.314175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 717/1452] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:11.384373 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76edb5-fa10-4e56-86c3-c3f2beea8bcf None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:11.384927 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76edb5-fa10-4e56-86c3-c3f2beea8bcf None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:11.384927 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76edb5-fa10-4e56-86c3-c3f2beea8bcf None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:11.386309 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:11.392155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec018c91-ebf9-420a-b51f-b7adeadec0e9 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:11.392616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec018c91-ebf9-420a-b51f-b7adeadec0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:11.392724 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec018c91-ebf9-420a-b51f-b7adeadec0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:11.470205 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:11.473513 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ec018c91-ebf9-420a-b51f-b7adeadec0e9 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:11.475417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ec018c91-ebf9-420a-b51f-b7adeadec0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:11.603082 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:11.914614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76edb5-fa10-4e56-86c3-c3f2beea8bcf None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:11.916162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0e76edb5-fa10-4e56-86c3-c3f2beea8bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:12.035462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76edb5-fa10-4e56-86c3-c3f2beea8bcf None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:12.087527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:12.113458 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed038c4-274c-4f50-b9ea-5388de6cf017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:12.114071 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed038c4-274c-4f50-b9ea-5388de6cf017 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:12.114618 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed038c4-274c-4f50-b9ea-5388de6cf017 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:12.114618 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed038c4-274c-4f50-b9ea-5388de6cf017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:12.116221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3ed038c4-274c-4f50-b9ea-5388de6cf017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:12.236750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed038c4-274c-4f50-b9ea-5388de6cf017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:12.238262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed038c4-274c-4f50-b9ea-5388de6cf017 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:12.257863 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 737/1455] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:14.273043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a380e-40bb-441c-91b4-8e77ad9e5059 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:14.273848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a380e-40bb-441c-91b4-8e77ad9e5059 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:14.273848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a380e-40bb-441c-91b4-8e77ad9e5059 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:14.275088 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:14.281636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae1f5e-ecb9-40bf-8ab4-c4ac484d0d68 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:14.282245 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae1f5e-ecb9-40bf-8ab4-c4ac484d0d68 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:14.282245 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae1f5e-ecb9-40bf-8ab4-c4ac484d0d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:14.361268 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-05ae1f5e-ecb9-40bf-8ab4-c4ac484d0d68 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:14.362968 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-05ae1f5e-ecb9-40bf-8ab4-c4ac484d0d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:14.396320 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:14.471607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:14.750231 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a380e-40bb-441c-91b4-8e77ad9e5059 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:14.751775 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4c2a380e-40bb-441c-91b4-8e77ad9e5059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:14.868722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a380e-40bb-441c-91b4-8e77ad9e5059 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:14.899912 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:14.951249 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2748c0-6f3b-494f-9d4e-76ae029b700f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:14.951852 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2748c0-6f3b-494f-9d4e-76ae029b700f service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:14.952149 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2748c0-6f3b-494f-9d4e-76ae029b700f service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:14.952393 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2748c0-6f3b-494f-9d4e-76ae029b700f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:14.954065 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7f2748c0-6f3b-494f-9d4e-76ae029b700f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:15.068108 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2748c0-6f3b-494f-9d4e-76ae029b700f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:15.069659 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2748c0-6f3b-494f-9d4e-76ae029b700f service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:15.089844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 720/1458] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:17.086439 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c770a5-bdb0-474b-9ce0-d8a629370a53 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:17.087018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c770a5-bdb0-474b-9ce0-d8a629370a53 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:17.087018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c770a5-bdb0-474b-9ce0-d8a629370a53 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:17.088301 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:17.094209 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e086-c1c5-479c-a2d6-d9fdeba17b9a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:17.094634 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e086-c1c5-479c-a2d6-d9fdeba17b9a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:17.094745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e086-c1c5-479c-a2d6-d9fdeba17b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:17.170341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-4a49e086-c1c5-479c-a2d6-d9fdeba17b9a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:17.171620 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4a49e086-c1c5-479c-a2d6-d9fdeba17b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:17.181506 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:17.274960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:17.558119 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c770a5-bdb0-474b-9ce0-d8a629370a53 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:17.559922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-70c770a5-bdb0-474b-9ce0-d8a629370a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:17.696097 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c770a5-bdb0-474b-9ce0-d8a629370a53 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:17.766987 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:17.787871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae70f3-3081-4b34-adcf-7a1cd3161352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:17.788489 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae70f3-3081-4b34-adcf-7a1cd3161352 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:17.788767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae70f3-3081-4b34-adcf-7a1cd3161352 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:17.789024 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae70f3-3081-4b34-adcf-7a1cd3161352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:17.790745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a1ae70f3-3081-4b34-adcf-7a1cd3161352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:17.930883 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae70f3-3081-4b34-adcf-7a1cd3161352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:17.932346 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae70f3-3081-4b34-adcf-7a1cd3161352 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:17.955465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 740/1461] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:25:19.970937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0b77f-ca58-401b-bc47-fc2aea2e582f None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:19.971640 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0b77f-ca58-401b-bc47-fc2aea2e582f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:19.971640 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0b77f-ca58-401b-bc47-fc2aea2e582f None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:19.972993 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:25:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:19.982144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d399503-41d9-4474-ab0c-0ec05ae0e011 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:19.982810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d399503-41d9-4474-ab0c-0ec05ae0e011 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:19.982810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d399503-41d9-4474-ab0c-0ec05ae0e011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:20.178519 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1d399503-41d9-4474-ab0c-0ec05ae0e011 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:20.179748 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1d399503-41d9-4474-ab0c-0ec05ae0e011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:20.224332 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:20.289494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:20.570611 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0b77f-ca58-401b-bc47-fc2aea2e582f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:20.572170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4cd0b77f-ca58-401b-bc47-fc2aea2e582f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:20.692294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0b77f-ca58-401b-bc47-fc2aea2e582f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:20.746756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:20.792965 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b88fb-af0e-4a0b-8c2c-555a953e90a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:20.793613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b88fb-af0e-4a0b-8c2c-555a953e90a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:20.793955 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b88fb-af0e-4a0b-8c2c-555a953e90a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:20.794267 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b88fb-af0e-4a0b-8c2c-555a953e90a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:20.796114 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8f4b88fb-af0e-4a0b-8c2c-555a953e90a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:20.926969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b88fb-af0e-4a0b-8c2c-555a953e90a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:20.928631 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b88fb-af0e-4a0b-8c2c-555a953e90a9 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:20.951970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 723/1464] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:22.908874 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6d4e3-123c-43d3-a03c-2a2c4a4a6850 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:22.909665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6d4e3-123c-43d3-a03c-2a2c4a4a6850 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:22.909665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6d4e3-123c-43d3-a03c-2a2c4a4a6850 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:22.911116 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:22.916841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd3d6-fd17-4207-a62d-79582efa9374 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:22.917334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd3d6-fd17-4207-a62d-79582efa9374 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:22.917451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd3d6-fd17-4207-a62d-79582efa9374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:23.002508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-70ccd3d6-fd17-4207-a62d-79582efa9374 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:23.003786 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-70ccd3d6-fd17-4207-a62d-79582efa9374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:23.030431 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:23.130608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:23.415961 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6d4e3-123c-43d3-a03c-2a2c4a4a6850 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:23.417558 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bcf6d4e3-123c-43d3-a03c-2a2c4a4a6850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:23.531773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6d4e3-123c-43d3-a03c-2a2c4a4a6850 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:23.605275 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:23.615178 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146421d2-89b9-4494-8c00-5848052cc80e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:23.615809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146421d2-89b9-4494-8c00-5848052cc80e service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:23.616086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146421d2-89b9-4494-8c00-5848052cc80e service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:23.616356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146421d2-89b9-4494-8c00-5848052cc80e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:23.618106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-146421d2-89b9-4494-8c00-5848052cc80e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:23.746591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146421d2-89b9-4494-8c00-5848052cc80e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:23.748103 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146421d2-89b9-4494-8c00-5848052cc80e service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:23.772809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 743/1467] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:25.772739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b977a3-a32d-41a9-80c1-3f3a91ba211c None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:25.773402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b977a3-a32d-41a9-80c1-3f3a91ba211c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:25.773402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b977a3-a32d-41a9-80c1-3f3a91ba211c None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:25.774907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:25.781102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae90f93-03ee-4106-b835-1f695ec81bb2 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:25.781642 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae90f93-03ee-4106-b835-1f695ec81bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:25.781735 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae90f93-03ee-4106-b835-1f695ec81bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:25.862773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4ae90f93-03ee-4106-b835-1f695ec81bb2 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:25.864009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4ae90f93-03ee-4106-b835-1f695ec81bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:25.914848 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:25.966404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:26.246065 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b977a3-a32d-41a9-80c1-3f3a91ba211c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:26.247739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-16b977a3-a32d-41a9-80c1-3f3a91ba211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:26.366395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b977a3-a32d-41a9-80c1-3f3a91ba211c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:26.425347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:26.456073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9d98a-b62e-4772-8cad-5733b5b19e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:26.456676 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9d98a-b62e-4772-8cad-5733b5b19e6e service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:26.456946 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9d98a-b62e-4772-8cad-5733b5b19e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:26.457275 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9d98a-b62e-4772-8cad-5733b5b19e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:26.458945 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c0f9d98a-b62e-4772-8cad-5733b5b19e6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:26.583880 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9d98a-b62e-4772-8cad-5733b5b19e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:26.585290 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9d98a-b62e-4772-8cad-5733b5b19e6e service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:26.609711 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 726/1470] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:35.964503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=22 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:36.607415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=66 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:46.465875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7613c5e-e29f-4117-a032-2f7463ad1172 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:46.466486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7613c5e-e29f-4117-a032-2f7463ad1172 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:46.466486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7613c5e-e29f-4117-a032-2f7463ad1172 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:46.467844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 745/1471] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:46.473266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3be70-b7d8-40d7-83e3-fc41f4f8ed44 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:46.473744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3be70-b7d8-40d7-83e3-fc41f4f8ed44 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:46.473853 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3be70-b7d8-40d7-83e3-fc41f4f8ed44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:46.552864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-05e3be70-b7d8-40d7-83e3-fc41f4f8ed44 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:46.554412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-05e3be70-b7d8-40d7-83e3-fc41f4f8ed44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:46.662199 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 727/1472] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:46.960398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44f270-76d4-444c-98cf-5857363e5741 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:46.960682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44f270-76d4-444c-98cf-5857363e5741 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:46.960946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44f270-76d4-444c-98cf-5857363e5741 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:46.962283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 746/1473] 10.222.0.52 () {54 vars in 967 bytes} [Mon Aug 29 20:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:46.967231 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6d31f-bffc-4e1e-aa80-f36278968878 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:46.967523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6d31f-bffc-4e1e-aa80-f36278968878 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:46.967795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6d31f-bffc-4e1e-aa80-f36278968878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:47.053105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-15d6d31f-bffc-4e1e-aa80-f36278968878 None None] MFA Rules not processed for user `47429aec6d8a4339b4ec0fb32b25e90b`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:47.054395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-15d6d31f-bffc-4e1e-aa80-f36278968878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:47.076335 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:47.136041 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 728/1474] 10.222.0.52 () {58 vars in 1064 bytes} [Mon Aug 29 20:25:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:47.144023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44f270-76d4-444c-98cf-5857363e5741 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:47.145713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ae44f270-76d4-444c-98cf-5857363e5741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:47.253342 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44f270-76d4-444c-98cf-5857363e5741 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:47.335985 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8979d5-83ab-4f67-85d8-2c269189087d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47429aec6d8a4339b4ec0fb32b25e90b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:47.336590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8979d5-83ab-4f67-85d8-2c269189087d service glance] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:47.336869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8979d5-83ab-4f67-85d8-2c269189087d service glance] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:47.337136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8979d5-83ab-4f67-85d8-2c269189087d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:47.338776 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8c8979d5-83ab-4f67-85d8-2c269189087d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:47.396546 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:47.462299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8979d5-83ab-4f67-85d8-2c269189087d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:47.463773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8979d5-83ab-4f67-85d8-2c269189087d service glance] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:47.484744 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 747/1475] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:49.546264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf4706-4d1a-4c3e-a9fa-384bf2f2c351 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:49.546981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf4706-4d1a-4c3e-a9fa-384bf2f2c351 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:49.546981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf4706-4d1a-4c3e-a9fa-384bf2f2c351 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:49.548205 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 729/1476] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:49.554368 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5496e45-bef6-4b7e-997b-713c78271398 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:49.554950 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5496e45-bef6-4b7e-997b-713c78271398 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:49.554950 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5496e45-bef6-4b7e-997b-713c78271398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:49.647393 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d5496e45-bef6-4b7e-997b-713c78271398 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:49.648544 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d5496e45-bef6-4b7e-997b-713c78271398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:49.797799 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 748/1477] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:50.071824 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf4706-4d1a-4c3e-a9fa-384bf2f2c351 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:50.073400 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-eddf4706-4d1a-4c3e-a9fa-384bf2f2c351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:50.231648 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf4706-4d1a-4c3e-a9fa-384bf2f2c351 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:50.288048 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:50.346679 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5e196-56f0-47da-b3d1-ae4882533abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:50.347330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5e196-56f0-47da-b3d1-ae4882533abf admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:50.347629 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5e196-56f0-47da-b3d1-ae4882533abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:50.347894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5e196-56f0-47da-b3d1-ae4882533abf admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:50.348549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5e196-56f0-47da-b3d1-ae4882533abf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:50.350538 dv-cinder-854263-2-smb devstack@keystone.service[81540]: WARNING py.warnings [None req-96a5e196-56f0-47da-b3d1-ae4882533abf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:25:50.350538 dv-cinder-854263-2-smb devstack@keystone.service[81540]: warnings.warn(msg) Aug 29 20:25:50.350538 dv-cinder-854263-2-smb devstack@keystone.service[81540]: Aug 29 20:25:50.351815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5e196-56f0-47da-b3d1-ae4882533abf admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:50.373774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 730/1478] 10.222.0.52 () {56 vars in 1108 bytes} [Mon Aug 29 20:25:50 2022] GET /identity/v3/projects => generated 2553 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:25:52.363678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42192ff5-08f6-40c4-95e9-a8a4915140f0 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:52.364283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42192ff5-08f6-40c4-95e9-a8a4915140f0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:52.364283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42192ff5-08f6-40c4-95e9-a8a4915140f0 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:52.365610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 749/1479] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:52.371341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe62ee5-78f9-46c3-84e5-ba7fac1e9859 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:52.371868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe62ee5-78f9-46c3-84e5-ba7fac1e9859 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:52.371868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe62ee5-78f9-46c3-84e5-ba7fac1e9859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:52.445524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-8fe62ee5-78f9-46c3-84e5-ba7fac1e9859 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:52.446780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8fe62ee5-78f9-46c3-84e5-ba7fac1e9859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:52.574759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 731/1480] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:52.883217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42192ff5-08f6-40c4-95e9-a8a4915140f0 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:52.884793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-42192ff5-08f6-40c4-95e9-a8a4915140f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:52.896054 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:53.050974 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42192ff5-08f6-40c4-95e9-a8a4915140f0 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:53.137908 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:53.174134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179ca2a-74d9-42da-927c-1661316d5b57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:53.174746 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179ca2a-74d9-42da-927c-1661316d5b57 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:53.175018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179ca2a-74d9-42da-927c-1661316d5b57 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:53.175286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179ca2a-74d9-42da-927c-1661316d5b57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:53.177055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8179ca2a-74d9-42da-927c-1661316d5b57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:53.280166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179ca2a-74d9-42da-927c-1661316d5b57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:53.282018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179ca2a-74d9-42da-927c-1661316d5b57 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:53.303541 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 750/1481] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:55.463231 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f44662-9412-4869-8bdf-0b102752aff0 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:55.463875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f44662-9412-4869-8bdf-0b102752aff0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:55.463875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f44662-9412-4869-8bdf-0b102752aff0 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:55.465294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 732/1482] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:55.471696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53abe6b-34de-4795-87ff-468067fc7256 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:55.472401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53abe6b-34de-4795-87ff-468067fc7256 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:55.472401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53abe6b-34de-4795-87ff-468067fc7256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:55.552369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b53abe6b-34de-4795-87ff-468067fc7256 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:55.553711 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b53abe6b-34de-4795-87ff-468067fc7256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:55.607080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:55.661996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 751/1483] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:55.955851 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f44662-9412-4869-8bdf-0b102752aff0 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:55.957435 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-87f44662-9412-4869-8bdf-0b102752aff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:55.987955 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:56.084722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f44662-9412-4869-8bdf-0b102752aff0 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:56.174590 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42367565-00b7-46ba-ad79-ee0f25348a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:56.175207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42367565-00b7-46ba-ad79-ee0f25348a7a service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:56.175468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42367565-00b7-46ba-ad79-ee0f25348a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:56.175747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42367565-00b7-46ba-ad79-ee0f25348a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:56.177430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-42367565-00b7-46ba-ad79-ee0f25348a7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:56.260467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:56.298253 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42367565-00b7-46ba-ad79-ee0f25348a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:56.299734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42367565-00b7-46ba-ad79-ee0f25348a7a service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:56.319316 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 733/1484] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:58.343977 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2de35-048f-444d-83fc-3813151a5ede None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:58.344563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2de35-048f-444d-83fc-3813151a5ede None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:58.344563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2de35-048f-444d-83fc-3813151a5ede None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:58.345962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 752/1485] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:25:58.354123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9858f67-6205-49d1-8342-7483d8b75dd4 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:58.354565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9858f67-6205-49d1-8342-7483d8b75dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:58.354694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9858f67-6205-49d1-8342-7483d8b75dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:58.433250 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d9858f67-6205-49d1-8342-7483d8b75dd4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:58.434594 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d9858f67-6205-49d1-8342-7483d8b75dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:58.557073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 734/1486] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:58.845351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2de35-048f-444d-83fc-3813151a5ede None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:58.847844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-30f2de35-048f-444d-83fc-3813151a5ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:58.971653 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2de35-048f-444d-83fc-3813151a5ede None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:59.048891 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:59.050877 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a5d60-490c-4d6f-b010-c9b99ac052e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:59.051494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5d60-490c-4d6f-b010-c9b99ac052e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:59.051767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5d60-490c-4d6f-b010-c9b99ac052e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:59.052024 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5d60-490c-4d6f-b010-c9b99ac052e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:59.054119 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-012a5d60-490c-4d6f-b010-c9b99ac052e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:59.176306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a5d60-490c-4d6f-b010-c9b99ac052e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:59.177709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a5d60-490c-4d6f-b010-c9b99ac052e9 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:59.196526 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 753/1487] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:01.425405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe1bd9-b019-4ce4-adfc-b9a392fde086 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:01.425977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe1bd9-b019-4ce4-adfc-b9a392fde086 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:01.425977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe1bd9-b019-4ce4-adfc-b9a392fde086 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:01.427343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 735/1488] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:26:01.439883 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2928-d2dc-4aab-9c3b-16dfa12883e5 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:01.440563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2928-d2dc-4aab-9c3b-16dfa12883e5 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:01.440563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2928-d2dc-4aab-9c3b-16dfa12883e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:01.525959 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-35fa2928-d2dc-4aab-9c3b-16dfa12883e5 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:01.527307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-35fa2928-d2dc-4aab-9c3b-16dfa12883e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:01.596317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:01.652779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 754/1489] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:01.949185 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe1bd9-b019-4ce4-adfc-b9a392fde086 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:01.950919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-edfe1bd9-b019-4ce4-adfc-b9a392fde086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:01.993663 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:02.082374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe1bd9-b019-4ce4-adfc-b9a392fde086 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:02.160345 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a2b1a-b78a-482d-a58e-11ec99a69e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:02.160917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a2b1a-b78a-482d-a58e-11ec99a69e08 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:02.161198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a2b1a-b78a-482d-a58e-11ec99a69e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:02.161506 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a2b1a-b78a-482d-a58e-11ec99a69e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:02.163179 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-db9a2b1a-b78a-482d-a58e-11ec99a69e08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:02.406263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:02.439635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a2b1a-b78a-482d-a58e-11ec99a69e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:02.441104 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a2b1a-b78a-482d-a58e-11ec99a69e08 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:02.460865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 736/1490] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:04.658242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35061944-89e1-4f61-b334-659fd6f99c93 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:04.659070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35061944-89e1-4f61-b334-659fd6f99c93 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:04.659070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35061944-89e1-4f61-b334-659fd6f99c93 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:04.660669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 755/1491] 10.222.0.52 () {54 vars in 927 bytes} [Mon Aug 29 20:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:26:04.667731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4c4f7-e66f-4306-9829-0aef8a8a0e22 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:04.668499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4c4f7-e66f-4306-9829-0aef8a8a0e22 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:04.668499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4c4f7-e66f-4306-9829-0aef8a8a0e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:04.740869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-0ad4c4f7-e66f-4306-9829-0aef8a8a0e22 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:04.742126 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0ad4c4f7-e66f-4306-9829-0aef8a8a0e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:04.845695 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 737/1492] 10.222.0.52 () {58 vars in 1024 bytes} [Mon Aug 29 20:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:05.150314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35061944-89e1-4f61-b334-659fd6f99c93 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:05.151988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-35061944-89e1-4f61-b334-659fd6f99c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:05.264049 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35061944-89e1-4f61-b334-659fd6f99c93 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:05.345281 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6028f-91c0-4c69-8f9b-d7e5dd6a353d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:05.346157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6028f-91c0-4c69-8f9b-d7e5dd6a353d service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:05.346434 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6028f-91c0-4c69-8f9b-d7e5dd6a353d service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:05.346712 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6028f-91c0-4c69-8f9b-d7e5dd6a353d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:05.348877 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-29f6028f-91c0-4c69-8f9b-d7e5dd6a353d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:05.360378 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:05.486945 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6028f-91c0-4c69-8f9b-d7e5dd6a353d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:05.488423 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6028f-91c0-4c69-8f9b-d7e5dd6a353d service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:05.507781 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 756/1493] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:14.843662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=82 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:15.505003 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=50 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:19.525041 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22005eb8-5f45-4d1e-abbc-9cfe17f56f68 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:19.525687 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22005eb8-5f45-4d1e-abbc-9cfe17f56f68 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:19.525687 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22005eb8-5f45-4d1e-abbc-9cfe17f56f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:19.636286 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-22005eb8-5f45-4d1e-abbc-9cfe17f56f68 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:27:19.638329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-22005eb8-5f45-4d1e-abbc-9cfe17f56f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:19.759180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 738/1494] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:27:19.769007 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4ff01-30a5-49d4-81fc-95c620eb0f15 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:19.769709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4ff01-30a5-49d4-81fc-95c620eb0f15 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:19.769709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4ff01-30a5-49d4-81fc-95c620eb0f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:19.867688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-25c4ff01-30a5-49d4-81fc-95c620eb0f15 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:27:19.868932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-25c4ff01-30a5-49d4-81fc-95c620eb0f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:19.991670 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 757/1495] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:27:19.996867 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22005eb8-5f45-4d1e-abbc-9cfe17f56f68 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:19.998315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-22005eb8-5f45-4d1e-abbc-9cfe17f56f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:20.010342 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22005eb8-5f45-4d1e-abbc-9cfe17f56f68 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:20.082282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:20.118503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7a198-32e6-4874-aedc-d650fbf936f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:20.119123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7a198-32e6-4874-aedc-d650fbf936f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:20.119393 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7a198-32e6-4874-aedc-d650fbf936f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:20.119660 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7a198-32e6-4874-aedc-d650fbf936f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:20.120301 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7a198-32e6-4874-aedc-d650fbf936f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:27:20.120615 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7a198-32e6-4874-aedc-d650fbf936f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:20.121728 dv-cinder-854263-2-smb devstack@keystone.service[81540]: WARNING py.warnings [None req-81b7a198-32e6-4874-aedc-d650fbf936f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:27:20.121728 dv-cinder-854263-2-smb devstack@keystone.service[81540]: warnings.warn(msg) Aug 29 20:27:20.121728 dv-cinder-854263-2-smb devstack@keystone.service[81540]: Aug 29 20:27:20.122613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7a198-32e6-4874-aedc-d650fbf936f0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:20.136795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 739/1496] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:27:20.145830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4ff01-30a5-49d4-81fc-95c620eb0f15 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:20.155719 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4ff01-30a5-49d4-81fc-95c620eb0f15 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:20.229723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:20.268042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f687c-1acd-4aff-87f7-e68e59d4d1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:20.268556 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f687c-1acd-4aff-87f7-e68e59d4d1e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:20.268854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f687c-1acd-4aff-87f7-e68e59d4d1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:20.269124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f687c-1acd-4aff-87f7-e68e59d4d1e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:20.269784 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f687c-1acd-4aff-87f7-e68e59d4d1e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:20.271947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: WARNING py.warnings [None req-724f687c-1acd-4aff-87f7-e68e59d4d1e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:27:20.271947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: warnings.warn(msg) Aug 29 20:27:20.271947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: Aug 29 20:27:20.273205 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f687c-1acd-4aff-87f7-e68e59d4d1e9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:20.347007 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 758/1497] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:27:20 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:27:20.348555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7a198-32e6-4874-aedc-d650fbf936f0 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:20.350539 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-81b7a198-32e6-4874-aedc-d650fbf936f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:20.390675 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7a198-32e6-4874-aedc-d650fbf936f0 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:20.499695 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f38fd2-44b0-4ae1-b770-8a5da99a79fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:20.500320 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f38fd2-44b0-4ae1-b770-8a5da99a79fd admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:20.500620 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f38fd2-44b0-4ae1-b770-8a5da99a79fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:20.500884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f38fd2-44b0-4ae1-b770-8a5da99a79fd admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:20.501583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f38fd2-44b0-4ae1-b770-8a5da99a79fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:20.502604 dv-cinder-854263-2-smb devstack@keystone.service[81540]: WARNING py.warnings [None req-66f38fd2-44b0-4ae1-b770-8a5da99a79fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:27:20.502604 dv-cinder-854263-2-smb devstack@keystone.service[81540]: warnings.warn(msg) Aug 29 20:27:20.502604 dv-cinder-854263-2-smb devstack@keystone.service[81540]: Aug 29 20:27:20.503937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f38fd2-44b0-4ae1-b770-8a5da99a79fd admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:20.556774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 740/1498] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:27:20 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:27:20.562016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f687c-1acd-4aff-87f7-e68e59d4d1e9 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:20.562958 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-724f687c-1acd-4aff-87f7-e68e59d4d1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:20.636098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f687c-1acd-4aff-87f7-e68e59d4d1e9 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:20.738692 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:20.751778 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b530fdb-1f20-4f83-beb0-ccec8912b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:20.752395 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b530fdb-1f20-4f83-beb0-ccec8912b678 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:20.752669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b530fdb-1f20-4f83-beb0-ccec8912b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:20.752933 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b530fdb-1f20-4f83-beb0-ccec8912b678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:20.753660 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b530fdb-1f20-4f83-beb0-ccec8912b678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:20.754696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: WARNING py.warnings [None req-3b530fdb-1f20-4f83-beb0-ccec8912b678 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:27:20.754696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: warnings.warn(msg) Aug 29 20:27:20.754696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: Aug 29 20:27:20.755596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b530fdb-1f20-4f83-beb0-ccec8912b678 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:20.769079 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 759/1499] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:27:20.773686 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f38fd2-44b0-4ae1-b770-8a5da99a79fd admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:20.775377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-66f38fd2-44b0-4ae1-b770-8a5da99a79fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:20.788746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f38fd2-44b0-4ae1-b770-8a5da99a79fd admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:20.818459 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:20.905787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348fc93-4c4e-4c75-aa07-0eda27ca4c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:20.906469 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348fc93-4c4e-4c75-aa07-0eda27ca4c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:20.906762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348fc93-4c4e-4c75-aa07-0eda27ca4c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:20.907060 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348fc93-4c4e-4c75-aa07-0eda27ca4c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:20.907703 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348fc93-4c4e-4c75-aa07-0eda27ca4c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:20.908715 dv-cinder-854263-2-smb devstack@keystone.service[81540]: WARNING py.warnings [None req-a348fc93-4c4e-4c75-aa07-0eda27ca4c37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:27:20.908715 dv-cinder-854263-2-smb devstack@keystone.service[81540]: warnings.warn(msg) Aug 29 20:27:20.908715 dv-cinder-854263-2-smb devstack@keystone.service[81540]: Aug 29 20:27:20.909617 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348fc93-4c4e-4c75-aa07-0eda27ca4c37 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:20.924771 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 741/1500] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:27:20.929247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b530fdb-1f20-4f83-beb0-ccec8912b678 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:20.930840 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3b530fdb-1f20-4f83-beb0-ccec8912b678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:20.968850 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b530fdb-1f20-4f83-beb0-ccec8912b678 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:21.077775 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fed6c-30d6-4ea8-8f0b-3d32e918486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:21.078443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fed6c-30d6-4ea8-8f0b-3d32e918486c admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:21.078573 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fed6c-30d6-4ea8-8f0b-3d32e918486c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:21.078888 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fed6c-30d6-4ea8-8f0b-3d32e918486c admin admin] PATH_INFO: `/v3/projects/96b68163938d46ecb2304e43a8ff8060/users/c60895a1c9ff47158b6d4cc7ad0d2239/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:21.101800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fed6c-30d6-4ea8-8f0b-3d32e918486c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b68163938d46ecb2304e43a8ff8060, user_id=c60895a1c9ff47158b6d4cc7ad0d2239, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:21.102845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: WARNING py.warnings [None req-3f1fed6c-30d6-4ea8-8f0b-3d32e918486c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:27:21.102845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: warnings.warn(msg) Aug 29 20:27:21.102845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: Aug 29 20:27:21.104774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fed6c-30d6-4ea8-8f0b-3d32e918486c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:21.130861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 760/1501] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:27:20 2022] PUT /identity/v3/projects/96b68163938d46ecb2304e43a8ff8060/users/c60895a1c9ff47158b6d4cc7ad0d2239/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:27:21.143551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5fa94-847a-48f4-a8a5-76c4a2c4e547 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:21.143824 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5fa94-847a-48f4-a8a5-76c4a2c4e547 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:21.144111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5fa94-847a-48f4-a8a5-76c4a2c4e547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:21.205314 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-58f5fa94-847a-48f4-a8a5-76c4a2c4e547 None None] MFA Rules not processed for user `c60895a1c9ff47158b6d4cc7ad0d2239`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:27:21.206566 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-58f5fa94-847a-48f4-a8a5-76c4a2c4e547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:21.296703 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 742/1502] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:27:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:27:21.310708 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb884c76-35ad-47d2-866b-1a933c8ab67e None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:21.310979 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb884c76-35ad-47d2-866b-1a933c8ab67e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:21.312614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb884c76-35ad-47d2-866b-1a933c8ab67e None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:21.312999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 761/1503] 10.222.0.52 () {54 vars in 964 bytes} [Mon Aug 29 20:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:27:21.317999 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a5f18-3130-4c5a-83b5-21acdb237bc3 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:21.318305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a5f18-3130-4c5a-83b5-21acdb237bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:21.318552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a5f18-3130-4c5a-83b5-21acdb237bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:21.355139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:21.409384 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-a45a5f18-3130-4c5a-83b5-21acdb237bc3 None None] MFA Rules not processed for user `960a2be5cb58461fb9fb8e99094398d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:27:21.410683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a45a5f18-3130-4c5a-83b5-21acdb237bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:21.501441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 743/1504] 10.222.0.52 () {58 vars in 1061 bytes} [Mon Aug 29 20:27:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:27:21.510994 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb884c76-35ad-47d2-866b-1a933c8ab67e None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:21.513013 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cb884c76-35ad-47d2-866b-1a933c8ab67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:21.576724 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:21.643222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb884c76-35ad-47d2-866b-1a933c8ab67e None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:21.727234 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e2c07-5aed-4b3d-9b47-e92597de3c23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:21.727852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e2c07-5aed-4b3d-9b47-e92597de3c23 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:21.728132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e2c07-5aed-4b3d-9b47-e92597de3c23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:21.728422 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e2c07-5aed-4b3d-9b47-e92597de3c23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:21.730099 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6a6e2c07-5aed-4b3d-9b47-e92597de3c23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:21.842739 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e2c07-5aed-4b3d-9b47-e92597de3c23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:21.844214 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e2c07-5aed-4b3d-9b47-e92597de3c23 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:21.848092 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:21.867170 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 762/1505] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:27:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:27:21.917166 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a84a90-fcf7-472d-8682-6ce21026a351 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:21.917733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a84a90-fcf7-472d-8682-6ce21026a351 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:21.917733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a84a90-fcf7-472d-8682-6ce21026a351 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:21.919020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 744/1506] 10.222.0.52 () {52 vars in 830 bytes} [Mon Aug 29 20:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:27:21.923801 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e2c07-5aed-4b3d-9b47-e92597de3c23 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:21.925967 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6a6e2c07-5aed-4b3d-9b47-e92597de3c23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:22.040230 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e2c07-5aed-4b3d-9b47-e92597de3c23 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:22.148885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675005b3-80f9-4475-97bc-e30f2c8d81f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:22.149431 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675005b3-80f9-4475-97bc-e30f2c8d81f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:22.149734 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675005b3-80f9-4475-97bc-e30f2c8d81f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:22.149977 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675005b3-80f9-4475-97bc-e30f2c8d81f5 admin admin] PATH_INFO: `/v3/users/c60895a1c9ff47158b6d4cc7ad0d2239` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:22.163432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675005b3-80f9-4475-97bc-e30f2c8d81f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60895a1c9ff47158b6d4cc7ad0d2239)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:22.164518 dv-cinder-854263-2-smb devstack@keystone.service[81539]: WARNING py.warnings [None req-675005b3-80f9-4475-97bc-e30f2c8d81f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:27:22.164518 dv-cinder-854263-2-smb devstack@keystone.service[81539]: warnings.warn(msg) Aug 29 20:27:22.164518 dv-cinder-854263-2-smb devstack@keystone.service[81539]: Aug 29 20:27:22.165788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675005b3-80f9-4475-97bc-e30f2c8d81f5 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:22.176638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:22.237945 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-675005b3-80f9-4475-97bc-e30f2c8d81f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60895a1c9ff47158b6d4cc7ad0d2239'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:27:22.251542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-675005b3-80f9-4475-97bc-e30f2c8d81f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60895a1c9ff47158b6d4cc7ad0d2239'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:27:22.279211 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-675005b3-80f9-4475-97bc-e30f2c8d81f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60895a1c9ff47158b6d4cc7ad0d2239'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:27:22.279701 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-675005b3-80f9-4475-97bc-e30f2c8d81f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60895a1c9ff47158b6d4cc7ad0d2239'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:27:22.280228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-675005b3-80f9-4475-97bc-e30f2c8d81f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60895a1c9ff47158b6d4cc7ad0d2239'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:27:22.301639 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 763/1507] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:27:21 2022] DELETE /identity/v3/users/c60895a1c9ff47158b6d4cc7ad0d2239 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:27:22.306295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d223aed-971e-48c4-b5f1-e0af508638d5 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:22.306577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d223aed-971e-48c4-b5f1-e0af508638d5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:22.306845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d223aed-971e-48c4-b5f1-e0af508638d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:22.374149 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7d223aed-971e-48c4-b5f1-e0af508638d5 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:27:22.375381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7d223aed-971e-48c4-b5f1-e0af508638d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:22.457045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:22.470252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 745/1508] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:27:22.480179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675005b3-80f9-4475-97bc-e30f2c8d81f5 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:22.481463 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-675005b3-80f9-4475-97bc-e30f2c8d81f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:22.588165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675005b3-80f9-4475-97bc-e30f2c8d81f5 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:22.646707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:22.667679 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c1b15-229d-4308-9473-cd031c1fc1e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:22.668304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c1b15-229d-4308-9473-cd031c1fc1e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:22.668586 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c1b15-229d-4308-9473-cd031c1fc1e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:22.668856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c1b15-229d-4308-9473-cd031c1fc1e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:22.670522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3c8c1b15-229d-4308-9473-cd031c1fc1e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:22.787398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c1b15-229d-4308-9473-cd031c1fc1e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:22.788833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c1b15-229d-4308-9473-cd031c1fc1e2 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:22.808385 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 764/1509] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:27:23.203658 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d223aed-971e-48c4-b5f1-e0af508638d5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:23.205263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7d223aed-971e-48c4-b5f1-e0af508638d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:23.220555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d223aed-971e-48c4-b5f1-e0af508638d5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:23.343610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce02f21-eee5-46f6-8d0c-b16f732576ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:23.344180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02f21-eee5-46f6-8d0c-b16f732576ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:23.344495 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02f21-eee5-46f6-8d0c-b16f732576ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:23.344764 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02f21-eee5-46f6-8d0c-b16f732576ba admin admin] PATH_INFO: `/v3/projects/96b68163938d46ecb2304e43a8ff8060` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:23.356029 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce02f21-eee5-46f6-8d0c-b16f732576ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b68163938d46ecb2304e43a8ff8060)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:23.357221 dv-cinder-854263-2-smb devstack@keystone.service[81540]: WARNING py.warnings [None req-0ce02f21-eee5-46f6-8d0c-b16f732576ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:27:23.357221 dv-cinder-854263-2-smb devstack@keystone.service[81540]: warnings.warn(msg) Aug 29 20:27:23.357221 dv-cinder-854263-2-smb devstack@keystone.service[81540]: Aug 29 20:27:23.358531 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce02f21-eee5-46f6-8d0c-b16f732576ba admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:23.422738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0ce02f21-eee5-46f6-8d0c-b16f732576ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b68163938d46ecb2304e43a8ff8060', 'request_id': 'req-0ce02f21-eee5-46f6-8d0c-b16f732576ba'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:27:23.436043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0ce02f21-eee5-46f6-8d0c-b16f732576ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b68163938d46ecb2304e43a8ff8060', 'request_id': 'req-0ce02f21-eee5-46f6-8d0c-b16f732576ba'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:27:23.451635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0ce02f21-eee5-46f6-8d0c-b16f732576ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b68163938d46ecb2304e43a8ff8060', 'request_id': 'req-0ce02f21-eee5-46f6-8d0c-b16f732576ba'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:27:23.478824 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0ce02f21-eee5-46f6-8d0c-b16f732576ba admin admin] The token cache is being invalidate because project 96b68163938d46ecb2304e43a8ff8060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:27:23.479079 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0ce02f21-eee5-46f6-8d0c-b16f732576ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:27:23.479657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0ce02f21-eee5-46f6-8d0c-b16f732576ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:27:23.481066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 746/1510] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:27:23 2022] DELETE /identity/v3/projects/96b68163938d46ecb2304e43a8ff8060 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:27:32.805679 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=62 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:33.476584 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:05.228920 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244957a9-2265-414c-8f83-7e523d0dc7cd None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:05.229595 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244957a9-2265-414c-8f83-7e523d0dc7cd None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:05.229595 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244957a9-2265-414c-8f83-7e523d0dc7cd None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:05.230886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 765/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:29:05.236322 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5fccf-05c9-4d18-93d4-696e10a10f68 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:05.236786 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5fccf-05c9-4d18-93d4-696e10a10f68 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:05.236894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5fccf-05c9-4d18-93d4-696e10a10f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:05.334990 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d2a5fccf-05c9-4d18-93d4-696e10a10f68 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:05.336186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d2a5fccf-05c9-4d18-93d4-696e10a10f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:05.450251 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 747/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:05.606090 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244957a9-2265-414c-8f83-7e523d0dc7cd None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:05.608319 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-244957a9-2265-414c-8f83-7e523d0dc7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:05.737314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244957a9-2265-414c-8f83-7e523d0dc7cd None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:05.743703 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b7872-3fe7-4666-8180-6670ec6a2931 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:05.744316 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7872-3fe7-4666-8180-6670ec6a2931 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:05.744590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7872-3fe7-4666-8180-6670ec6a2931 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:05.744855 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7872-3fe7-4666-8180-6670ec6a2931 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:05.753825 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b7872-3fe7-4666-8180-6670ec6a2931 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:05.755425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b7872-3fe7-4666-8180-6670ec6a2931 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:05.765378 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 766/1513] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:06.614787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d239617-c00a-4182-996d-50fa23c5c1d5 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:06.615336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d239617-c00a-4182-996d-50fa23c5c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:06.615336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d239617-c00a-4182-996d-50fa23c5c1d5 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:06.616877 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 748/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:29:06.622100 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346e3d3-b052-40f4-8fb1-860f19534b5a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:06.622604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346e3d3-b052-40f4-8fb1-860f19534b5a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:06.622714 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346e3d3-b052-40f4-8fb1-860f19534b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:06.645489 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1346e3d3-b052-40f4-8fb1-860f19534b5a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:06.646745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1346e3d3-b052-40f4-8fb1-860f19534b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:06.655561 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 767/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:06.807206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d239617-c00a-4182-996d-50fa23c5c1d5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:06.822843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d239617-c00a-4182-996d-50fa23c5c1d5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:06.828811 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ece2bd-9f2a-428c-a36d-b352184c2b4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:06.829823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ece2bd-9f2a-428c-a36d-b352184c2b4e service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:06.830142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ece2bd-9f2a-428c-a36d-b352184c2b4e service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:06.830417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ece2bd-9f2a-428c-a36d-b352184c2b4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:06.839879 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ece2bd-9f2a-428c-a36d-b352184c2b4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:06.841562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ece2bd-9f2a-428c-a36d-b352184c2b4e service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:06.852134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 749/1516] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:07.108580 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608b8f0-7656-4450-8c4c-539c6b54bea5 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:07.108867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608b8f0-7656-4450-8c4c-539c6b54bea5 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:07.109121 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608b8f0-7656-4450-8c4c-539c6b54bea5 None None] PATH_INFO: `/v3` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:07.110598 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 768/1517] 10.222.0.69 () {54 vars in 925 bytes} [Mon Aug 29 20:29:07 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:29:07.117839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f390a3-30ca-4275-becb-a5db8c4fc4b3 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:07.118130 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f390a3-30ca-4275-becb-a5db8c4fc4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:07.118404 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f390a3-30ca-4275-becb-a5db8c4fc4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:07.184841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d2f390a3-30ca-4275-becb-a5db8c4fc4b3 None None] MFA Rules not processed for user `b8295272eec349f8aa38e44c861faa47`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:07.186028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d2f390a3-30ca-4275-becb-a5db8c4fc4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:07.203398 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:07.261969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 750/1518] 10.222.0.69 () {58 vars in 1015 bytes} [Mon Aug 29 20:29:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:16.639435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026916e-17b2-44bd-afad-b8179a42e707 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:16.640096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026916e-17b2-44bd-afad-b8179a42e707 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:16.640096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026916e-17b2-44bd-afad-b8179a42e707 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:16.641908 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 769/1519] 10.222.0.52 () {54 vars in 961 bytes} [Mon Aug 29 20:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:29:16.642277 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=56 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:16.647462 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ca0b5-37c0-4277-85b7-167f9eb307c4 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:16.648282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ca0b5-37c0-4277-85b7-167f9eb307c4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:16.648282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ca0b5-37c0-4277-85b7-167f9eb307c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:16.670380 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c06ca0b5-37c0-4277-85b7-167f9eb307c4 None None] MFA Rules not processed for user `b8295272eec349f8aa38e44c861faa47`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:16.671623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c06ca0b5-37c0-4277-85b7-167f9eb307c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:16.680955 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 751/1520] 10.222.0.52 () {58 vars in 1058 bytes} [Mon Aug 29 20:29:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:29:16.689029 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026916e-17b2-44bd-afad-b8179a42e707 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:16.703692 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026916e-17b2-44bd-afad-b8179a42e707 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:16.713941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00e1a0-78eb-4e12-9a51-e7a8a7bc3e2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8295272eec349f8aa38e44c861faa47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:16.714571 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00e1a0-78eb-4e12-9a51-e7a8a7bc3e2f service placement] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:16.714846 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00e1a0-78eb-4e12-9a51-e7a8a7bc3e2f service placement] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:16.715116 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00e1a0-78eb-4e12-9a51-e7a8a7bc3e2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:16.725394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00e1a0-78eb-4e12-9a51-e7a8a7bc3e2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:16.727263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00e1a0-78eb-4e12-9a51-e7a8a7bc3e2f service placement] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:16.738632 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 770/1521] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:18.087393 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b809373-ef0b-419b-846b-2b552a08efca None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:18.088058 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b809373-ef0b-419b-846b-2b552a08efca None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:18.088058 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b809373-ef0b-419b-846b-2b552a08efca None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:18.089404 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:29:18.096183 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940151d-79f9-4a1b-ac40-5fcd7a8f3e4d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:18.096716 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940151d-79f9-4a1b-ac40-5fcd7a8f3e4d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:18.097140 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940151d-79f9-4a1b-ac40-5fcd7a8f3e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:18.127614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6940151d-79f9-4a1b-ac40-5fcd7a8f3e4d None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:18.128846 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6940151d-79f9-4a1b-ac40-5fcd7a8f3e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:18.136921 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:18.292712 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b809373-ef0b-419b-846b-2b552a08efca None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:18.314401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b809373-ef0b-419b-846b-2b552a08efca None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:18.323529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c3e0e-c9dd-4eb8-9fb8-0b7b0001d857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:18.324275 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c3e0e-c9dd-4eb8-9fb8-0b7b0001d857 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:18.324576 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c3e0e-c9dd-4eb8-9fb8-0b7b0001d857 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:18.324849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c3e0e-c9dd-4eb8-9fb8-0b7b0001d857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:18.336836 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c3e0e-c9dd-4eb8-9fb8-0b7b0001d857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:18.338847 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c3e0e-c9dd-4eb8-9fb8-0b7b0001d857 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:18.352109 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 753/1524] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:19.217526 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae95b75-ff6d-4f4e-9705-cdf3e01b0b1e None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:19.218438 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae95b75-ff6d-4f4e-9705-cdf3e01b0b1e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:19.218438 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae95b75-ff6d-4f4e-9705-cdf3e01b0b1e None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:19.220127 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:29:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:29:19.225612 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b2d10-7872-42fd-bd4d-939c70f7310c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:19.226053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b2d10-7872-42fd-bd4d-939c70f7310c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:19.226187 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b2d10-7872-42fd-bd4d-939c70f7310c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:19.247829 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b00b2d10-7872-42fd-bd4d-939c70f7310c None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:19.249049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b00b2d10-7872-42fd-bd4d-939c70f7310c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:19.257683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:19.411715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae95b75-ff6d-4f4e-9705-cdf3e01b0b1e None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:19.428949 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae95b75-ff6d-4f4e-9705-cdf3e01b0b1e None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:19.434896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37c87b-868e-42e2-99be-64079a28c47f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:19.435517 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37c87b-868e-42e2-99be-64079a28c47f service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:19.435795 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37c87b-868e-42e2-99be-64079a28c47f service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:19.436062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37c87b-868e-42e2-99be-64079a28c47f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:19.447042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37c87b-868e-42e2-99be-64079a28c47f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:19.448654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37c87b-868e-42e2-99be-64079a28c47f service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:19.459919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 773/1527] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:23.671696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe827d-0aff-4c89-a029-1c75a9ca34a6 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:23.672366 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe827d-0aff-4c89-a029-1c75a9ca34a6 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:23.672366 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe827d-0aff-4c89-a029-1c75a9ca34a6 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:23.673613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:29:23.679673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c052de3-6e36-4929-9282-980ac7b2266a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:23.680288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c052de3-6e36-4929-9282-980ac7b2266a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:23.680288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c052de3-6e36-4929-9282-980ac7b2266a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:23.702333 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3c052de3-6e36-4929-9282-980ac7b2266a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:23.703586 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3c052de3-6e36-4929-9282-980ac7b2266a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:23.712936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:24.002951 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe827d-0aff-4c89-a029-1c75a9ca34a6 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:24.004960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fffe827d-0aff-4c89-a029-1c75a9ca34a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:24.103944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe827d-0aff-4c89-a029-1c75a9ca34a6 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:24.108381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892ba7e-a8dc-4f8a-a17d-a420bf6d6b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:24.108992 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892ba7e-a8dc-4f8a-a17d-a420bf6d6b8f service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:24.109264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892ba7e-a8dc-4f8a-a17d-a420bf6d6b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:24.109788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892ba7e-a8dc-4f8a-a17d-a420bf6d6b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:24.121346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892ba7e-a8dc-4f8a-a17d-a420bf6d6b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:24.122881 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892ba7e-a8dc-4f8a-a17d-a420bf6d6b8f service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:24.133800 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 756/1530] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:26.076574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f79ef-de69-4919-a66e-0d7c736aea0b None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:26.077220 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f79ef-de69-4919-a66e-0d7c736aea0b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:26.077220 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f79ef-de69-4919-a66e-0d7c736aea0b None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:26.078464 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:29:26.084412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e86a2-bbd4-4ebd-b40d-3fa83dde9513 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:26.084887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e86a2-bbd4-4ebd-b40d-3fa83dde9513 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:26.084998 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e86a2-bbd4-4ebd-b40d-3fa83dde9513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:26.105603 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ab9e86a2-bbd4-4ebd-b40d-3fa83dde9513 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:26.106807 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ab9e86a2-bbd4-4ebd-b40d-3fa83dde9513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:26.115311 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:26.401984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f79ef-de69-4919-a66e-0d7c736aea0b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:26.413686 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f79ef-de69-4919-a66e-0d7c736aea0b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:26.417962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c231be-92ec-45d8-ab15-f85334e7c9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:26.418706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c231be-92ec-45d8-ab15-f85334e7c9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:26.419115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c231be-92ec-45d8-ab15-f85334e7c9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:26.419440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c231be-92ec-45d8-ab15-f85334e7c9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:26.431374 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c231be-92ec-45d8-ab15-f85334e7c9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:26.432852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c231be-92ec-45d8-ab15-f85334e7c9e2 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:26.447251 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 776/1533] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:30.066002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fb8c9-74f0-4e7d-aae0-2dcf8e8e51a5 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:30.066581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fb8c9-74f0-4e7d-aae0-2dcf8e8e51a5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:30.066717 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fb8c9-74f0-4e7d-aae0-2dcf8e8e51a5 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:30.068405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:29:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:29:30.075388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4969e-b902-4a20-a394-7d71d95aec93 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:30.076241 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4969e-b902-4a20-a394-7d71d95aec93 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:30.076241 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4969e-b902-4a20-a394-7d71d95aec93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:30.098026 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b6e4969e-b902-4a20-a394-7d71d95aec93 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:30.099241 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b6e4969e-b902-4a20-a394-7d71d95aec93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:30.107344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:29:30.691138 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fb8c9-74f0-4e7d-aae0-2dcf8e8e51a5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:30.693223 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a61fb8c9-74f0-4e7d-aae0-2dcf8e8e51a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:30.779212 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:30.801332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fb8c9-74f0-4e7d-aae0-2dcf8e8e51a5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:30.807408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919fb25-bd5f-440e-af33-0f926eb87757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:30.808438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919fb25-bd5f-440e-af33-0f926eb87757 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:30.808928 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919fb25-bd5f-440e-af33-0f926eb87757 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:30.809451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919fb25-bd5f-440e-af33-0f926eb87757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:30.823704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919fb25-bd5f-440e-af33-0f926eb87757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:30.826117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919fb25-bd5f-440e-af33-0f926eb87757 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:30.844984 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 759/1536] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:32.851694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038c305-1255-4d4a-a64d-9148a221e7c0 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:32.852292 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038c305-1255-4d4a-a64d-9148a221e7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:32.852292 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038c305-1255-4d4a-a64d-9148a221e7c0 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:32.854782 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:29:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:29:32.861113 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a2e0b-dbdf-4c12-9688-54e71e13169a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:32.861800 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a2e0b-dbdf-4c12-9688-54e71e13169a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:32.861800 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a2e0b-dbdf-4c12-9688-54e71e13169a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:32.882995 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-8d0a2e0b-dbdf-4c12-9688-54e71e13169a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:32.884218 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8d0a2e0b-dbdf-4c12-9688-54e71e13169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:32.892999 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:33.474114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038c305-1255-4d4a-a64d-9148a221e7c0 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:33.476105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7038c305-1255-4d4a-a64d-9148a221e7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:33.492676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038c305-1255-4d4a-a64d-9148a221e7c0 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:33.496641 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02467efb-58ff-43a3-b685-9d9e3d3837bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:33.497263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02467efb-58ff-43a3-b685-9d9e3d3837bb service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:33.497564 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02467efb-58ff-43a3-b685-9d9e3d3837bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:33.497835 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02467efb-58ff-43a3-b685-9d9e3d3837bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:33.510457 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02467efb-58ff-43a3-b685-9d9e3d3837bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:33.512585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02467efb-58ff-43a3-b685-9d9e3d3837bb service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:33.526353 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 779/1539] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:42.877391 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=11 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:43.519704 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=33 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:07.287549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32a469-9850-49d5-92f5-3959e24cd6d3 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.288239 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32a469-9850-49d5-92f5-3959e24cd6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.288239 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32a469-9850-49d5-92f5-3959e24cd6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.317400 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ec32a469-9850-49d5-92f5-3959e24cd6d3 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:07.318676 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ec32a469-9850-49d5-92f5-3959e24cd6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:07.328886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 761/1540] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:07.344466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ffc21-b14e-4001-9829-79f5caa4c05c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.345262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ffc21-b14e-4001-9829-79f5caa4c05c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.345262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ffc21-b14e-4001-9829-79f5caa4c05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.375088 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00398b-c076-4d4c-8941-09f7bd066dbe None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.375364 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00398b-c076-4d4c-8941-09f7bd066dbe None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.375627 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00398b-c076-4d4c-8941-09f7bd066dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.387875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-8b2ffc21-b14e-4001-9829-79f5caa4c05c None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:07.389312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8b2ffc21-b14e-4001-9829-79f5caa4c05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:07.412610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 780/1541] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:07.416292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ee00398b-c076-4d4c-8941-09f7bd066dbe None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:07.421310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ee00398b-c076-4d4c-8941-09f7bd066dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:07.424358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ffc21-b14e-4001-9829-79f5caa4c05c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:07.440318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ffc21-b14e-4001-9829-79f5caa4c05c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:07.444028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 762/1542] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:31:07.456125 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673df094-8870-4191-93e0-a59d38e1bd35 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.456509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673df094-8870-4191-93e0-a59d38e1bd35 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.456788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673df094-8870-4191-93e0-a59d38e1bd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.463551 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a0b0f-5d6f-4d1b-a1a5-86ec91d82b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:07.464204 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a0b0f-5d6f-4d1b-a1a5-86ec91d82b21 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.464478 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a0b0f-5d6f-4d1b-a1a5-86ec91d82b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.464747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a0b0f-5d6f-4d1b-a1a5-86ec91d82b21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.465674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a0b0f-5d6f-4d1b-a1a5-86ec91d82b21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:07.465968 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a0b0f-5d6f-4d1b-a1a5-86ec91d82b21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:07.467122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: WARNING py.warnings [None req-bb4a0b0f-5d6f-4d1b-a1a5-86ec91d82b21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:31:07.467122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: warnings.warn(msg) Aug 29 20:31:07.467122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: Aug 29 20:31:07.468035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a0b0f-5d6f-4d1b-a1a5-86ec91d82b21 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:07.490894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 781/1543] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:31:07.504005 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a0b0f-5d6f-4d1b-a1a5-86ec91d82b21 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:07.505926 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-673df094-8870-4191-93e0-a59d38e1bd35 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:07.507167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-673df094-8870-4191-93e0-a59d38e1bd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:07.521856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a0b0f-5d6f-4d1b-a1a5-86ec91d82b21 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:07.531731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b5795-d577-45ff-ac92-cbfcf5433a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:07.532168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 763/1544] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:31:07.532543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b5795-d577-45ff-ac92-cbfcf5433a89 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.532892 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b5795-d577-45ff-ac92-cbfcf5433a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.533394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b5795-d577-45ff-ac92-cbfcf5433a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.534146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b5795-d577-45ff-ac92-cbfcf5433a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:07.536285 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b5795-d577-45ff-ac92-cbfcf5433a89 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:07.537230 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673df094-8870-4191-93e0-a59d38e1bd35 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:07.565750 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673df094-8870-4191-93e0-a59d38e1bd35 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:07.579222 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8043b-a678-469e-b1a2-5e81d5d3cb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:07.579854 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8043b-a678-469e-b1a2-5e81d5d3cb64 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.580130 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8043b-a678-469e-b1a2-5e81d5d3cb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.580404 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8043b-a678-469e-b1a2-5e81d5d3cb64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.582617 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8043b-a678-469e-b1a2-5e81d5d3cb64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:07.582936 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8043b-a678-469e-b1a2-5e81d5d3cb64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:07.584734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8043b-a678-469e-b1a2-5e81d5d3cb64 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:07.607988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 782/1545] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:07 2022] POST /identity/v3/projects => generated 405 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:31:07.609760 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de6490-d313-4485-ab15-56a2397a8a7a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.610048 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de6490-d313-4485-ab15-56a2397a8a7a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.610315 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de6490-d313-4485-ab15-56a2397a8a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.611199 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 764/1546] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:31:07.615480 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8043b-a678-469e-b1a2-5e81d5d3cb64 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:07.636129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8043b-a678-469e-b1a2-5e81d5d3cb64 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:07.653089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e0de6490-d313-4485-ab15-56a2397a8a7a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:07.654358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e0de6490-d313-4485-ab15-56a2397a8a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:07.759493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380ce8-3853-4a40-91dc-23ba373ef018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:07.760124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380ce8-3853-4a40-91dc-23ba373ef018 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.760400 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380ce8-3853-4a40-91dc-23ba373ef018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.760667 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380ce8-3853-4a40-91dc-23ba373ef018 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.761337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c380ce8-3853-4a40-91dc-23ba373ef018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:07.763550 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c380ce8-3853-4a40-91dc-23ba373ef018 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:07.782888 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 783/1547] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:07.784031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de6490-d313-4485-ab15-56a2397a8a7a None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:07.803000 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 765/1548] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:07 2022] POST /identity/v3/users => generated 303 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:31:07.804367 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c452c-072d-4c2d-999c-8bb1d82e625e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.804649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c452c-072d-4c2d-999c-8bb1d82e625e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.804920 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c452c-072d-4c2d-999c-8bb1d82e625e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.805025 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de6490-d313-4485-ab15-56a2397a8a7a None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:07.811497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77c885-7364-4a62-9da7-8822b90eb3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:07.812132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77c885-7364-4a62-9da7-8822b90eb3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.812413 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77c885-7364-4a62-9da7-8822b90eb3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.812686 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77c885-7364-4a62-9da7-8822b90eb3e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.813407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77c885-7364-4a62-9da7-8822b90eb3e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:07.815349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77c885-7364-4a62-9da7-8822b90eb3e8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:07.842298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f70c452c-072d-4c2d-999c-8bb1d82e625e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:07.845882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f70c452c-072d-4c2d-999c-8bb1d82e625e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:07.868634 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 766/1549] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:07.869642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c452c-072d-4c2d-999c-8bb1d82e625e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:07.880577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c452c-072d-4c2d-999c-8bb1d82e625e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:07.891622 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 784/1550] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:07 2022] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:07.893098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c60b5b-8fc6-41bd-b30b-b0bf00020a5d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.893564 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c60b5b-8fc6-41bd-b30b-b0bf00020a5d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.893937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c60b5b-8fc6-41bd-b30b-b0bf00020a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.897909 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092aff94-bb71-4b3c-9df8-56e7035900e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:07.898590 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092aff94-bb71-4b3c-9df8-56e7035900e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:07.898927 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092aff94-bb71-4b3c-9df8-56e7035900e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:07.899212 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092aff94-bb71-4b3c-9df8-56e7035900e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:07.899903 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092aff94-bb71-4b3c-9df8-56e7035900e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:07.901682 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092aff94-bb71-4b3c-9df8-56e7035900e8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:07.913567 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 767/1551] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:07.914303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092aff94-bb71-4b3c-9df8-56e7035900e8 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:07.919665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-25c60b5b-8fc6-41bd-b30b-b0bf00020a5d None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:07.920906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-25c60b5b-8fc6-41bd-b30b-b0bf00020a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:07.925682 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092aff94-bb71-4b3c-9df8-56e7035900e8 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:07.997127 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 785/1552] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:08.002344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d6ad0-2b8d-4b83-a895-782e1c1dab8e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.002736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d6ad0-2b8d-4b83-a895-782e1c1dab8e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.003012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d6ad0-2b8d-4b83-a895-782e1c1dab8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.007382 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df8500-5d9e-4aec-a079-3f5526be3664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.008035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df8500-5d9e-4aec-a079-3f5526be3664 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.008309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df8500-5d9e-4aec-a079-3f5526be3664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.008579 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df8500-5d9e-4aec-a079-3f5526be3664 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.009227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df8500-5d9e-4aec-a079-3f5526be3664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:08.009558 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df8500-5d9e-4aec-a079-3f5526be3664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.011195 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df8500-5d9e-4aec-a079-3f5526be3664 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.022782 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2e3d6ad0-2b8d-4b83-a895-782e1c1dab8e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:08.029778 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 768/1553] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:08.030012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2e3d6ad0-2b8d-4b83-a895-782e1c1dab8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:08.030130 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5acfda-2056-439f-8f7d-4c44ae813dea None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.030130 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5acfda-2056-439f-8f7d-4c44ae813dea None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.030130 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5acfda-2056-439f-8f7d-4c44ae813dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.038796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 786/1554] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:08.040382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d6ad0-2b8d-4b83-a895-782e1c1dab8e None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.051780 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d6ad0-2b8d-4b83-a895-782e1c1dab8e None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.052033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ba5acfda-2056-439f-8f7d-4c44ae813dea None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:08.053138 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ba5acfda-2056-439f-8f7d-4c44ae813dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:08.056843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105230c-f859-4ebc-8402-1858336ea717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.057486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105230c-f859-4ebc-8402-1858336ea717 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.057880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105230c-f859-4ebc-8402-1858336ea717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.058149 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105230c-f859-4ebc-8402-1858336ea717 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.058784 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105230c-f859-4ebc-8402-1858336ea717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.060587 dv-cinder-854263-2-smb devstack@keystone.service[81539]: WARNING py.warnings [None req-c105230c-f859-4ebc-8402-1858336ea717 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:31:08.060587 dv-cinder-854263-2-smb devstack@keystone.service[81539]: warnings.warn(msg) Aug 29 20:31:08.060587 dv-cinder-854263-2-smb devstack@keystone.service[81539]: Aug 29 20:31:08.061862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 769/1555] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:08.062223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105230c-f859-4ebc-8402-1858336ea717 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.062620 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5acfda-2056-439f-8f7d-4c44ae813dea None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.073373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5acfda-2056-439f-8f7d-4c44ae813dea None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.080682 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dcb81-fa6d-4ada-9114-2f44ab768a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.081415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dcb81-fa6d-4ada-9114-2f44ab768a92 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.081881 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dcb81-fa6d-4ada-9114-2f44ab768a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.082060 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dcb81-fa6d-4ada-9114-2f44ab768a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.082696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9dcb81-fa6d-4ada-9114-2f44ab768a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.085174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9dcb81-fa6d-4ada-9114-2f44ab768a92 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.092221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 787/1556] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/users => generated 297 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:08.092221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce9a65-0d1d-454e-aaa5-ae077cd4f7f6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.092221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce9a65-0d1d-454e-aaa5-ae077cd4f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.092221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce9a65-0d1d-454e-aaa5-ae077cd4f7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.099264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 770/1557] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:08.103138 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d9136-9faf-4755-b44e-2fe3d6dd4ec0 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.103332 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:08.103833 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d9136-9faf-4755-b44e-2fe3d6dd4ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.104256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d9136-9faf-4755-b44e-2fe3d6dd4ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.117621 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-04ce9a65-0d1d-454e-aaa5-ae077cd4f7f6 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:08.118949 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-04ce9a65-0d1d-454e-aaa5-ae077cd4f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:08.124999 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-042d9136-9faf-4755-b44e-2fe3d6dd4ec0 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:08.126158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-042d9136-9faf-4755-b44e-2fe3d6dd4ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:08.128387 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 788/1558] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:08.129565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4cda1-3e45-4d60-99d9-2f2bd8b0ad3c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.129853 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4cda1-3e45-4d60-99d9-2f2bd8b0ad3c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.130125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4cda1-3e45-4d60-99d9-2f2bd8b0ad3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.140529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 771/1559] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:08.141862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d9136-9faf-4755-b44e-2fe3d6dd4ec0 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.151893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1ba4cda1-3e45-4d60-99d9-2f2bd8b0ad3c None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:08.153069 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1ba4cda1-3e45-4d60-99d9-2f2bd8b0ad3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:08.156468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d9136-9faf-4755-b44e-2fe3d6dd4ec0 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.161159 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df4401-6721-4590-b4c7-84064fb850b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.161426 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 789/1560] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:08.165174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df4401-6721-4590-b4c7-84064fb850b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.165174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df4401-6721-4590-b4c7-84064fb850b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.165349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd9216-6fe5-4a32-b1fd-0cc8e732cae3 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.165487 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df4401-6721-4590-b4c7-84064fb850b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.165590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd9216-6fe5-4a32-b1fd-0cc8e732cae3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.165590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd9216-6fe5-4a32-b1fd-0cc8e732cae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.165745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df4401-6721-4590-b4c7-84064fb850b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.165745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: WARNING py.warnings [None req-98df4401-6721-4590-b4c7-84064fb850b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:31:08.165745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: warnings.warn(msg) Aug 29 20:31:08.165745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: Aug 29 20:31:08.165745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df4401-6721-4590-b4c7-84064fb850b6 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.171570 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:08.187286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-acfd9216-6fe5-4a32-b1fd-0cc8e732cae3 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:08.188661 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-acfd9216-6fe5-4a32-b1fd-0cc8e732cae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:08.196994 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 790/1561] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:08.204773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 772/1562] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:08.204964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6044849-4907-4d5b-8332-252fc8127d79 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.204964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6044849-4907-4d5b-8332-252fc8127d79 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.205154 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df4401-6721-4590-b4c7-84064fb850b6 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.205240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6044849-4907-4d5b-8332-252fc8127d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.224814 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a6044849-4907-4d5b-8332-252fc8127d79 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:08.226409 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a6044849-4907-4d5b-8332-252fc8127d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:08.277682 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df4401-6721-4590-b4c7-84064fb850b6 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.283565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c09b0-9f73-4073-b15c-ea9e7bd6721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.284376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c09b0-9f73-4073-b15c-ea9e7bd6721b admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.284826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c09b0-9f73-4073-b15c-ea9e7bd6721b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.285144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c09b0-9f73-4073-b15c-ea9e7bd6721b admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.286006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c09b0-9f73-4073-b15c-ea9e7bd6721b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.287812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c09b0-9f73-4073-b15c-ea9e7bd6721b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.291845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 791/1563] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:08.292685 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6044849-4907-4d5b-8332-252fc8127d79 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.300626 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 773/1564] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:08.301975 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0983e-d377-4fe3-aab2-7a17df7c253b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.302100 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6044849-4907-4d5b-8332-252fc8127d79 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.302291 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0983e-d377-4fe3-aab2-7a17df7c253b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.302577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0983e-d377-4fe3-aab2-7a17df7c253b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.308006 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc09d2-96f0-4cef-93a3-265f7c467a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.308678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc09d2-96f0-4cef-93a3-265f7c467a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.308956 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc09d2-96f0-4cef-93a3-265f7c467a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.309226 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc09d2-96f0-4cef-93a3-265f7c467a7b admin admin] PATH_INFO: `/v3/projects/d2f4d44358d3464d83f0ad6ebd69a313/users/f40aafc95f5b48eb9c316231a2859161/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.323466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d3b0983e-d377-4fe3-aab2-7a17df7c253b None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:08.324833 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d3b0983e-d377-4fe3-aab2-7a17df7c253b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:08.325065 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc09d2-96f0-4cef-93a3-265f7c467a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f4d44358d3464d83f0ad6ebd69a313, user_id=f40aafc95f5b48eb9c316231a2859161, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.328252 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc09d2-96f0-4cef-93a3-265f7c467a7b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.333624 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 774/1565] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:08.334960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0ad0b-1d32-44ed-9129-518efe3df729 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.335378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0ad0b-1d32-44ed-9129-518efe3df729 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.335599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0ad0b-1d32-44ed-9129-518efe3df729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.351176 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 792/1566] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:08 2022] PUT /identity/v3/projects/d2f4d44358d3464d83f0ad6ebd69a313/users/f40aafc95f5b48eb9c316231a2859161/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:08.354233 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc09d2-96f0-4cef-93a3-265f7c467a7b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.356273 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-afd0ad0b-1d32-44ed-9129-518efe3df729 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:08.357503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-afd0ad0b-1d32-44ed-9129-518efe3df729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:08.427719 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 775/1567] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:08.428549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0ad0b-1d32-44ed-9129-518efe3df729 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.429172 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc09d2-96f0-4cef-93a3-265f7c467a7b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.440120 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0ad0b-1d32-44ed-9129-518efe3df729 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.441690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd6ad0-1bce-4e9b-938f-006910c131db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.442334 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd6ad0-1bce-4e9b-938f-006910c131db admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.442617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd6ad0-1bce-4e9b-938f-006910c131db admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.442889 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd6ad0-1bce-4e9b-938f-006910c131db admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.443552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd6ad0-1bce-4e9b-938f-006910c131db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:08.443851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd6ad0-1bce-4e9b-938f-006910c131db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.445709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd6ad0-1bce-4e9b-938f-006910c131db admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.447166 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e48c0d-5063-4797-8e6e-15f2d5babf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.448194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e48c0d-5063-4797-8e6e-15f2d5babf41 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.448832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e48c0d-5063-4797-8e6e-15f2d5babf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.449246 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e48c0d-5063-4797-8e6e-15f2d5babf41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.450598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e48c0d-5063-4797-8e6e-15f2d5babf41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:08.451308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e48c0d-5063-4797-8e6e-15f2d5babf41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.454374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e48c0d-5063-4797-8e6e-15f2d5babf41 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.459381 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 793/1568] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:08.460306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd6ad0-1bce-4e9b-938f-006910c131db admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.473685 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd6ad0-1bce-4e9b-938f-006910c131db admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.484066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 776/1569] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:08.484066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e48c0d-5063-4797-8e6e-15f2d5babf41 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.484483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3f9a6-ef80-4b99-957f-429c4c742bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.484483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3f9a6-ef80-4b99-957f-429c4c742bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.484483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3f9a6-ef80-4b99-957f-429c4c742bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.484483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3f9a6-ef80-4b99-957f-429c4c742bd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.484853 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3f9a6-ef80-4b99-957f-429c4c742bd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.485496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3f9a6-ef80-4b99-957f-429c4c742bd3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.493768 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e48c0d-5063-4797-8e6e-15f2d5babf41 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.501825 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89254c91-9781-48c0-a578-6c27861ac368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.502816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89254c91-9781-48c0-a578-6c27861ac368 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.503306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89254c91-9781-48c0-a578-6c27861ac368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.503723 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89254c91-9781-48c0-a578-6c27861ac368 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.504982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89254c91-9781-48c0-a578-6c27861ac368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:08.505521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89254c91-9781-48c0-a578-6c27861ac368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.508338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89254c91-9781-48c0-a578-6c27861ac368 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.513498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 794/1570] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/users => generated 286 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:08.514486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3f9a6-ef80-4b99-957f-429c4c742bd3 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.526757 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3f9a6-ef80-4b99-957f-429c4c742bd3 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.538429 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 777/1571] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:08.538429 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89254c91-9781-48c0-a578-6c27861ac368 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.538794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d381e16-229d-4b54-b865-1a56c3839ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.538794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d381e16-229d-4b54-b865-1a56c3839ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.538794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d381e16-229d-4b54-b865-1a56c3839ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.538794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d381e16-229d-4b54-b865-1a56c3839ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.539185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d381e16-229d-4b54-b865-1a56c3839ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.539185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d381e16-229d-4b54-b865-1a56c3839ae9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.544033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89254c91-9781-48c0-a578-6c27861ac368 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.550014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0cfd5-1407-4893-814b-7f20a02fc096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.550250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 795/1572] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:08.552330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d169b9-3874-4547-b4bb-02df943137bb None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.552330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d169b9-3874-4547-b4bb-02df943137bb None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.552330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d169b9-3874-4547-b4bb-02df943137bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.553915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0cfd5-1407-4893-814b-7f20a02fc096 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.554231 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0cfd5-1407-4893-814b-7f20a02fc096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.554508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0cfd5-1407-4893-814b-7f20a02fc096 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.555210 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0cfd5-1407-4893-814b-7f20a02fc096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:08.555513 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0cfd5-1407-4893-814b-7f20a02fc096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.557178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0cfd5-1407-4893-814b-7f20a02fc096 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.571658 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 778/1573] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:08.572524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0cfd5-1407-4893-814b-7f20a02fc096 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.585501 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-90d169b9-3874-4547-b4bb-02df943137bb None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:08.587763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-90d169b9-3874-4547-b4bb-02df943137bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:08.591352 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0cfd5-1407-4893-814b-7f20a02fc096 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.596616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faaa28-38ff-44dd-b008-18b7a6e156f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.597324 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faaa28-38ff-44dd-b008-18b7a6e156f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.597697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faaa28-38ff-44dd-b008-18b7a6e156f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.598065 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faaa28-38ff-44dd-b008-18b7a6e156f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.598872 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6faaa28-38ff-44dd-b008-18b7a6e156f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:08.599252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6faaa28-38ff-44dd-b008-18b7a6e156f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.601101 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6faaa28-38ff-44dd-b008-18b7a6e156f8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.602358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 796/1574] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:08.603882 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d169b9-3874-4547-b4bb-02df943137bb None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.619585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 779/1575] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:08.619585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faaa28-38ff-44dd-b008-18b7a6e156f8 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.622772 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d169b9-3874-4547-b4bb-02df943137bb None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.632204 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec26ac-8f38-499d-b51f-061ab0fa3a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.632995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec26ac-8f38-499d-b51f-061ab0fa3a1e admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.633386 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec26ac-8f38-499d-b51f-061ab0fa3a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.633791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec26ac-8f38-499d-b51f-061ab0fa3a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.634530 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec26ac-8f38-499d-b51f-061ab0fa3a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.636472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec26ac-8f38-499d-b51f-061ab0fa3a1e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.639047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faaa28-38ff-44dd-b008-18b7a6e156f8 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.644678 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbe12c-657a-4700-be00-42514c246ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.645294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbe12c-657a-4700-be00-42514c246ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.645608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbe12c-657a-4700-be00-42514c246ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.645873 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbe12c-657a-4700-be00-42514c246ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.646510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbe12c-657a-4700-be00-42514c246ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.648434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbe12c-657a-4700-be00-42514c246ea5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.662484 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:08.675076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 797/1576] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/projects => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:08.675711 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec26ac-8f38-499d-b51f-061ab0fa3a1e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.685140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 780/1577] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:08.689204 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbe12c-657a-4700-be00-42514c246ea5 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.693775 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:08.749005 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec26ac-8f38-499d-b51f-061ab0fa3a1e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.760585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbe12c-657a-4700-be00-42514c246ea5 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.765649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bd137-10a8-4ca2-a163-a4cc1c6098a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.766275 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd137-10a8-4ca2-a163-a4cc1c6098a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.766556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd137-10a8-4ca2-a163-a4cc1c6098a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.766826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd137-10a8-4ca2-a163-a4cc1c6098a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.767472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bd137-10a8-4ca2-a163-a4cc1c6098a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.769428 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bd137-10a8-4ca2-a163-a4cc1c6098a3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.802073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 781/1578] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:08.802970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bd137-10a8-4ca2-a163-a4cc1c6098a3 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.815151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26ecd0-ffb9-4035-9fd6-f4eb194d5837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.815958 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26ecd0-ffb9-4035-9fd6-f4eb194d5837 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.816462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26ecd0-ffb9-4035-9fd6-f4eb194d5837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.816656 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26ecd0-ffb9-4035-9fd6-f4eb194d5837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.817252 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26ecd0-ffb9-4035-9fd6-f4eb194d5837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.819240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26ecd0-ffb9-4035-9fd6-f4eb194d5837 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.832429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 798/1579] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:08.836516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26ecd0-ffb9-4035-9fd6-f4eb194d5837 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.848347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26ecd0-ffb9-4035-9fd6-f4eb194d5837 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.904162 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bd137-10a8-4ca2-a163-a4cc1c6098a3 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:08.911858 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7616a-e991-4422-80b0-7acec6d1c1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.912237 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ad76f-d9d7-4999-9dec-86e178162b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:08.912733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ad76f-d9d7-4999-9dec-86e178162b75 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.913116 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ad76f-d9d7-4999-9dec-86e178162b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.913394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ad76f-d9d7-4999-9dec-86e178162b75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.913602 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7616a-e991-4422-80b0-7acec6d1c1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:08.914053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ad76f-d9d7-4999-9dec-86e178162b75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.914215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7616a-e991-4422-80b0-7acec6d1c1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:08.914731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7616a-e991-4422-80b0-7acec6d1c1eb admin admin] PATH_INFO: `/v3/projects/a371dcc023964374ab5367cf29a7d580/users/46da39cde1ca40c7a84bb457f0e3bf77/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:08.916059 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ad76f-d9d7-4999-9dec-86e178162b75 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.942470 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7616a-e991-4422-80b0-7acec6d1c1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a371dcc023964374ab5367cf29a7d580, user_id=46da39cde1ca40c7a84bb457f0e3bf77, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:08.943599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: WARNING py.warnings [None req-b9a7616a-e991-4422-80b0-7acec6d1c1eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:31:08.943599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: warnings.warn(msg) Aug 29 20:31:08.943599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: Aug 29 20:31:08.946378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7616a-e991-4422-80b0-7acec6d1c1eb admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:08.949078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 799/1580] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:08.949934 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ad76f-d9d7-4999-9dec-86e178162b75 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:08.952084 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d93ad76f-d9d7-4999-9dec-86e178162b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:08.973911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 782/1581] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:08 2022] PUT /identity/v3/projects/a371dcc023964374ab5367cf29a7d580/users/46da39cde1ca40c7a84bb457f0e3bf77/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:08.979815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7616a-e991-4422-80b0-7acec6d1c1eb admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.007429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:09.054366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ad76f-d9d7-4999-9dec-86e178162b75 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.068343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7616a-e991-4422-80b0-7acec6d1c1eb admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.074929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c80d0-24fe-4624-b55d-b87c03d0421c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.075609 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c80d0-24fe-4624-b55d-b87c03d0421c admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.075897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c80d0-24fe-4624-b55d-b87c03d0421c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.076168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c80d0-24fe-4624-b55d-b87c03d0421c admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.077174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c80d0-24fe-4624-b55d-b87c03d0421c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.079392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c80d0-24fe-4624-b55d-b87c03d0421c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.096578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:09.117333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 783/1582] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:08 2022] POST /identity/v3/projects => generated 357 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:09.117333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c80d0-24fe-4624-b55d-b87c03d0421c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.124591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994308a-37f9-4003-b751-8df73ab280fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.125338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994308a-37f9-4003-b751-8df73ab280fa service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.125675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994308a-37f9-4003-b751-8df73ab280fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.125950 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994308a-37f9-4003-b751-8df73ab280fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.140714 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994308a-37f9-4003-b751-8df73ab280fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.142214 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994308a-37f9-4003-b751-8df73ab280fa service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.153002 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 800/1583] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:09.153765 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994308a-37f9-4003-b751-8df73ab280fa service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.165903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994308a-37f9-4003-b751-8df73ab280fa service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.191341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c80d0-24fe-4624-b55d-b87c03d0421c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.197616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c351ff1-4895-49cb-a104-5b2211e3f8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.198762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c351ff1-4895-49cb-a104-5b2211e3f8ac admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.199158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c351ff1-4895-49cb-a104-5b2211e3f8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.199507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c351ff1-4895-49cb-a104-5b2211e3f8ac admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.200671 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c351ff1-4895-49cb-a104-5b2211e3f8ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.204118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c351ff1-4895-49cb-a104-5b2211e3f8ac admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.231640 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 784/1584] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:09 2022] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:09.235887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c351ff1-4895-49cb-a104-5b2211e3f8ac admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.241830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142a258-baf5-494c-94fa-f5f01890fd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.242469 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142a258-baf5-494c-94fa-f5f01890fd67 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.242756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142a258-baf5-494c-94fa-f5f01890fd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.243037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142a258-baf5-494c-94fa-f5f01890fd67 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.243663 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142a258-baf5-494c-94fa-f5f01890fd67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.244091 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c351ff1-4895-49cb-a104-5b2211e3f8ac admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.245643 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142a258-baf5-494c-94fa-f5f01890fd67 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.250035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7c2a2-5c49-4009-aa87-fb5b774cb77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.250861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7c2a2-5c49-4009-aa87-fb5b774cb77f admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.251257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7c2a2-5c49-4009-aa87-fb5b774cb77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.251653 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7c2a2-5c49-4009-aa87-fb5b774cb77f admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.252293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7c2a2-5c49-4009-aa87-fb5b774cb77f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.254834 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7c2a2-5c49-4009-aa87-fb5b774cb77f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.273250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 801/1585] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:09 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:09.277531 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142a258-baf5-494c-94fa-f5f01890fd67 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.281555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 785/1586] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:09 2022] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:09.283046 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7c2a2-5c49-4009-aa87-fb5b774cb77f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.290701 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142a258-baf5-494c-94fa-f5f01890fd67 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.294637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7c2a2-5c49-4009-aa87-fb5b774cb77f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.295273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3ee7f-e1dd-407d-a527-31c8bb96290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.295817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3ee7f-e1dd-407d-a527-31c8bb96290f admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.296096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3ee7f-e1dd-407d-a527-31c8bb96290f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.296349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3ee7f-e1dd-407d-a527-31c8bb96290f admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.297303 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3ee7f-e1dd-407d-a527-31c8bb96290f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.299028 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3ee7f-e1dd-407d-a527-31c8bb96290f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.300792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670669c-5421-4fac-8723-f8be2e9ba448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.301580 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670669c-5421-4fac-8723-f8be2e9ba448 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.302017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670669c-5421-4fac-8723-f8be2e9ba448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.302610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670669c-5421-4fac-8723-f8be2e9ba448 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.303496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670669c-5421-4fac-8723-f8be2e9ba448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.306512 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670669c-5421-4fac-8723-f8be2e9ba448 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.313176 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 802/1587] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:09.314890 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ec92f-d216-42c1-aef0-5593a7925356 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.315162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ec92f-d216-42c1-aef0-5593a7925356 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.315452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ec92f-d216-42c1-aef0-5593a7925356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.337882 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f83ec92f-d216-42c1-aef0-5593a7925356 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:09.339095 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f83ec92f-d216-42c1-aef0-5593a7925356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:09.344101 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 786/1588] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:09 2022] POST /identity/v3/users => generated 288 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:09.349676 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670669c-5421-4fac-8723-f8be2e9ba448 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.357096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 803/1589] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:09.360527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ec92f-d216-42c1-aef0-5593a7925356 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.360742 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670669c-5421-4fac-8723-f8be2e9ba448 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.366106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4faaf-cc45-4235-a018-06ecef14d729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.366787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4faaf-cc45-4235-a018-06ecef14d729 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.366969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4faaf-cc45-4235-a018-06ecef14d729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.367241 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4faaf-cc45-4235-a018-06ecef14d729 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.368057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4faaf-cc45-4235-a018-06ecef14d729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.370195 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4faaf-cc45-4235-a018-06ecef14d729 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.388196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ec92f-d216-42c1-aef0-5593a7925356 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.397091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe6619-a0ae-4d2e-b5a2-bbf61b2d9fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.402188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe6619-a0ae-4d2e-b5a2-bbf61b2d9fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.402188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe6619-a0ae-4d2e-b5a2-bbf61b2d9fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.402188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe6619-a0ae-4d2e-b5a2-bbf61b2d9fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.402188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe6619-a0ae-4d2e-b5a2-bbf61b2d9fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.406521 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe6619-a0ae-4d2e-b5a2-bbf61b2d9fa6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.406625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 787/1590] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:09 2022] POST /identity/v3/users => generated 279 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:09.406625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4faaf-cc45-4235-a018-06ecef14d729 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.417184 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 804/1591] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:09.417732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4faaf-cc45-4235-a018-06ecef14d729 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.418085 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe6619-a0ae-4d2e-b5a2-bbf61b2d9fa6 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.424814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046065a8-034e-41eb-ab4e-eebb3a2c71cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.426537 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046065a8-034e-41eb-ab4e-eebb3a2c71cc admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.427018 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046065a8-034e-41eb-ab4e-eebb3a2c71cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.427292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046065a8-034e-41eb-ab4e-eebb3a2c71cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.428566 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046065a8-034e-41eb-ab4e-eebb3a2c71cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.430884 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe6619-a0ae-4d2e-b5a2-bbf61b2d9fa6 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.431059 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046065a8-034e-41eb-ab4e-eebb3a2c71cc admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.435981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900daee7-fa39-410d-9477-b8b5d55d3db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.436676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900daee7-fa39-410d-9477-b8b5d55d3db1 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.436954 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900daee7-fa39-410d-9477-b8b5d55d3db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.437130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900daee7-fa39-410d-9477-b8b5d55d3db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.437843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900daee7-fa39-410d-9477-b8b5d55d3db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.439485 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900daee7-fa39-410d-9477-b8b5d55d3db1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.447963 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 788/1592] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:09.447963 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046065a8-034e-41eb-ab4e-eebb3a2c71cc admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.453401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 805/1593] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:09.453401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900daee7-fa39-410d-9477-b8b5d55d3db1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.459956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046065a8-034e-41eb-ab4e-eebb3a2c71cc admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.465160 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900daee7-fa39-410d-9477-b8b5d55d3db1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.466545 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144f1e-4a39-43b7-88a5-3b70e2c94b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.467660 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144f1e-4a39-43b7-88a5-3b70e2c94b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.468017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144f1e-4a39-43b7-88a5-3b70e2c94b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.468347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91144f1e-4a39-43b7-88a5-3b70e2c94b2c admin admin] PATH_INFO: `/v3/projects/aca8f1ea9efd4c099f72f9d64cd98a8b/users/e7c89c1a34ea42578c107e1fb34ac6e4/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.470589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485d989-ece2-4fe8-ac8c-e43b921a813e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.471455 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485d989-ece2-4fe8-ac8c-e43b921a813e admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.472709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485d989-ece2-4fe8-ac8c-e43b921a813e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.473056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485d989-ece2-4fe8-ac8c-e43b921a813e admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.473837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485d989-ece2-4fe8-ac8c-e43b921a813e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.475859 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485d989-ece2-4fe8-ac8c-e43b921a813e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.485838 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91144f1e-4a39-43b7-88a5-3b70e2c94b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca8f1ea9efd4c099f72f9d64cd98a8b, user_id=e7c89c1a34ea42578c107e1fb34ac6e4, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.488605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91144f1e-4a39-43b7-88a5-3b70e2c94b2c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.489617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 806/1594] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:09.493946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485d989-ece2-4fe8-ac8c-e43b921a813e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.517408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 789/1595] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:09 2022] PUT /identity/v3/projects/aca8f1ea9efd4c099f72f9d64cd98a8b/users/e7c89c1a34ea42578c107e1fb34ac6e4/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:09.517408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144f1e-4a39-43b7-88a5-3b70e2c94b2c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.543527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:09.583857 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485d989-ece2-4fe8-ac8c-e43b921a813e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.603872 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:09.609841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91144f1e-4a39-43b7-88a5-3b70e2c94b2c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.616725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d1924-54d9-4531-842e-d02fea35395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.617341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d1924-54d9-4531-842e-d02fea35395f admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.618843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d1924-54d9-4531-842e-d02fea35395f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.619428 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d1924-54d9-4531-842e-d02fea35395f admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.620599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d1924-54d9-4531-842e-d02fea35395f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.622983 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d1924-54d9-4531-842e-d02fea35395f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.638560 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 790/1596] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:09.639498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d1924-54d9-4531-842e-d02fea35395f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.652873 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d1924-54d9-4531-842e-d02fea35395f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.655408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385eaf3-a215-477a-9cef-db7dff1db223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.656606 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385eaf3-a215-477a-9cef-db7dff1db223 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.656978 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385eaf3-a215-477a-9cef-db7dff1db223 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.657382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385eaf3-a215-477a-9cef-db7dff1db223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.661001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823df28-19dc-4b19-a018-5d053f74dbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.661890 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823df28-19dc-4b19-a018-5d053f74dbdd admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.662277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823df28-19dc-4b19-a018-5d053f74dbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.662737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823df28-19dc-4b19-a018-5d053f74dbdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.663457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823df28-19dc-4b19-a018-5d053f74dbdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.665313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823df28-19dc-4b19-a018-5d053f74dbdd admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.671674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385eaf3-a215-477a-9cef-db7dff1db223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.674161 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385eaf3-a215-477a-9cef-db7dff1db223 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.681437 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 791/1597] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:09.683866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823df28-19dc-4b19-a018-5d053f74dbdd admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.693027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 807/1598] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:09.699059 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823df28-19dc-4b19-a018-5d053f74dbdd admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.705585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e0f7c-a936-4d36-b5a9-3b08044c46cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.706300 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e0f7c-a936-4d36-b5a9-3b08044c46cf admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.706552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385eaf3-a215-477a-9cef-db7dff1db223 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.706715 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e0f7c-a936-4d36-b5a9-3b08044c46cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.707075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e0f7c-a936-4d36-b5a9-3b08044c46cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.707930 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e0f7c-a936-4d36-b5a9-3b08044c46cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.709792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e0f7c-a936-4d36-b5a9-3b08044c46cf admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.719920 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385eaf3-a215-477a-9cef-db7dff1db223 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.723392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 792/1599] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:09.726061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404404c2-fcf2-4f05-b865-29a9b9efaaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.727042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404404c2-fcf2-4f05-b865-29a9b9efaaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.727391 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404404c2-fcf2-4f05-b865-29a9b9efaaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.727731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404404c2-fcf2-4f05-b865-29a9b9efaaf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.727851 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e0f7c-a936-4d36-b5a9-3b08044c46cf admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.728509 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404404c2-fcf2-4f05-b865-29a9b9efaaf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.730390 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404404c2-fcf2-4f05-b865-29a9b9efaaf3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.738612 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e0f7c-a936-4d36-b5a9-3b08044c46cf admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.744149 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8f7c2-7e5c-41a4-8899-d9dbc4dbc81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.745029 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 808/1600] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:09.745592 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8f7c2-7e5c-41a4-8899-d9dbc4dbc81d admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.746069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8f7c2-7e5c-41a4-8899-d9dbc4dbc81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.746368 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1a760-de78-44e5-9e21-a8ea6af118c8 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.747009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1a760-de78-44e5-9e21-a8ea6af118c8 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.747009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1a760-de78-44e5-9e21-a8ea6af118c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.747538 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8f7c2-7e5c-41a4-8899-d9dbc4dbc81d admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.748787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8f7c2-7e5c-41a4-8899-d9dbc4dbc81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.751112 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8f7c2-7e5c-41a4-8899-d9dbc4dbc81d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.768731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 793/1601] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:09.768731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8f7c2-7e5c-41a4-8899-d9dbc4dbc81d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.782705 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8f7c2-7e5c-41a4-8899-d9dbc4dbc81d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.784931 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-77c1a760-de78-44e5-9e21-a8ea6af118c8 None None] MFA Rules not processed for user `e7c89c1a34ea42578c107e1fb34ac6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:09.786404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-77c1a760-de78-44e5-9e21-a8ea6af118c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:09.790358 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06413f-7bd5-4904-a56b-3301bccf58b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.790623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06413f-7bd5-4904-a56b-3301bccf58b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.790815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06413f-7bd5-4904-a56b-3301bccf58b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.791115 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06413f-7bd5-4904-a56b-3301bccf58b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.791699 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06413f-7bd5-4904-a56b-3301bccf58b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.794016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06413f-7bd5-4904-a56b-3301bccf58b5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.812792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 794/1602] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:09.814977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06413f-7bd5-4904-a56b-3301bccf58b5 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.832976 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06413f-7bd5-4904-a56b-3301bccf58b5 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:09.840082 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa4b05-a4e0-4e19-beb7-c4203cac1f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:09.841464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4b05-a4e0-4e19-beb7-c4203cac1f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:09.841962 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4b05-a4e0-4e19-beb7-c4203cac1f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:09.842181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4b05-a4e0-4e19-beb7-c4203cac1f72 admin admin] PATH_INFO: `/v3/projects/1077a873dd7b461bbb1a2dedd13b858f/users/c68dce0ecbcf40fd82052d990ab83f3e/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:09.869486 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa4b05-a4e0-4e19-beb7-c4203cac1f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1077a873dd7b461bbb1a2dedd13b858f, user_id=c68dce0ecbcf40fd82052d990ab83f3e, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:09.872533 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa4b05-a4e0-4e19-beb7-c4203cac1f72 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:09.893507 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 809/1603] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:09.893507 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1a760-de78-44e5-9e21-a8ea6af118c8 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.893810 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 795/1604] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:09 2022] PUT /identity/v3/projects/1077a873dd7b461bbb1a2dedd13b858f/users/c68dce0ecbcf40fd82052d990ab83f3e/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:09.893810 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa4b05-a4e0-4e19-beb7-c4203cac1f72 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:09.914876 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1a760-de78-44e5-9e21-a8ea6af118c8 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:10.007697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa4b05-a4e0-4e19-beb7-c4203cac1f72 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:10.007697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155601f6-3090-493f-9958-086cf5d8cda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:10.007697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155601f6-3090-493f-9958-086cf5d8cda6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:10.007697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155601f6-3090-493f-9958-086cf5d8cda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:10.008268 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155601f6-3090-493f-9958-086cf5d8cda6 admin admin] PATH_INFO: `/v3/projects/1cebbf6d9f2b419ea60f805241153b70/users/960befc2f96b4565b9a99026d906f3cc/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:10.011791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5469b-b74e-45a8-8c16-218ed6d32611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:10.013987 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5469b-b74e-45a8-8c16-218ed6d32611 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:10.013987 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5469b-b74e-45a8-8c16-218ed6d32611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:10.013987 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5469b-b74e-45a8-8c16-218ed6d32611 admin admin] PATH_INFO: `/v3/projects/d563f96aa2dd4b01ac0f4dbcd4bb9a02/users/75683bc93b194eddb72540008507b2c4/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:10.017992 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:10.030600 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155601f6-3090-493f-9958-086cf5d8cda6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cebbf6d9f2b419ea60f805241153b70, user_id=960befc2f96b4565b9a99026d906f3cc, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:10.035585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155601f6-3090-493f-9958-086cf5d8cda6 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:10.043634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5469b-b74e-45a8-8c16-218ed6d32611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d563f96aa2dd4b01ac0f4dbcd4bb9a02, user_id=75683bc93b194eddb72540008507b2c4, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:10.049935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5469b-b74e-45a8-8c16-218ed6d32611 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:10.060140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 796/1605] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:09 2022] PUT /identity/v3/projects/1cebbf6d9f2b419ea60f805241153b70/users/960befc2f96b4565b9a99026d906f3cc/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:10.061606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155601f6-3090-493f-9958-086cf5d8cda6 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:10.077673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 810/1606] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:09 2022] PUT /identity/v3/projects/d563f96aa2dd4b01ac0f4dbcd4bb9a02/users/75683bc93b194eddb72540008507b2c4/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:10.078536 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5469b-b74e-45a8-8c16-218ed6d32611 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:10.181106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155601f6-3090-493f-9958-086cf5d8cda6 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:10.184833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5469b-b74e-45a8-8c16-218ed6d32611 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:10.190159 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5e433-1a65-467a-a482-aff6d0b4ba57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:10.191242 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5e433-1a65-467a-a482-aff6d0b4ba57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:10.191462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab4648-34ed-4274-b25d-81c946359af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:10.192052 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5e433-1a65-467a-a482-aff6d0b4ba57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:10.192515 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab4648-34ed-4274-b25d-81c946359af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:10.192839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5e433-1a65-467a-a482-aff6d0b4ba57 admin admin] PATH_INFO: `/v3/projects/70f25ea6efae49e3bcb70daf1a9baa4c/users/2965ddfda61d4ba88eb46c48ab5b1f4e/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:10.192953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab4648-34ed-4274-b25d-81c946359af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:10.193383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab4648-34ed-4274-b25d-81c946359af9 admin admin] PATH_INFO: `/v3/projects/eeae3fbf337e47c8a79bae272823e3f1/users/14b4535bad63457abd1a928f46846a8e/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:10.210284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:10.214849 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab4648-34ed-4274-b25d-81c946359af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeae3fbf337e47c8a79bae272823e3f1, user_id=14b4535bad63457abd1a928f46846a8e, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:10.215907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5e433-1a65-467a-a482-aff6d0b4ba57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f25ea6efae49e3bcb70daf1a9baa4c, user_id=2965ddfda61d4ba88eb46c48ab5b1f4e, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:10.218712 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab4648-34ed-4274-b25d-81c946359af9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:10.220315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5e433-1a65-467a-a482-aff6d0b4ba57 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:10.245898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 811/1607] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:10 2022] PUT /identity/v3/projects/eeae3fbf337e47c8a79bae272823e3f1/users/14b4535bad63457abd1a928f46846a8e/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:10.256978 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc43bf6-b2f1-42d8-a4c7-e6c50f8a18e4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:10.256978 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc43bf6-b2f1-42d8-a4c7-e6c50f8a18e4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:10.256978 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc43bf6-b2f1-42d8-a4c7-e6c50f8a18e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:10.262275 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 797/1608] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:10 2022] PUT /identity/v3/projects/70f25ea6efae49e3bcb70daf1a9baa4c/users/2965ddfda61d4ba88eb46c48ab5b1f4e/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:10.265948 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92088768-262b-495a-91fb-866d2c151c38 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:10.265948 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92088768-262b-495a-91fb-866d2c151c38 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:10.265948 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92088768-262b-495a-91fb-866d2c151c38 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:10.267273 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 798/1609] 10.222.0.52 () {54 vars in 962 bytes} [Mon Aug 29 20:31:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:10.270949 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d910165-b2bb-4e3e-b52d-3e92276f2ed2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:10.271684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d910165-b2bb-4e3e-b52d-3e92276f2ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:10.272045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d910165-b2bb-4e3e-b52d-3e92276f2ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:10.302007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-8d910165-b2bb-4e3e-b52d-3e92276f2ed2 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:10.303354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8d910165-b2bb-4e3e-b52d-3e92276f2ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:10.306801 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7bc43bf6-b2f1-42d8-a4c7-e6c50f8a18e4 None None] MFA Rules not processed for user `c68dce0ecbcf40fd82052d990ab83f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:10.308628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7bc43bf6-b2f1-42d8-a4c7-e6c50f8a18e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:10.389632 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 799/1610] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:10.389632 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464221a8-7014-4aa0-a025-117f0911baec None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:10.389632 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464221a8-7014-4aa0-a025-117f0911baec None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:10.389632 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464221a8-7014-4aa0-a025-117f0911baec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:10.420714 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 812/1611] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:10.422795 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31da08a-fac6-4c30-bf78-6f2d00ee1daa None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:10.423032 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31da08a-fac6-4c30-bf78-6f2d00ee1daa None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:10.423307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31da08a-fac6-4c30-bf78-6f2d00ee1daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:10.439962 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-464221a8-7014-4aa0-a025-117f0911baec None None] MFA Rules not processed for user `75683bc93b194eddb72540008507b2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:10.440696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-464221a8-7014-4aa0-a025-117f0911baec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:10.463466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c31da08a-fac6-4c30-bf78-6f2d00ee1daa None None] MFA Rules not processed for user `f40aafc95f5b48eb9c316231a2859161`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:10.465321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c31da08a-fac6-4c30-bf78-6f2d00ee1daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:10.524321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:10.528532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 800/1612] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:10.530160 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f416fb1-040e-4e63-a1cf-c1262776d6e7 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:10.530661 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f416fb1-040e-4e63-a1cf-c1262776d6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:10.530904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f416fb1-040e-4e63-a1cf-c1262776d6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:10.552891 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 813/1613] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:10 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:10.554543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775a888-26c4-4526-b28b-c1fd197020e1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:10.554824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775a888-26c4-4526-b28b-c1fd197020e1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:10.555087 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775a888-26c4-4526-b28b-c1fd197020e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:10.568032 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7f416fb1-040e-4e63-a1cf-c1262776d6e7 None None] MFA Rules not processed for user `14b4535bad63457abd1a928f46846a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:10.569933 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7f416fb1-040e-4e63-a1cf-c1262776d6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:10.578356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5775a888-26c4-4526-b28b-c1fd197020e1 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:10.579561 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5775a888-26c4-4526-b28b-c1fd197020e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:10.587697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 814/1614] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:10.588999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9105f8-f7f9-4a40-9425-70781c1fedd6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:10.589271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9105f8-f7f9-4a40-9425-70781c1fedd6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:10.589559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9105f8-f7f9-4a40-9425-70781c1fedd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:10.636477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-8c9105f8-f7f9-4a40-9425-70781c1fedd6 None None] MFA Rules not processed for user `9c95d16fd4da4fa7987b893eae0b3ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:10.638289 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8c9105f8-f7f9-4a40-9425-70781c1fedd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:10.662400 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 801/1615] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:10.663374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f416fb1-040e-4e63-a1cf-c1262776d6e7 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:10.681892 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:10.742188 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f416fb1-040e-4e63-a1cf-c1262776d6e7 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:10.747084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7154ff2-80e9-4d3a-b71e-8a8eb377445e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:10.747745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7154ff2-80e9-4d3a-b71e-8a8eb377445e service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:10.748069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7154ff2-80e9-4d3a-b71e-8a8eb377445e service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:10.748467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7154ff2-80e9-4d3a-b71e-8a8eb377445e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:10.757980 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 815/1616] 10.222.0.52 () {58 vars in 1059 bytes} [Mon Aug 29 20:31:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:10.759038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9105f8-f7f9-4a40-9425-70781c1fedd6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:10.769849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7154ff2-80e9-4d3a-b71e-8a8eb377445e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:10.771418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7154ff2-80e9-4d3a-b71e-8a8eb377445e service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:10.771865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9105f8-f7f9-4a40-9425-70781c1fedd6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:10.778319 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39f806-0535-4fe2-b380-1a7c5d7085c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:10.778583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39f806-0535-4fe2-b380-1a7c5d7085c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:10.778860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39f806-0535-4fe2-b380-1a7c5d7085c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:10.779223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39f806-0535-4fe2-b380-1a7c5d7085c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:10.779995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39f806-0535-4fe2-b380-1a7c5d7085c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:10.782371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39f806-0535-4fe2-b380-1a7c5d7085c7 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:10.783791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 802/1617] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:10.784631 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7154ff2-80e9-4d3a-b71e-8a8eb377445e service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:10.795733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7154ff2-80e9-4d3a-b71e-8a8eb377445e service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:10.810856 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224984f-df7c-4f2e-81c9-6a74b1edbfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:10.811707 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224984f-df7c-4f2e-81c9-6a74b1edbfea admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:10.812079 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224984f-df7c-4f2e-81c9-6a74b1edbfea admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:10.812797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224984f-df7c-4f2e-81c9-6a74b1edbfea admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:10.813773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224984f-df7c-4f2e-81c9-6a74b1edbfea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:10.817231 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224984f-df7c-4f2e-81c9-6a74b1edbfea admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:10.825304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 816/1618] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:10 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:10.830432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39f806-0535-4fe2-b380-1a7c5d7085c7 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:10.867951 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 803/1619] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:10 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:10.869260 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224984f-df7c-4f2e-81c9-6a74b1edbfea admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:10.958605 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39f806-0535-4fe2-b380-1a7c5d7085c7 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:10.994165 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224984f-df7c-4f2e-81c9-6a74b1edbfea admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:10.998626 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8397d6-0baf-49f9-8022-ad88cbda6690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:10.999469 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8397d6-0baf-49f9-8022-ad88cbda6690 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:10.999846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8397d6-0baf-49f9-8022-ad88cbda6690 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:11.000237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8397d6-0baf-49f9-8022-ad88cbda6690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:11.038625 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:11.068838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41d96f-915a-40e1-898b-ab70e60939d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:11.069820 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41d96f-915a-40e1-898b-ab70e60939d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:11.070110 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41d96f-915a-40e1-898b-ab70e60939d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:11.070374 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41d96f-915a-40e1-898b-ab70e60939d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:11.071074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41d96f-915a-40e1-898b-ab70e60939d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:11.073467 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41d96f-915a-40e1-898b-ab70e60939d7 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:11.094418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8397d6-0baf-49f9-8022-ad88cbda6690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:11.096130 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8397d6-0baf-49f9-8022-ad88cbda6690 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:11.109589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 804/1620] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:11.111251 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 817/1621] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:10 2022] POST /identity/v3/projects => generated 405 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:11.112285 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41d96f-915a-40e1-898b-ab70e60939d7 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:11.113606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8397d6-0baf-49f9-8022-ad88cbda6690 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:11.131327 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8397d6-0baf-49f9-8022-ad88cbda6690 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:11.206773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:11.235529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85e859-892c-4f07-b6c4-b2eaaca3a99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:11.236215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85e859-892c-4f07-b6c4-b2eaaca3a99c admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:11.236634 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85e859-892c-4f07-b6c4-b2eaaca3a99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:11.236938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85e859-892c-4f07-b6c4-b2eaaca3a99c admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:11.237731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85e859-892c-4f07-b6c4-b2eaaca3a99c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:11.239890 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85e859-892c-4f07-b6c4-b2eaaca3a99c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:11.264549 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41d96f-915a-40e1-898b-ab70e60939d7 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:11.271671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c10ac8-6c90-47bc-9a8c-b39158994835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:11.272764 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c10ac8-6c90-47bc-9a8c-b39158994835 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:11.273350 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c10ac8-6c90-47bc-9a8c-b39158994835 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:11.273809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c10ac8-6c90-47bc-9a8c-b39158994835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:11.281736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 805/1622] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:11 2022] POST /identity/v3/projects => generated 355 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:11.283693 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85e859-892c-4f07-b6c4-b2eaaca3a99c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:11.366001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c10ac8-6c90-47bc-9a8c-b39158994835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:11.368885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c10ac8-6c90-47bc-9a8c-b39158994835 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:11.382763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 818/1623] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:11.384066 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c10ac8-6c90-47bc-9a8c-b39158994835 service nova] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:11.396123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c10ac8-6c90-47bc-9a8c-b39158994835 service nova] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:11.402556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85e859-892c-4f07-b6c4-b2eaaca3a99c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:11.404982 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8974e-daa8-470f-91da-01847ca7d0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:11.405886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8974e-daa8-470f-91da-01847ca7d0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:11.406334 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8974e-daa8-470f-91da-01847ca7d0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:11.406788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8974e-daa8-470f-91da-01847ca7d0c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:11.407662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8974e-daa8-470f-91da-01847ca7d0c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:11.409556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4334452-ed9a-4841-91fa-8c9cd108bb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:11.410780 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8974e-daa8-470f-91da-01847ca7d0c7 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:11.411501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4334452-ed9a-4841-91fa-8c9cd108bb94 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:11.412054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4334452-ed9a-4841-91fa-8c9cd108bb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:11.412635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4334452-ed9a-4841-91fa-8c9cd108bb94 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:11.415784 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4334452-ed9a-4841-91fa-8c9cd108bb94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:11.419656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4334452-ed9a-4841-91fa-8c9cd108bb94 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:11.443085 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 819/1624] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:11 2022] POST /identity/v3/users => generated 295 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:11.444213 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8974e-daa8-470f-91da-01847ca7d0c7 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:11.461223 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 806/1625] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:11 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:11.462517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4334452-ed9a-4841-91fa-8c9cd108bb94 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:11.463673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8974e-daa8-470f-91da-01847ca7d0c7 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:11.469793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a16876-adc7-4ef5-a31a-532b1341b62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:11.470821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a16876-adc7-4ef5-a31a-532b1341b62f admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:11.471305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a16876-adc7-4ef5-a31a-532b1341b62f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:11.471694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a16876-adc7-4ef5-a31a-532b1341b62f admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:11.473162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a16876-adc7-4ef5-a31a-532b1341b62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:11.475738 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a16876-adc7-4ef5-a31a-532b1341b62f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:11.476737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4334452-ed9a-4841-91fa-8c9cd108bb94 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:11.482099 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb7e84-0c65-4be3-896a-98fb50bb71bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:11.483003 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7e84-0c65-4be3-896a-98fb50bb71bf admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:11.483471 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7e84-0c65-4be3-896a-98fb50bb71bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:11.484038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7e84-0c65-4be3-896a-98fb50bb71bf admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:11.484852 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb7e84-0c65-4be3-896a-98fb50bb71bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:11.488052 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb7e84-0c65-4be3-896a-98fb50bb71bf admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:11.509605 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 820/1626] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:11 2022] POST /identity/v3/users => generated 309 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:11.510496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a16876-adc7-4ef5-a31a-532b1341b62f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:11.524803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a16876-adc7-4ef5-a31a-532b1341b62f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:11.536514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a6412-6bac-49d1-81ed-ee679cea3d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:11.537270 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a6412-6bac-49d1-81ed-ee679cea3d8c admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:11.540739 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a6412-6bac-49d1-81ed-ee679cea3d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:11.540739 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a6412-6bac-49d1-81ed-ee679cea3d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:11.541021 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 807/1627] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:11 2022] POST /identity/v3/users => generated 284 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:11.541129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a6412-6bac-49d1-81ed-ee679cea3d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:11.541218 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb7e84-0c65-4be3-896a-98fb50bb71bf admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:11.542465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a6412-6bac-49d1-81ed-ee679cea3d8c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:11.564569 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 821/1628] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:11.566906 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb7e84-0c65-4be3-896a-98fb50bb71bf admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:11.567087 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a6412-6bac-49d1-81ed-ee679cea3d8c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:11.572265 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087e461-edf7-435e-8f0d-5e3747d99a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:11.572891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087e461-edf7-435e-8f0d-5e3747d99a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:11.573173 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087e461-edf7-435e-8f0d-5e3747d99a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:11.573481 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087e461-edf7-435e-8f0d-5e3747d99a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:11.574343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087e461-edf7-435e-8f0d-5e3747d99a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:11.576154 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087e461-edf7-435e-8f0d-5e3747d99a65 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:11.581020 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a6412-6bac-49d1-81ed-ee679cea3d8c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:11.590284 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad610e2-87fe-4a2a-b893-83828a29aa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:11.594566 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 808/1629] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:11.594566 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087e461-edf7-435e-8f0d-5e3747d99a65 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:11.597344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad610e2-87fe-4a2a-b893-83828a29aa24 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:11.597344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad610e2-87fe-4a2a-b893-83828a29aa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:11.597840 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad610e2-87fe-4a2a-b893-83828a29aa24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:11.601591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad610e2-87fe-4a2a-b893-83828a29aa24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:11.603786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad610e2-87fe-4a2a-b893-83828a29aa24 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:11.606114 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087e461-edf7-435e-8f0d-5e3747d99a65 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:11.611635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1999229-fe88-46d4-bef4-7fb2f65f8296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:11.612247 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1999229-fe88-46d4-bef4-7fb2f65f8296 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:11.612526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1999229-fe88-46d4-bef4-7fb2f65f8296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:11.612819 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1999229-fe88-46d4-bef4-7fb2f65f8296 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:11.613525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1999229-fe88-46d4-bef4-7fb2f65f8296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:11.617935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1999229-fe88-46d4-bef4-7fb2f65f8296 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:11.632884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 809/1630] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:11.632884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1999229-fe88-46d4-bef4-7fb2f65f8296 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:11.635191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 822/1631] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:11.636872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad610e2-87fe-4a2a-b893-83828a29aa24 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:11.654199 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1999229-fe88-46d4-bef4-7fb2f65f8296 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:11.662014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944c09a-0207-4a8c-a6b7-96da9f535f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:11.662715 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c09a-0207-4a8c-a6b7-96da9f535f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:11.662994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c09a-0207-4a8c-a6b7-96da9f535f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:11.663267 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c09a-0207-4a8c-a6b7-96da9f535f3f admin admin] PATH_INFO: `/v3/projects/1428ab6294724eddb6a18a007e954d93/users/4b9f8b4aeeab40b986d35d130b5aa362/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:11.668441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad610e2-87fe-4a2a-b893-83828a29aa24 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:11.684410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944c09a-0207-4a8c-a6b7-96da9f535f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1428ab6294724eddb6a18a007e954d93, user_id=4b9f8b4aeeab40b986d35d130b5aa362, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:11.687192 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc059ba-5078-4811-9cdb-cdda1552ca4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:11.688224 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944c09a-0207-4a8c-a6b7-96da9f535f3f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:11.693088 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc059ba-5078-4811-9cdb-cdda1552ca4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:11.698859 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc059ba-5078-4811-9cdb-cdda1552ca4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:11.699321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc059ba-5078-4811-9cdb-cdda1552ca4a admin admin] PATH_INFO: `/v3/projects/e0e9e553da794c8c809bb8b5aada359b/users/a1922b54588c4e478ccbc42b7a33406d/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:11.704252 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:11.708714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 810/1632] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:11 2022] PUT /identity/v3/projects/1428ab6294724eddb6a18a007e954d93/users/4b9f8b4aeeab40b986d35d130b5aa362/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:11.710277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944c09a-0207-4a8c-a6b7-96da9f535f3f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:11.738725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc059ba-5078-4811-9cdb-cdda1552ca4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e9e553da794c8c809bb8b5aada359b, user_id=a1922b54588c4e478ccbc42b7a33406d, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:11.742327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc059ba-5078-4811-9cdb-cdda1552ca4a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:11.764788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 823/1633] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:11 2022] PUT /identity/v3/projects/e0e9e553da794c8c809bb8b5aada359b/users/a1922b54588c4e478ccbc42b7a33406d/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:11.764788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc059ba-5078-4811-9cdb-cdda1552ca4a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:11.778748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:11.793921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944c09a-0207-4a8c-a6b7-96da9f535f3f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:11.853191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc059ba-5078-4811-9cdb-cdda1552ca4a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:11.859353 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638b6e8-f4ab-419d-964b-a87d1bf93d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:11.860041 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638b6e8-f4ab-419d-964b-a87d1bf93d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:11.860322 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638b6e8-f4ab-419d-964b-a87d1bf93d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:11.860597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638b6e8-f4ab-419d-964b-a87d1bf93d89 admin admin] PATH_INFO: `/v3/projects/01172be82a664d0186815620e6b92769/users/8419dd602d7b4d6aacde1b93ddb1fcd0/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:11.863507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d243b60-c544-4217-b15a-2145aae347ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:11.864535 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d243b60-c544-4217-b15a-2145aae347ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:11.864956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d243b60-c544-4217-b15a-2145aae347ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:11.865493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d243b60-c544-4217-b15a-2145aae347ba admin admin] PATH_INFO: `/v3/projects/4a52d96099f94467a84c00a9115dc3fa/users/50752e8d5bbe4fc3a14e504288f3b613/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:11.881629 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638b6e8-f4ab-419d-964b-a87d1bf93d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01172be82a664d0186815620e6b92769, user_id=8419dd602d7b4d6aacde1b93ddb1fcd0, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:11.885171 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638b6e8-f4ab-419d-964b-a87d1bf93d89 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:11.885399 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d243b60-c544-4217-b15a-2145aae347ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a52d96099f94467a84c00a9115dc3fa, user_id=50752e8d5bbe4fc3a14e504288f3b613, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:11.888580 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d243b60-c544-4217-b15a-2145aae347ba admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:11.908792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 811/1634] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:11 2022] PUT /identity/v3/projects/4a52d96099f94467a84c00a9115dc3fa/users/50752e8d5bbe4fc3a14e504288f3b613/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:11.909955 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d243b60-c544-4217-b15a-2145aae347ba admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:11.915312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 824/1635] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:11 2022] PUT /identity/v3/projects/01172be82a664d0186815620e6b92769/users/8419dd602d7b4d6aacde1b93ddb1fcd0/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:11.918575 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949cc54-f8fc-49bc-9cd6-c4c5968eabb1 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:11.918575 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949cc54-f8fc-49bc-9cd6-c4c5968eabb1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:11.918575 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949cc54-f8fc-49bc-9cd6-c4c5968eabb1 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:11.919906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 825/1636] 10.222.0.52 () {54 vars in 912 bytes} [Mon Aug 29 20:31:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:11.926238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949cc54-f8fc-49bc-9cd6-c4c5968eabb1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:12.005195 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d243b60-c544-4217-b15a-2145aae347ba admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:12.010377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658689c-4bb1-4f2d-bcab-8a5c0db48705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:12.011165 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658689c-4bb1-4f2d-bcab-8a5c0db48705 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.011428 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658689c-4bb1-4f2d-bcab-8a5c0db48705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.011692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658689c-4bb1-4f2d-bcab-8a5c0db48705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.012747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658689c-4bb1-4f2d-bcab-8a5c0db48705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:12.014181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658689c-4bb1-4f2d-bcab-8a5c0db48705 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:12.018577 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949cc54-f8fc-49bc-9cd6-c4c5968eabb1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:12.023252 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4101b-bada-4cda-92af-6a6a822fd7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:12.024001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4101b-bada-4cda-92af-6a6a822fd7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.024376 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4101b-bada-4cda-92af-6a6a822fd7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.024745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4101b-bada-4cda-92af-6a6a822fd7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.025497 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 812/1637] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:12.025795 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4101b-bada-4cda-92af-6a6a822fd7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:12.026825 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658689c-4bb1-4f2d-bcab-8a5c0db48705 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:12.027770 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4101b-bada-4cda-92af-6a6a822fd7d0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:12.038321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658689c-4bb1-4f2d-bcab-8a5c0db48705 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:12.045307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 826/1638] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:12.045307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4101b-bada-4cda-92af-6a6a822fd7d0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:12.048953 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4d57f-31a6-424f-9dd8-60fdb77494b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:12.050181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4d57f-31a6-424f-9dd8-60fdb77494b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.050729 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4d57f-31a6-424f-9dd8-60fdb77494b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.051090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4d57f-31a6-424f-9dd8-60fdb77494b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.052146 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4d57f-31a6-424f-9dd8-60fdb77494b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:12.055870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4101b-bada-4cda-92af-6a6a822fd7d0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:12.056092 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4d57f-31a6-424f-9dd8-60fdb77494b3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:12.066504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f16112-f895-41dc-9c5c-7e77d1b517ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:12.068175 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f16112-f895-41dc-9c5c-7e77d1b517ed admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.068542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f16112-f895-41dc-9c5c-7e77d1b517ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.068909 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f16112-f895-41dc-9c5c-7e77d1b517ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.069753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f16112-f895-41dc-9c5c-7e77d1b517ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:12.071696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f16112-f895-41dc-9c5c-7e77d1b517ed admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:12.076026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 813/1639] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:12.076026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc4cf1-1d10-4331-b216-5457f7c2f550 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.076026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc4cf1-1d10-4331-b216-5457f7c2f550 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.076026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc4cf1-1d10-4331-b216-5457f7c2f550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.094968 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 827/1640] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:12.094968 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f16112-f895-41dc-9c5c-7e77d1b517ed admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:12.102740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-aecc4cf1-1d10-4331-b216-5457f7c2f550 None None] MFA Rules not processed for user `9c95d16fd4da4fa7987b893eae0b3ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:12.105351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f16112-f895-41dc-9c5c-7e77d1b517ed admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:12.106140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-aecc4cf1-1d10-4331-b216-5457f7c2f550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:12.113094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1e23d-b29d-450a-ba1a-d5ba447a30e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:12.116645 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1e23d-b29d-450a-ba1a-d5ba447a30e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.117858 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1e23d-b29d-450a-ba1a-d5ba447a30e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.118151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1e23d-b29d-450a-ba1a-d5ba447a30e3 admin admin] PATH_INFO: `/v3/projects/1428ab6294724eddb6a18a007e954d93/users/4b9f8b4aeeab40b986d35d130b5aa362/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.121036 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1e23d-b29d-450a-ba1a-d5ba447a30e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1428ab6294724eddb6a18a007e954d93, user_id=4b9f8b4aeeab40b986d35d130b5aa362, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:12.124729 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1e23d-b29d-450a-ba1a-d5ba447a30e3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:12.141334 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 828/1641] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:12 2022] PUT /identity/v3/projects/1428ab6294724eddb6a18a007e954d93/users/4b9f8b4aeeab40b986d35d130b5aa362/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:12.142406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1e23d-b29d-450a-ba1a-d5ba447a30e3 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:12.195589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:12.204373 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:12.221984 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 814/1642] 10.222.0.52 () {58 vars in 1009 bytes} [Mon Aug 29 20:31:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:12.223691 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc4cf1-1d10-4331-b216-5457f7c2f550 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:12.242822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1e23d-b29d-450a-ba1a-d5ba447a30e3 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:12.246488 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc4cf1-1d10-4331-b216-5457f7c2f550 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:12.255171 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efb46f-4b62-4c19-9cf2-4cad5f89e06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:12.255969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bdd09-f601-4f05-b00a-e33d5867fb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:12.256153 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efb46f-4b62-4c19-9cf2-4cad5f89e06f admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.256311 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efb46f-4b62-4c19-9cf2-4cad5f89e06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.256669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efb46f-4b62-4c19-9cf2-4cad5f89e06f admin admin] PATH_INFO: `/v3/projects/e0e9e553da794c8c809bb8b5aada359b/users/a1922b54588c4e478ccbc42b7a33406d/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.259062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bdd09-f601-4f05-b00a-e33d5867fb49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.259316 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efb46f-4b62-4c19-9cf2-4cad5f89e06f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e9e553da794c8c809bb8b5aada359b, user_id=a1922b54588c4e478ccbc42b7a33406d, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:12.259711 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bdd09-f601-4f05-b00a-e33d5867fb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.259999 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bdd09-f601-4f05-b00a-e33d5867fb49 admin admin] PATH_INFO: `/v3/projects/4a52d96099f94467a84c00a9115dc3fa/users/50752e8d5bbe4fc3a14e504288f3b613/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.262892 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efb46f-4b62-4c19-9cf2-4cad5f89e06f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:12.264365 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bdd09-f601-4f05-b00a-e33d5867fb49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a52d96099f94467a84c00a9115dc3fa, user_id=50752e8d5bbe4fc3a14e504288f3b613, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:12.270889 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bdd09-f601-4f05-b00a-e33d5867fb49 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:12.281053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 829/1643] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:12 2022] PUT /identity/v3/projects/e0e9e553da794c8c809bb8b5aada359b/users/a1922b54588c4e478ccbc42b7a33406d/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:12.283028 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efb46f-4b62-4c19-9cf2-4cad5f89e06f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:12.292881 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 815/1644] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:12 2022] PUT /identity/v3/projects/4a52d96099f94467a84c00a9115dc3fa/users/50752e8d5bbe4fc3a14e504288f3b613/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:12.294514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d93cec-b4d2-4624-a8cc-078a10235571 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.356272 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d93cec-b4d2-4624-a8cc-078a10235571 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.356272 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d93cec-b4d2-4624-a8cc-078a10235571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.370167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-83d93cec-b4d2-4624-a8cc-078a10235571 None None] MFA Rules not processed for user `4b9f8b4aeeab40b986d35d130b5aa362`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:12.371425 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-83d93cec-b4d2-4624-a8cc-078a10235571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:12.456483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efb46f-4b62-4c19-9cf2-4cad5f89e06f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:12.479045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 816/1645] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:12.479045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d93cec-b4d2-4624-a8cc-078a10235571 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:12.560594 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdab71f-ec8c-4632-9b5c-bdd22f65f76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:12.561615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdab71f-ec8c-4632-9b5c-bdd22f65f76c admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.562046 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdab71f-ec8c-4632-9b5c-bdd22f65f76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.562472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdab71f-ec8c-4632-9b5c-bdd22f65f76c admin admin] PATH_INFO: `/v3/projects/01172be82a664d0186815620e6b92769/users/8419dd602d7b4d6aacde1b93ddb1fcd0/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.565991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdab71f-ec8c-4632-9b5c-bdd22f65f76c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01172be82a664d0186815620e6b92769, user_id=8419dd602d7b4d6aacde1b93ddb1fcd0, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:12.568896 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d93cec-b4d2-4624-a8cc-078a10235571 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:12.569628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdab71f-ec8c-4632-9b5c-bdd22f65f76c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:12.573945 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75734cb6-f0e6-455e-8d30-f6c5149acbdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:12.574905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75734cb6-f0e6-455e-8d30-f6c5149acbdb service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.575212 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75734cb6-f0e6-455e-8d30-f6c5149acbdb service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.575453 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75734cb6-f0e6-455e-8d30-f6c5149acbdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.584684 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 830/1646] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:12 2022] PUT /identity/v3/projects/01172be82a664d0186815620e6b92769/users/8419dd602d7b4d6aacde1b93ddb1fcd0/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:12.586564 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0113090-b294-46b9-b87d-006c991148aa None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.587468 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0113090-b294-46b9-b87d-006c991148aa None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.588062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0113090-b294-46b9-b87d-006c991148aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.630346 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f0113090-b294-46b9-b87d-006c991148aa None None] MFA Rules not processed for user `a1922b54588c4e478ccbc42b7a33406d`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:12.631935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f0113090-b294-46b9-b87d-006c991148aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:12.680282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75734cb6-f0e6-455e-8d30-f6c5149acbdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:12.683154 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75734cb6-f0e6-455e-8d30-f6c5149acbdb service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:12.706336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 817/1647] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:12.708761 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d843dd7-ca8e-4f40-969e-44d88c213f79 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.709325 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d843dd7-ca8e-4f40-969e-44d88c213f79 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.709735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d843dd7-ca8e-4f40-969e-44d88c213f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.764151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:12.768411 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:12.772807 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-0d843dd7-ca8e-4f40-969e-44d88c213f79 None None] MFA Rules not processed for user `50752e8d5bbe4fc3a14e504288f3b613`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:12.774771 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0d843dd7-ca8e-4f40-969e-44d88c213f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:12.780052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 831/1648] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:12.781130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0113090-b294-46b9-b87d-006c991148aa None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:12.899025 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0113090-b294-46b9-b87d-006c991148aa None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:12.912493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c50097-c34d-4d31-8d0d-5376d36275b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:12.913134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c50097-c34d-4d31-8d0d-5376d36275b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.915630 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c50097-c34d-4d31-8d0d-5376d36275b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.917982 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c50097-c34d-4d31-8d0d-5376d36275b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.959015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 818/1649] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:13.086044 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c50097-c34d-4d31-8d0d-5376d36275b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:13.090732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c50097-c34d-4d31-8d0d-5376d36275b0 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:13.120314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 832/1650] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:13.798919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500790d-6480-4715-894f-d0dd17f243b8 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:13.799843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500790d-6480-4715-894f-d0dd17f243b8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:13.800268 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500790d-6480-4715-894f-d0dd17f243b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:13.850690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c50097-c34d-4d31-8d0d-5376d36275b0 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:13.859486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c50097-c34d-4d31-8d0d-5376d36275b0 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:13.866918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3061a7-5f31-45ee-adfb-73273c8e8626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:13.868138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3061a7-5f31-45ee-adfb-73273c8e8626 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:13.868694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3061a7-5f31-45ee-adfb-73273c8e8626 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:13.869244 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3061a7-5f31-45ee-adfb-73273c8e8626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:13.871438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-2500790d-6480-4715-894f-d0dd17f243b8 None None] MFA Rules not processed for user `8419dd602d7b4d6aacde1b93ddb1fcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:13.877917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2500790d-6480-4715-894f-d0dd17f243b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:13.881919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3061a7-5f31-45ee-adfb-73273c8e8626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:13.883722 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3061a7-5f31-45ee-adfb-73273c8e8626 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:13.898398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 833/1651] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:14.031922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3061a7-5f31-45ee-adfb-73273c8e8626 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:14.049807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3061a7-5f31-45ee-adfb-73273c8e8626 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:14.054235 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e6099-7f63-4a99-a44c-dffa2e4e3809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:14.054935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e6099-7f63-4a99-a44c-dffa2e4e3809 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:14.055312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e6099-7f63-4a99-a44c-dffa2e4e3809 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:14.056133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e6099-7f63-4a99-a44c-dffa2e4e3809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:14.059390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 819/1652] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:13 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:14.107324 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e6099-7f63-4a99-a44c-dffa2e4e3809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:14.109227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e6099-7f63-4a99-a44c-dffa2e4e3809 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:14.147954 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 834/1653] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:14.195793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500790d-6480-4715-894f-d0dd17f243b8 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:14.220414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500790d-6480-4715-894f-d0dd17f243b8 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:14.230116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ebfe9-87ba-41a4-8186-8722ab8cc233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:14.230987 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ebfe9-87ba-41a4-8186-8722ab8cc233 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:14.231336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ebfe9-87ba-41a4-8186-8722ab8cc233 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:14.231801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ebfe9-87ba-41a4-8186-8722ab8cc233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:14.428715 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ebfe9-87ba-41a4-8186-8722ab8cc233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:14.433858 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ebfe9-87ba-41a4-8186-8722ab8cc233 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:14.510795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 820/1654] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:14.515648 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e6099-7f63-4a99-a44c-dffa2e4e3809 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:14.528520 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e6099-7f63-4a99-a44c-dffa2e4e3809 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:14.546052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07337880-8bad-45e8-a426-eb295754928b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:14.547072 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07337880-8bad-45e8-a426-eb295754928b service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:14.547354 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07337880-8bad-45e8-a426-eb295754928b service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:14.547629 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07337880-8bad-45e8-a426-eb295754928b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:14.818811 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07337880-8bad-45e8-a426-eb295754928b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:14.823955 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07337880-8bad-45e8-a426-eb295754928b service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:14.853459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 835/1655] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:14.986715 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7156d-0b71-49e5-8d32-03c824bb2a4d None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:14.987278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7156d-0b71-49e5-8d32-03c824bb2a4d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:14.987521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7156d-0b71-49e5-8d32-03c824bb2a4d None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:14.989880 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 821/1656] 10.222.0.52 () {54 vars in 962 bytes} [Mon Aug 29 20:31:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:15.021949 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f0e4f-70f3-453c-b68f-9e93ddda5d87 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:15.023025 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f0e4f-70f3-453c-b68f-9e93ddda5d87 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:15.023430 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f0e4f-70f3-453c-b68f-9e93ddda5d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:15.100353 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-083f0e4f-70f3-453c-b68f-9e93ddda5d87 None None] MFA Rules not processed for user `9c95d16fd4da4fa7987b893eae0b3ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:15.113066 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-083f0e4f-70f3-453c-b68f-9e93ddda5d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:15.167037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:15.339079 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 836/1657] 10.222.0.52 () {58 vars in 1059 bytes} [Mon Aug 29 20:31:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:15.340872 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fbd38-d6e1-4701-9e8e-ea582312dfda None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:15.341536 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fbd38-d6e1-4701-9e8e-ea582312dfda None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:15.342070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fbd38-d6e1-4701-9e8e-ea582312dfda None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:15.352052 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 822/1658] 10.222.0.52 () {54 vars in 912 bytes} [Mon Aug 29 20:31:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:15.358845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fe951-4025-4f7d-8574-0169103e77c1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:15.359132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fe951-4025-4f7d-8574-0169103e77c1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:15.359406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fe951-4025-4f7d-8574-0169103e77c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:15.383060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d74fe951-4025-4f7d-8574-0169103e77c1 None None] MFA Rules not processed for user `9c95d16fd4da4fa7987b893eae0b3ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:15.384506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d74fe951-4025-4f7d-8574-0169103e77c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:15.421306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 837/1659] 10.222.0.52 () {58 vars in 1009 bytes} [Mon Aug 29 20:31:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:15.431122 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fbd38-d6e1-4701-9e8e-ea582312dfda None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:15.453755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fbd38-d6e1-4701-9e8e-ea582312dfda None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:15.466198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79154414-e0b2-4a02-9bf5-989d22bc9b08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:15.466924 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79154414-e0b2-4a02-9bf5-989d22bc9b08 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:15.467213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79154414-e0b2-4a02-9bf5-989d22bc9b08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:15.467487 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79154414-e0b2-4a02-9bf5-989d22bc9b08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:15.490729 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79154414-e0b2-4a02-9bf5-989d22bc9b08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:15.492211 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79154414-e0b2-4a02-9bf5-989d22bc9b08 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:15.518387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 823/1660] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:15.740626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a331c0b-a9d1-49fe-b9b3-82732512f82b None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:15.741316 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a331c0b-a9d1-49fe-b9b3-82732512f82b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:15.741850 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a331c0b-a9d1-49fe-b9b3-82732512f82b None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:15.743940 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 838/1661] 10.222.0.52 () {54 vars in 921 bytes} [Mon Aug 29 20:31:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:15.793421 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f75669-ba2a-4ac0-ae16-12141f2aed24 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:15.793759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f75669-ba2a-4ac0-ae16-12141f2aed24 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:15.794077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f75669-ba2a-4ac0-ae16-12141f2aed24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:15.825164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-14f75669-ba2a-4ac0-ae16-12141f2aed24 None None] MFA Rules not processed for user `b8295272eec349f8aa38e44c861faa47`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:15.826845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-14f75669-ba2a-4ac0-ae16-12141f2aed24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:15.833833 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:15.987021 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 824/1662] 10.222.0.52 () {58 vars in 1018 bytes} [Mon Aug 29 20:31:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:16.022542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a331c0b-a9d1-49fe-b9b3-82732512f82b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:16.045767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a331c0b-a9d1-49fe-b9b3-82732512f82b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:16.069382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133f477-8c4a-4cf8-b379-d26b4fa10c28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8295272eec349f8aa38e44c861faa47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:16.070035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133f477-8c4a-4cf8-b379-d26b4fa10c28 service placement] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:16.070319 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133f477-8c4a-4cf8-b379-d26b4fa10c28 service placement] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:16.070593 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133f477-8c4a-4cf8-b379-d26b4fa10c28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:16.104244 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133f477-8c4a-4cf8-b379-d26b4fa10c28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:16.106948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133f477-8c4a-4cf8-b379-d26b4fa10c28 service placement] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:16.153323 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 839/1663] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:17.320102 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f75669-ba2a-4ac0-ae16-12141f2aed24 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:17.353159 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f75669-ba2a-4ac0-ae16-12141f2aed24 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:17.362403 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244a397-b9a2-4fcf-99b5-aa676fbca433 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:17.364298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a397-b9a2-4fcf-99b5-aa676fbca433 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:17.366011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a397-b9a2-4fcf-99b5-aa676fbca433 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:17.367215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a397-b9a2-4fcf-99b5-aa676fbca433 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:17.438505 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133f477-8c4a-4cf8-b379-d26b4fa10c28 service placement] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:17.547431 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244a397-b9a2-4fcf-99b5-aa676fbca433 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:17.550826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244a397-b9a2-4fcf-99b5-aa676fbca433 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:17.557346 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133f477-8c4a-4cf8-b379-d26b4fa10c28 service placement] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:17.563606 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156a7ff-1bb2-44e2-b1af-452ea174b96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:17.564522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156a7ff-1bb2-44e2-b1af-452ea174b96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:17.564944 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156a7ff-1bb2-44e2-b1af-452ea174b96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:17.565396 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156a7ff-1bb2-44e2-b1af-452ea174b96f admin admin] PATH_INFO: `/v3/users/e7c89c1a34ea42578c107e1fb34ac6e4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:17.566798 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156a7ff-1bb2-44e2-b1af-452ea174b96f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c89c1a34ea42578c107e1fb34ac6e4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:17.569030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156a7ff-1bb2-44e2-b1af-452ea174b96f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:17.583555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 825/1664] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:17.658068 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3156a7ff-1bb2-44e2-b1af-452ea174b96f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c89c1a34ea42578c107e1fb34ac6e4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:17.674200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3156a7ff-1bb2-44e2-b1af-452ea174b96f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c89c1a34ea42578c107e1fb34ac6e4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:17.699313 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3156a7ff-1bb2-44e2-b1af-452ea174b96f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c89c1a34ea42578c107e1fb34ac6e4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:17.701094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3156a7ff-1bb2-44e2-b1af-452ea174b96f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c89c1a34ea42578c107e1fb34ac6e4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:17.703474 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3156a7ff-1bb2-44e2-b1af-452ea174b96f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c89c1a34ea42578c107e1fb34ac6e4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:17.742906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 840/1665] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:17 2022] DELETE /identity/v3/users/e7c89c1a34ea42578c107e1fb34ac6e4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:17.748076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9287c-18fe-48c9-a477-b30f7ffcdc5c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:17.752358 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9287c-18fe-48c9-a477-b30f7ffcdc5c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:17.752358 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9287c-18fe-48c9-a477-b30f7ffcdc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:17.786539 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-62d9287c-18fe-48c9-a477-b30f7ffcdc5c None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:17.788385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-62d9287c-18fe-48c9-a477-b30f7ffcdc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:17.949743 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 826/1666] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:17.970788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156a7ff-1bb2-44e2-b1af-452ea174b96f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:17.982568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3156a7ff-1bb2-44e2-b1af-452ea174b96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:18.030167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:18.160106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156a7ff-1bb2-44e2-b1af-452ea174b96f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:18.169525 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc39ea-70b0-4ccd-bd9e-17d213b929c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:18.171617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc39ea-70b0-4ccd-bd9e-17d213b929c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:18.172640 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc39ea-70b0-4ccd-bd9e-17d213b929c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:18.173985 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc39ea-70b0-4ccd-bd9e-17d213b929c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:18.213054 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc39ea-70b0-4ccd-bd9e-17d213b929c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:18.217540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc39ea-70b0-4ccd-bd9e-17d213b929c5 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:18.263890 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 841/1667] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:18.313792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5b0d5-e93b-4103-90ba-ae2770fc40aa None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:18.314013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5b0d5-e93b-4103-90ba-ae2770fc40aa None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:18.314276 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5b0d5-e93b-4103-90ba-ae2770fc40aa None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:18.316357 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 827/1668] 10.222.0.52 () {54 vars in 921 bytes} [Mon Aug 29 20:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:18.408260 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988096c-855d-4648-93fc-ffc96f431fdc None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:18.408552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988096c-855d-4648-93fc-ffc96f431fdc None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:18.408830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988096c-855d-4648-93fc-ffc96f431fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:18.455882 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6988096c-855d-4648-93fc-ffc96f431fdc None None] MFA Rules not processed for user `b8295272eec349f8aa38e44c861faa47`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:18.469218 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6988096c-855d-4648-93fc-ffc96f431fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:18.753285 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 842/1669] 10.222.0.52 () {58 vars in 1018 bytes} [Mon Aug 29 20:31:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:31:19.406369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5b0d5-e93b-4103-90ba-ae2770fc40aa None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:19.406369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c2d5b0d5-e93b-4103-90ba-ae2770fc40aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:19.448143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5b0d5-e93b-4103-90ba-ae2770fc40aa None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:19.459868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07837b6-ce61-4f7d-b9e6-abbab8945fd2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8295272eec349f8aa38e44c861faa47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:19.460620 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07837b6-ce61-4f7d-b9e6-abbab8945fd2 service placement] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:19.461038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07837b6-ce61-4f7d-b9e6-abbab8945fd2 service placement] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:19.461317 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07837b6-ce61-4f7d-b9e6-abbab8945fd2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:19.498204 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07837b6-ce61-4f7d-b9e6-abbab8945fd2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:19.500789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07837b6-ce61-4f7d-b9e6-abbab8945fd2 service placement] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:19.538805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 828/1670] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:19.554663 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988096c-855d-4648-93fc-ffc96f431fdc None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:19.558616 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6988096c-855d-4648-93fc-ffc96f431fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:19.599595 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988096c-855d-4648-93fc-ffc96f431fdc None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:19.616905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa0946-725f-40f8-b101-3c7fcf2acf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:19.617912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa0946-725f-40f8-b101-3c7fcf2acf1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:19.618495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa0946-725f-40f8-b101-3c7fcf2acf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:19.618745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa0946-725f-40f8-b101-3c7fcf2acf1c admin admin] PATH_INFO: `/v3/users/f40aafc95f5b48eb9c316231a2859161` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:19.629623 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa0946-725f-40f8-b101-3c7fcf2acf1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f40aafc95f5b48eb9c316231a2859161)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:19.631614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa0946-725f-40f8-b101-3c7fcf2acf1c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:19.749221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e0fa0946-725f-40f8-b101-3c7fcf2acf1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f40aafc95f5b48eb9c316231a2859161'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:19.795623 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e0fa0946-725f-40f8-b101-3c7fcf2acf1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f40aafc95f5b48eb9c316231a2859161'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:19.850806 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e0fa0946-725f-40f8-b101-3c7fcf2acf1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f40aafc95f5b48eb9c316231a2859161'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:19.857194 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e0fa0946-725f-40f8-b101-3c7fcf2acf1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f40aafc95f5b48eb9c316231a2859161'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:19.859654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e0fa0946-725f-40f8-b101-3c7fcf2acf1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f40aafc95f5b48eb9c316231a2859161'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:19.889948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 843/1671] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:19 2022] DELETE /identity/v3/users/f40aafc95f5b48eb9c316231a2859161 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:20.175776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07837b6-ce61-4f7d-b9e6-abbab8945fd2 service placement] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:20.177293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b07837b6-ce61-4f7d-b9e6-abbab8945fd2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:20.220345 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07837b6-ce61-4f7d-b9e6-abbab8945fd2 service placement] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:20.324343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:20.440257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb5b78-2327-4bdc-ba22-75926ecd2f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:20.442727 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb5b78-2327-4bdc-ba22-75926ecd2f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:20.443167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb5b78-2327-4bdc-ba22-75926ecd2f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:20.443589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb5b78-2327-4bdc-ba22-75926ecd2f6d admin admin] PATH_INFO: `/v3/users/c68dce0ecbcf40fd82052d990ab83f3e` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:20.453922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb5b78-2327-4bdc-ba22-75926ecd2f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c68dce0ecbcf40fd82052d990ab83f3e)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:20.455270 dv-cinder-854263-2-smb devstack@keystone.service[81540]: WARNING py.warnings [None req-25eb5b78-2327-4bdc-ba22-75926ecd2f6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:31:20.455270 dv-cinder-854263-2-smb devstack@keystone.service[81540]: warnings.warn(msg) Aug 29 20:31:20.455270 dv-cinder-854263-2-smb devstack@keystone.service[81540]: Aug 29 20:31:20.471519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb5b78-2327-4bdc-ba22-75926ecd2f6d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:20.672453 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-25eb5b78-2327-4bdc-ba22-75926ecd2f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c68dce0ecbcf40fd82052d990ab83f3e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.691981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa0946-725f-40f8-b101-3c7fcf2acf1c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:20.694155 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e0fa0946-725f-40f8-b101-3c7fcf2acf1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:20.724317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa0946-725f-40f8-b101-3c7fcf2acf1c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:20.744879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20200a-560c-4e0c-9744-5ce08ab6046d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:20.748304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20200a-560c-4e0c-9744-5ce08ab6046d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:20.749296 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20200a-560c-4e0c-9744-5ce08ab6046d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:20.751209 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-25eb5b78-2327-4bdc-ba22-75926ecd2f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c68dce0ecbcf40fd82052d990ab83f3e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.752899 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20200a-560c-4e0c-9744-5ce08ab6046d admin admin] PATH_INFO: `/v3/projects/aca8f1ea9efd4c099f72f9d64cd98a8b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:20.777229 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20200a-560c-4e0c-9744-5ce08ab6046d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aca8f1ea9efd4c099f72f9d64cd98a8b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:20.781513 dv-cinder-854263-2-smb devstack@keystone.service[81539]: WARNING py.warnings [None req-7a20200a-560c-4e0c-9744-5ce08ab6046d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:31:20.781513 dv-cinder-854263-2-smb devstack@keystone.service[81539]: warnings.warn(msg) Aug 29 20:31:20.781513 dv-cinder-854263-2-smb devstack@keystone.service[81539]: Aug 29 20:31:20.790078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20200a-560c-4e0c-9744-5ce08ab6046d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:20.803621 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-25eb5b78-2327-4bdc-ba22-75926ecd2f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c68dce0ecbcf40fd82052d990ab83f3e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.805606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-25eb5b78-2327-4bdc-ba22-75926ecd2f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c68dce0ecbcf40fd82052d990ab83f3e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.818796 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-25eb5b78-2327-4bdc-ba22-75926ecd2f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c68dce0ecbcf40fd82052d990ab83f3e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.838457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 829/1672] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:20 2022] DELETE /identity/v3/users/c68dce0ecbcf40fd82052d990ab83f3e => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:20.846127 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a9ab-54c1-4223-bd6c-ca88808dfc53 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:20.863184 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a9ab-54c1-4223-bd6c-ca88808dfc53 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:20.864125 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a9ab-54c1-4223-bd6c-ca88808dfc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:20.870664 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:20.922238 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-4f38a9ab-54c1-4223-bd6c-ca88808dfc53 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:20.924077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4f38a9ab-54c1-4223-bd6c-ca88808dfc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:20.933404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7a20200a-560c-4e0c-9744-5ce08ab6046d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aca8f1ea9efd4c099f72f9d64cd98a8b', 'request_id': 'req-7a20200a-560c-4e0c-9744-5ce08ab6046d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.968762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7a20200a-560c-4e0c-9744-5ce08ab6046d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aca8f1ea9efd4c099f72f9d64cd98a8b', 'request_id': 'req-7a20200a-560c-4e0c-9744-5ce08ab6046d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.001775 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7a20200a-560c-4e0c-9744-5ce08ab6046d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aca8f1ea9efd4c099f72f9d64cd98a8b', 'request_id': 'req-7a20200a-560c-4e0c-9744-5ce08ab6046d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.042870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7a20200a-560c-4e0c-9744-5ce08ab6046d admin admin] The token cache is being invalidate because project aca8f1ea9efd4c099f72f9d64cd98a8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:21.043431 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7a20200a-560c-4e0c-9744-5ce08ab6046d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.044284 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7a20200a-560c-4e0c-9744-5ce08ab6046d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.046465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 844/1673] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:20 2022] DELETE /identity/v3/projects/aca8f1ea9efd4c099f72f9d64cd98a8b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:31:21.051756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cda158-fcc1-4919-82a9-e771b72c29c4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:21.052294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cda158-fcc1-4919-82a9-e771b72c29c4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:21.052726 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cda158-fcc1-4919-82a9-e771b72c29c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:21.098277 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-73cda158-fcc1-4919-82a9-e771b72c29c4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:21.099536 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-73cda158-fcc1-4919-82a9-e771b72c29c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:21.118224 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 830/1674] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:21.129535 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 845/1675] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:31:21.132143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49385bd-e1a3-4c45-b80b-d7656ab2cc1a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:21.132684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49385bd-e1a3-4c45-b80b-d7656ab2cc1a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:21.133130 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49385bd-e1a3-4c45-b80b-d7656ab2cc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:21.200261 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-a49385bd-e1a3-4c45-b80b-d7656ab2cc1a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:21.202785 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a49385bd-e1a3-4c45-b80b-d7656ab2cc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:21.226626 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 831/1676] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:21.230930 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cda158-fcc1-4919-82a9-e771b72c29c4 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:21.239697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49385bd-e1a3-4c45-b80b-d7656ab2cc1a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:21.243422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a49385bd-e1a3-4c45-b80b-d7656ab2cc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:21.247436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cda158-fcc1-4919-82a9-e771b72c29c4 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:21.262909 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090185e-ebcc-4703-a675-588d0bee6577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:21.273131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090185e-ebcc-4703-a675-588d0bee6577 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:21.274014 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090185e-ebcc-4703-a675-588d0bee6577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:21.278121 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090185e-ebcc-4703-a675-588d0bee6577 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:21.279602 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090185e-ebcc-4703-a675-588d0bee6577 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:21.280138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090185e-ebcc-4703-a675-588d0bee6577 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:21.284340 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090185e-ebcc-4703-a675-588d0bee6577 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:21.328369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 846/1677] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:21.332969 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090185e-ebcc-4703-a675-588d0bee6577 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:21.364115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090185e-ebcc-4703-a675-588d0bee6577 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:21.388286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6923de-6835-40f8-9df8-2828bd988dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:21.405273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6923de-6835-40f8-9df8-2828bd988dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:21.408019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6923de-6835-40f8-9df8-2828bd988dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:21.408554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6923de-6835-40f8-9df8-2828bd988dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:21.410913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6923de-6835-40f8-9df8-2828bd988dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:21.431363 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6923de-6835-40f8-9df8-2828bd988dc4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:21.450596 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:21.586789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49385bd-e1a3-4c45-b80b-d7656ab2cc1a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:21.607208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97b97e-5368-4b3b-9351-7989db602753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:21.609287 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97b97e-5368-4b3b-9351-7989db602753 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:21.612676 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97b97e-5368-4b3b-9351-7989db602753 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:21.614776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97b97e-5368-4b3b-9351-7989db602753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:21.653083 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 847/1678] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:21 2022] POST /identity/v3/projects => generated 363 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:31:21.657803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6923de-6835-40f8-9df8-2828bd988dc4 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:21.668618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97b97e-5368-4b3b-9351-7989db602753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:21.678431 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97b97e-5368-4b3b-9351-7989db602753 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:21.741239 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 832/1679] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:21.854769 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6923de-6835-40f8-9df8-2828bd988dc4 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:21.865078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631bfdd-2ce6-4eba-9f4b-122079ad3f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:21.866999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631bfdd-2ce6-4eba-9f4b-122079ad3f3b admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:21.868473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631bfdd-2ce6-4eba-9f4b-122079ad3f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:21.869155 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631bfdd-2ce6-4eba-9f4b-122079ad3f3b admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:21.870125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631bfdd-2ce6-4eba-9f4b-122079ad3f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:21.877617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631bfdd-2ce6-4eba-9f4b-122079ad3f3b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:21.886048 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97b97e-5368-4b3b-9351-7989db602753 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:21.887635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ce97b97e-5368-4b3b-9351-7989db602753 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:21.909983 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97b97e-5368-4b3b-9351-7989db602753 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:21.927074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472b723-25ab-479e-8bd4-9d51e5bfd51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:21.927759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472b723-25ab-479e-8bd4-9d51e5bfd51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:21.928039 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472b723-25ab-479e-8bd4-9d51e5bfd51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:21.928312 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472b723-25ab-479e-8bd4-9d51e5bfd51b admin admin] PATH_INFO: `/v3/projects/d2f4d44358d3464d83f0ad6ebd69a313` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:21.929574 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472b723-25ab-479e-8bd4-9d51e5bfd51b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f4d44358d3464d83f0ad6ebd69a313)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:21.931642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472b723-25ab-479e-8bd4-9d51e5bfd51b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:21.933871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 848/1680] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:21 2022] POST /identity/v3/users => generated 282 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:21.938378 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631bfdd-2ce6-4eba-9f4b-122079ad3f3b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:21.960367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631bfdd-2ce6-4eba-9f4b-122079ad3f3b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:21.978271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4e26c-7277-431b-b77b-1c99c4f520c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:21.979238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4e26c-7277-431b-b77b-1c99c4f520c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:21.979709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4e26c-7277-431b-b77b-1c99c4f520c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:21.980355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4e26c-7277-431b-b77b-1c99c4f520c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:21.981033 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4e26c-7277-431b-b77b-1c99c4f520c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:21.987239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4e26c-7277-431b-b77b-1c99c4f520c0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:22.014321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 849/1681] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:31:22.029856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4e26c-7277-431b-b77b-1c99c4f520c0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:22.060755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6472b723-25ab-479e-8bd4-9d51e5bfd51b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f4d44358d3464d83f0ad6ebd69a313', 'request_id': 'req-6472b723-25ab-479e-8bd4-9d51e5bfd51b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:22.068507 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4e26c-7277-431b-b77b-1c99c4f520c0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:22.079602 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6472b723-25ab-479e-8bd4-9d51e5bfd51b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f4d44358d3464d83f0ad6ebd69a313', 'request_id': 'req-6472b723-25ab-479e-8bd4-9d51e5bfd51b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:22.093876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6472b723-25ab-479e-8bd4-9d51e5bfd51b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f4d44358d3464d83f0ad6ebd69a313', 'request_id': 'req-6472b723-25ab-479e-8bd4-9d51e5bfd51b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:22.127737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6472b723-25ab-479e-8bd4-9d51e5bfd51b admin admin] The token cache is being invalidate because project d2f4d44358d3464d83f0ad6ebd69a313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:22.131613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6472b723-25ab-479e-8bd4-9d51e5bfd51b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:22.134350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6472b723-25ab-479e-8bd4-9d51e5bfd51b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:22.139591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 833/1682] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:21 2022] DELETE /identity/v3/projects/d2f4d44358d3464d83f0ad6ebd69a313 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:31:22.144904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472b723-25ab-479e-8bd4-9d51e5bfd51b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:22.146840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6472b723-25ab-479e-8bd4-9d51e5bfd51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:22.245107 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:22.268853 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76c922-9bce-480c-af99-8ea85c6b208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:22.270169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76c922-9bce-480c-af99-8ea85c6b208b admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:22.270644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76c922-9bce-480c-af99-8ea85c6b208b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:22.270997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76c922-9bce-480c-af99-8ea85c6b208b admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:22.274682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76c922-9bce-480c-af99-8ea85c6b208b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:22.276551 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76c922-9bce-480c-af99-8ea85c6b208b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:22.304653 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 850/1683] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:22.309567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76c922-9bce-480c-af99-8ea85c6b208b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:22.316670 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cb76c922-9bce-480c-af99-8ea85c6b208b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:22.360346 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76c922-9bce-480c-af99-8ea85c6b208b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:22.380264 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e358ad-0787-4f1a-90fd-5798fdb9cd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:22.381228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e358ad-0787-4f1a-90fd-5798fdb9cd12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:22.381599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e358ad-0787-4f1a-90fd-5798fdb9cd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:22.381943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e358ad-0787-4f1a-90fd-5798fdb9cd12 admin admin] PATH_INFO: `/v3/projects/d42d6f9eebef47fda1d04f780c5eb843/users/d9039382706d4681865feec689d648cc/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:22.389924 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472b723-25ab-479e-8bd4-9d51e5bfd51b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:22.411078 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ef28e-5318-4724-aca2-5df9dd790d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:22.412778 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef28e-5318-4724-aca2-5df9dd790d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:22.413880 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef28e-5318-4724-aca2-5df9dd790d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:22.414684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef28e-5318-4724-aca2-5df9dd790d7d admin admin] PATH_INFO: `/v3/users/8419dd602d7b4d6aacde1b93ddb1fcd0` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:22.419957 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ef28e-5318-4724-aca2-5df9dd790d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8419dd602d7b4d6aacde1b93ddb1fcd0)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:22.432102 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ef28e-5318-4724-aca2-5df9dd790d7d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:22.461971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e358ad-0787-4f1a-90fd-5798fdb9cd12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d42d6f9eebef47fda1d04f780c5eb843, user_id=d9039382706d4681865feec689d648cc, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:22.468304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e358ad-0787-4f1a-90fd-5798fdb9cd12 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:22.508380 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 851/1684] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:22 2022] PUT /identity/v3/projects/d42d6f9eebef47fda1d04f780c5eb843/users/d9039382706d4681865feec689d648cc/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:31:22.521852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2a530-89f9-46be-a90f-8e54e4fd7a69 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:22.522134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2a530-89f9-46be-a90f-8e54e4fd7a69 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:22.522557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2a530-89f9-46be-a90f-8e54e4fd7a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:22.545973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-933ef28e-5318-4724-aca2-5df9dd790d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8419dd602d7b4d6aacde1b93ddb1fcd0'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:22.571684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-933ef28e-5318-4724-aca2-5df9dd790d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8419dd602d7b4d6aacde1b93ddb1fcd0'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:22.574890 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:22.587864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-933ef28e-5318-4724-aca2-5df9dd790d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8419dd602d7b4d6aacde1b93ddb1fcd0'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:22.589113 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-933ef28e-5318-4724-aca2-5df9dd790d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8419dd602d7b4d6aacde1b93ddb1fcd0'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:22.604165 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-933ef28e-5318-4724-aca2-5df9dd790d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8419dd602d7b4d6aacde1b93ddb1fcd0'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:22.614253 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 834/1685] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:22 2022] DELETE /identity/v3/users/8419dd602d7b4d6aacde1b93ddb1fcd0 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:22.615847 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-61a2a530-89f9-46be-a90f-8e54e4fd7a69 None None] MFA Rules not processed for user `d9039382706d4681865feec689d648cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:22.618760 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-61a2a530-89f9-46be-a90f-8e54e4fd7a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:22.865066 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 852/1686] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:31:22.869676 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ef28e-5318-4724-aca2-5df9dd790d7d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:22.871231 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-933ef28e-5318-4724-aca2-5df9dd790d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:23.013768 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ef28e-5318-4724-aca2-5df9dd790d7d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:23.020758 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f9a5f-cd0c-4aa6-84f2-131ecce37d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:23.021260 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f9a5f-cd0c-4aa6-84f2-131ecce37d35 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:23.021645 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f9a5f-cd0c-4aa6-84f2-131ecce37d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:23.021964 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f9a5f-cd0c-4aa6-84f2-131ecce37d35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:23.022729 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f9a5f-cd0c-4aa6-84f2-131ecce37d35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:23.025198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f9a5f-cd0c-4aa6-84f2-131ecce37d35 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:23.073830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 835/1687] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:22 2022] POST /identity/v3/projects => generated 363 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:23.077957 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2a530-89f9-46be-a90f-8e54e4fd7a69 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:23.092338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2a530-89f9-46be-a90f-8e54e4fd7a69 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:23.189781 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444db463-3f37-42db-b4aa-8a6647b41d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:23.191611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444db463-3f37-42db-b4aa-8a6647b41d0b admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:23.192178 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444db463-3f37-42db-b4aa-8a6647b41d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:23.192870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444db463-3f37-42db-b4aa-8a6647b41d0b admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:23.194046 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444db463-3f37-42db-b4aa-8a6647b41d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:23.197416 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444db463-3f37-42db-b4aa-8a6647b41d0b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:23.232091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 853/1688] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:23 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:23.238681 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f9a5f-cd0c-4aa6-84f2-131ecce37d35 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:23.240362 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444db463-3f37-42db-b4aa-8a6647b41d0b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:23.245135 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-444db463-3f37-42db-b4aa-8a6647b41d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:23.255196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f9a5f-cd0c-4aa6-84f2-131ecce37d35 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:23.290447 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db4b82-24a3-4d58-a039-0b92b16c4b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:23.291133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db4b82-24a3-4d58-a039-0b92b16c4b4f admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:23.291411 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db4b82-24a3-4d58-a039-0b92b16c4b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:23.291686 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db4b82-24a3-4d58-a039-0b92b16c4b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:23.292433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db4b82-24a3-4d58-a039-0b92b16c4b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:23.302322 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db4b82-24a3-4d58-a039-0b92b16c4b4f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:23.302505 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444db463-3f37-42db-b4aa-8a6647b41d0b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:23.323548 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06773b63-7252-4f20-bdc4-afbb3a190d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:23.324286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06773b63-7252-4f20-bdc4-afbb3a190d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:23.324644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06773b63-7252-4f20-bdc4-afbb3a190d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:23.324986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06773b63-7252-4f20-bdc4-afbb3a190d7d admin admin] PATH_INFO: `/v3/projects/01172be82a664d0186815620e6b92769` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:23.330878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06773b63-7252-4f20-bdc4-afbb3a190d7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=01172be82a664d0186815620e6b92769)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:23.332607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06773b63-7252-4f20-bdc4-afbb3a190d7d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:23.352417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 836/1689] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:23.353300 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db4b82-24a3-4d58-a039-0b92b16c4b4f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:23.359696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-55db4b82-24a3-4d58-a039-0b92b16c4b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:23.398930 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db4b82-24a3-4d58-a039-0b92b16c4b4f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:23.412405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14595f5e-7ace-4a8b-977d-42eaa1d6172e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:23.414383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14595f5e-7ace-4a8b-977d-42eaa1d6172e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:23.414799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14595f5e-7ace-4a8b-977d-42eaa1d6172e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:23.415201 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14595f5e-7ace-4a8b-977d-42eaa1d6172e admin admin] PATH_INFO: `/v3/projects/1077a873dd7b461bbb1a2dedd13b858f` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:23.417469 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14595f5e-7ace-4a8b-977d-42eaa1d6172e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1077a873dd7b461bbb1a2dedd13b858f)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:23.420503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14595f5e-7ace-4a8b-977d-42eaa1d6172e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:23.430912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:23.471099 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-06773b63-7252-4f20-bdc4-afbb3a190d7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01172be82a664d0186815620e6b92769', 'request_id': 'req-06773b63-7252-4f20-bdc4-afbb3a190d7d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:23.500692 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-06773b63-7252-4f20-bdc4-afbb3a190d7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01172be82a664d0186815620e6b92769', 'request_id': 'req-06773b63-7252-4f20-bdc4-afbb3a190d7d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:23.519465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-06773b63-7252-4f20-bdc4-afbb3a190d7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01172be82a664d0186815620e6b92769', 'request_id': 'req-06773b63-7252-4f20-bdc4-afbb3a190d7d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:23.549634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-06773b63-7252-4f20-bdc4-afbb3a190d7d admin admin] The token cache is being invalidate because project 01172be82a664d0186815620e6b92769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:23.549943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-06773b63-7252-4f20-bdc4-afbb3a190d7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:23.551113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-06773b63-7252-4f20-bdc4-afbb3a190d7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:23.561477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 854/1690] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:23 2022] DELETE /identity/v3/projects/01172be82a664d0186815620e6b92769 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:23.561477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06773b63-7252-4f20-bdc4-afbb3a190d7d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:23.561477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-06773b63-7252-4f20-bdc4-afbb3a190d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:23.627053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-14595f5e-7ace-4a8b-977d-42eaa1d6172e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1077a873dd7b461bbb1a2dedd13b858f', 'request_id': 'req-14595f5e-7ace-4a8b-977d-42eaa1d6172e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:23.642973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-14595f5e-7ace-4a8b-977d-42eaa1d6172e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1077a873dd7b461bbb1a2dedd13b858f', 'request_id': 'req-14595f5e-7ace-4a8b-977d-42eaa1d6172e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:23.657652 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-14595f5e-7ace-4a8b-977d-42eaa1d6172e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1077a873dd7b461bbb1a2dedd13b858f', 'request_id': 'req-14595f5e-7ace-4a8b-977d-42eaa1d6172e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:23.688921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-14595f5e-7ace-4a8b-977d-42eaa1d6172e admin admin] The token cache is being invalidate because project 1077a873dd7b461bbb1a2dedd13b858f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:23.688921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-14595f5e-7ace-4a8b-977d-42eaa1d6172e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:23.689794 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-14595f5e-7ace-4a8b-977d-42eaa1d6172e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:23.695548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 837/1691] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:23 2022] DELETE /identity/v3/projects/1077a873dd7b461bbb1a2dedd13b858f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:23.695548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9aacf3-235e-454d-9abe-f16a48917e05 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:23.695548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9aacf3-235e-454d-9abe-f16a48917e05 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:23.695548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9aacf3-235e-454d-9abe-f16a48917e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:23.751266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-8a9aacf3-235e-454d-9abe-f16a48917e05 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:23.753104 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8a9aacf3-235e-454d-9abe-f16a48917e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:23.780735 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06773b63-7252-4f20-bdc4-afbb3a190d7d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:23.876856 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:23.922151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36fd2a-6a3a-4d58-9822-1ffcb614d643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:23.923065 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36fd2a-6a3a-4d58-9822-1ffcb614d643 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:23.923223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36fd2a-6a3a-4d58-9822-1ffcb614d643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:23.923474 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36fd2a-6a3a-4d58-9822-1ffcb614d643 admin admin] PATH_INFO: `/v3/projects/ee728956e88c416d812eed539af3f84f/users/0e20070b7ff94633a708a582f937f1f0/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:23.946795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 838/1692] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:23.952474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9aacf3-235e-454d-9abe-f16a48917e05 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:23.958638 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8a9aacf3-235e-454d-9abe-f16a48917e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:23.962442 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36fd2a-6a3a-4d58-9822-1ffcb614d643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee728956e88c416d812eed539af3f84f, user_id=0e20070b7ff94633a708a582f937f1f0, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:23.971766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36fd2a-6a3a-4d58-9822-1ffcb614d643 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:23.982896 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9aacf3-235e-454d-9abe-f16a48917e05 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:24.003863 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 855/1693] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:23 2022] PUT /identity/v3/projects/ee728956e88c416d812eed539af3f84f/users/0e20070b7ff94633a708a582f937f1f0/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:24.004165 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43b8b9-4eda-4bb9-8f57-100f02271f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:24.004263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d518209-a567-4a56-9c31-dde97413f6d7 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:24.004263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d518209-a567-4a56-9c31-dde97413f6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:24.004263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d518209-a567-4a56-9c31-dde97413f6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:24.004468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43b8b9-4eda-4bb9-8f57-100f02271f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:24.004993 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43b8b9-4eda-4bb9-8f57-100f02271f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:24.006045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43b8b9-4eda-4bb9-8f57-100f02271f0d admin admin] PATH_INFO: `/v3/users/a1922b54588c4e478ccbc42b7a33406d` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:24.008630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43b8b9-4eda-4bb9-8f57-100f02271f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1922b54588c4e478ccbc42b7a33406d)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:24.017538 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43b8b9-4eda-4bb9-8f57-100f02271f0d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:24.062609 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7d518209-a567-4a56-9c31-dde97413f6d7 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:24.063912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7d518209-a567-4a56-9c31-dde97413f6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:24.184157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:24.213636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 856/1694] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:24.214536 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d518209-a567-4a56-9c31-dde97413f6d7 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:24.219427 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7d518209-a567-4a56-9c31-dde97413f6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:24.220141 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2c43b8b9-4eda-4bb9-8f57-100f02271f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1922b54588c4e478ccbc42b7a33406d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:24.243338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d518209-a567-4a56-9c31-dde97413f6d7 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:24.250203 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2c43b8b9-4eda-4bb9-8f57-100f02271f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1922b54588c4e478ccbc42b7a33406d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:24.258534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f0524-d8fb-4817-8f25-9b7a87260992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:24.259185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f0524-d8fb-4817-8f25-9b7a87260992 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:24.259457 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f0524-d8fb-4817-8f25-9b7a87260992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:24.259732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f0524-d8fb-4817-8f25-9b7a87260992 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:24.260397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f0524-d8fb-4817-8f25-9b7a87260992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:24.262463 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f0524-d8fb-4817-8f25-9b7a87260992 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:24.266873 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2c43b8b9-4eda-4bb9-8f57-100f02271f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1922b54588c4e478ccbc42b7a33406d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:24.268087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2c43b8b9-4eda-4bb9-8f57-100f02271f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1922b54588c4e478ccbc42b7a33406d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:24.290331 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 857/1695] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:24.291299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f0524-d8fb-4817-8f25-9b7a87260992 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:24.295548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2c43b8b9-4eda-4bb9-8f57-100f02271f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1922b54588c4e478ccbc42b7a33406d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:24.314112 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f0524-d8fb-4817-8f25-9b7a87260992 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:24.320567 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 839/1696] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:23 2022] DELETE /identity/v3/users/a1922b54588c4e478ccbc42b7a33406d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:24.320567 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43b8b9-4eda-4bb9-8f57-100f02271f0d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:24.324126 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2c43b8b9-4eda-4bb9-8f57-100f02271f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:24.488839 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2582cd1-804b-4315-b844-fc14568daf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:24.489540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582cd1-804b-4315-b844-fc14568daf67 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:24.489829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582cd1-804b-4315-b844-fc14568daf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:24.490098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582cd1-804b-4315-b844-fc14568daf67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:24.495233 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2582cd1-804b-4315-b844-fc14568daf67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:24.495464 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2582cd1-804b-4315-b844-fc14568daf67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:24.498829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2582cd1-804b-4315-b844-fc14568daf67 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:24.552160 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 858/1697] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:24.552390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43b8b9-4eda-4bb9-8f57-100f02271f0d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:24.552652 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2582cd1-804b-4315-b844-fc14568daf67 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:24.555649 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f2582cd1-804b-4315-b844-fc14568daf67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:24.563769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cdeda-0af8-4b89-9b97-069b6baab4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:24.564630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cdeda-0af8-4b89-9b97-069b6baab4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:24.564911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cdeda-0af8-4b89-9b97-069b6baab4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:24.565188 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cdeda-0af8-4b89-9b97-069b6baab4f6 admin admin] PATH_INFO: `/v3/projects/ee728956e88c416d812eed539af3f84f/users/0e20070b7ff94633a708a582f937f1f0/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:24.573469 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cdeda-0af8-4b89-9b97-069b6baab4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee728956e88c416d812eed539af3f84f, user_id=0e20070b7ff94633a708a582f937f1f0, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:24.576633 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cdeda-0af8-4b89-9b97-069b6baab4f6 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:24.585935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2582cd1-804b-4315-b844-fc14568daf67 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:24.596895 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042a287-242d-45e1-84f2-3ded9a6bb721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:24.597588 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042a287-242d-45e1-84f2-3ded9a6bb721 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:24.598311 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042a287-242d-45e1-84f2-3ded9a6bb721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:24.598589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042a287-242d-45e1-84f2-3ded9a6bb721 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:24.599296 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042a287-242d-45e1-84f2-3ded9a6bb721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:24.602527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042a287-242d-45e1-84f2-3ded9a6bb721 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:24.617098 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 840/1698] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:24 2022] PUT /identity/v3/projects/ee728956e88c416d812eed539af3f84f/users/0e20070b7ff94633a708a582f937f1f0/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:24.627842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0395c-4fc3-490b-8e34-1fd98bef2774 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:24.627842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0395c-4fc3-490b-8e34-1fd98bef2774 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:24.627842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0395c-4fc3-490b-8e34-1fd98bef2774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:24.715824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 859/1699] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:24 2022] POST /identity/v3/projects => generated 393 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:24.716961 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042a287-242d-45e1-84f2-3ded9a6bb721 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:24.723782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-2cf0395c-4fc3-490b-8e34-1fd98bef2774 None None] MFA Rules not processed for user `0e20070b7ff94633a708a582f937f1f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:24.725163 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2cf0395c-4fc3-490b-8e34-1fd98bef2774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:24.875698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:24.945544 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042a287-242d-45e1-84f2-3ded9a6bb721 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:24.957215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd4363-ad2e-4344-b608-2efd08832430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:24.957215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd4363-ad2e-4344-b608-2efd08832430 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:24.957215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd4363-ad2e-4344-b608-2efd08832430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:24.957215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd4363-ad2e-4344-b608-2efd08832430 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:24.957876 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd4363-ad2e-4344-b608-2efd08832430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:24.957876 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd4363-ad2e-4344-b608-2efd08832430 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:24.967020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 841/1700] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:25.010158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0395c-4fc3-490b-8e34-1fd98bef2774 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:25.023507 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 860/1701] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:24 2022] POST /identity/v3/users => generated 297 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:25.028176 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0395c-4fc3-490b-8e34-1fd98bef2774 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:25.043462 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3868ad-e90a-468c-b9e4-28d77e9c7d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:25.043680 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3868ad-e90a-468c-b9e4-28d77e9c7d91 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:25.045877 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3868ad-e90a-468c-b9e4-28d77e9c7d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:25.046201 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3868ad-e90a-468c-b9e4-28d77e9c7d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:25.046942 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3868ad-e90a-468c-b9e4-28d77e9c7d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:25.059139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3868ad-e90a-468c-b9e4-28d77e9c7d91 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:25.078264 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd4363-ad2e-4344-b608-2efd08832430 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:25.085029 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a7bd4363-ad2e-4344-b608-2efd08832430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:25.129061 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 842/1702] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:25.130143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3868ad-e90a-468c-b9e4-28d77e9c7d91 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:25.171725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3868ad-e90a-468c-b9e4-28d77e9c7d91 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:25.185270 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39b52d-0fb7-4992-b884-8b6e3aefd098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:25.185935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39b52d-0fb7-4992-b884-8b6e3aefd098 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:25.186217 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39b52d-0fb7-4992-b884-8b6e3aefd098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:25.186492 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39b52d-0fb7-4992-b884-8b6e3aefd098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:25.187199 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39b52d-0fb7-4992-b884-8b6e3aefd098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:25.194790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39b52d-0fb7-4992-b884-8b6e3aefd098 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:25.229595 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 843/1703] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:25.232591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39b52d-0fb7-4992-b884-8b6e3aefd098 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:25.238095 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:25.261037 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39b52d-0fb7-4992-b884-8b6e3aefd098 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:25.265266 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd4363-ad2e-4344-b608-2efd08832430 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:25.273497 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffebca4-3577-4cd9-b735-79065b9e42ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:25.274805 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f01736-a7f7-456a-b6aa-50b3daad95ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:25.275462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f01736-a7f7-456a-b6aa-50b3daad95ad service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:25.275737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f01736-a7f7-456a-b6aa-50b3daad95ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:25.276001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f01736-a7f7-456a-b6aa-50b3daad95ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:25.276763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffebca4-3577-4cd9-b735-79065b9e42ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:25.277089 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffebca4-3577-4cd9-b735-79065b9e42ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:25.277405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffebca4-3577-4cd9-b735-79065b9e42ff admin admin] PATH_INFO: `/v3/projects/22c85428a881485eaf03584752b42594/users/17f6b1d08cc044b4a9bd7af490c336a8/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:25.298072 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f01736-a7f7-456a-b6aa-50b3daad95ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:25.301957 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f01736-a7f7-456a-b6aa-50b3daad95ad service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:25.312563 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffebca4-3577-4cd9-b735-79065b9e42ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c85428a881485eaf03584752b42594, user_id=17f6b1d08cc044b4a9bd7af490c336a8, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:25.319766 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffebca4-3577-4cd9-b735-79065b9e42ff admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:25.327763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 861/1704] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:31:25.361170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 844/1705] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:25 2022] PUT /identity/v3/projects/22c85428a881485eaf03584752b42594/users/17f6b1d08cc044b4a9bd7af490c336a8/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:25.376301 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa0782-1e17-47ad-905b-9996dfd87b19 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:25.376500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa0782-1e17-47ad-905b-9996dfd87b19 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:25.376746 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa0782-1e17-47ad-905b-9996dfd87b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:25.461998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-8ffa0782-1e17-47ad-905b-9996dfd87b19 None None] MFA Rules not processed for user `17f6b1d08cc044b4a9bd7af490c336a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:25.463328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8ffa0782-1e17-47ad-905b-9996dfd87b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:25.538286 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffebca4-3577-4cd9-b735-79065b9e42ff admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:25.707001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 862/1706] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:25.709149 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa0782-1e17-47ad-905b-9996dfd87b19 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:25.729582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffebca4-3577-4cd9-b735-79065b9e42ff admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:25.741278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359053fe-9785-4c7e-ab2a-6595e66f3010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:25.741849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359053fe-9785-4c7e-ab2a-6595e66f3010 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:25.742122 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359053fe-9785-4c7e-ab2a-6595e66f3010 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:25.742389 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359053fe-9785-4c7e-ab2a-6595e66f3010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:25.751135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-359053fe-9785-4c7e-ab2a-6595e66f3010 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:25.877661 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa0782-1e17-47ad-905b-9996dfd87b19 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:25.889645 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03fd0d-7338-405e-8b80-64fa994cdc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:25.889645 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03fd0d-7338-405e-8b80-64fa994cdc14 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:25.889645 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03fd0d-7338-405e-8b80-64fa994cdc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:25.889645 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03fd0d-7338-405e-8b80-64fa994cdc14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:25.889943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03fd0d-7338-405e-8b80-64fa994cdc14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:25.889943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03fd0d-7338-405e-8b80-64fa994cdc14 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:25.908323 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359053fe-9785-4c7e-ab2a-6595e66f3010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:25.910310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359053fe-9785-4c7e-ab2a-6595e66f3010 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:25.933087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 845/1707] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:31:25.936608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d4f78-a181-4cb5-87d9-1d98b35af995 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:25.936927 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d4f78-a181-4cb5-87d9-1d98b35af995 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:25.937195 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d4f78-a181-4cb5-87d9-1d98b35af995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:25.961115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 863/1708] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:25 2022] POST /identity/v3/projects => generated 393 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:25.962308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03fd0d-7338-405e-8b80-64fa994cdc14 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:26.037638 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6e8d4f78-a181-4cb5-87d9-1d98b35af995 None None] MFA Rules not processed for user `46da39cde1ca40c7a84bb457f0e3bf77`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:26.039889 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6e8d4f78-a181-4cb5-87d9-1d98b35af995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:26.080255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03fd0d-7338-405e-8b80-64fa994cdc14 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:26.089591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047895b-d873-4cb6-8bc1-8817b605c172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:26.090232 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047895b-d873-4cb6-8bc1-8817b605c172 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:26.090514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047895b-d873-4cb6-8bc1-8817b605c172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:26.090956 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047895b-d873-4cb6-8bc1-8817b605c172 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:26.091892 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047895b-d873-4cb6-8bc1-8817b605c172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:26.094238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047895b-d873-4cb6-8bc1-8817b605c172 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:26.106986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:26.126050 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:26.139792 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 864/1709] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:25 2022] POST /identity/v3/users => generated 303 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:26.139792 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047895b-d873-4cb6-8bc1-8817b605c172 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:26.148295 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c047895b-d873-4cb6-8bc1-8817b605c172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:26.174385 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047895b-d873-4cb6-8bc1-8817b605c172 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:26.190896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922b126-9db9-4be6-8259-a7609a5c2025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:26.191906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922b126-9db9-4be6-8259-a7609a5c2025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:26.198860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922b126-9db9-4be6-8259-a7609a5c2025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:26.199432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922b126-9db9-4be6-8259-a7609a5c2025 admin admin] PATH_INFO: `/v3/projects/e0e9e553da794c8c809bb8b5aada359b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:26.201386 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922b126-9db9-4be6-8259-a7609a5c2025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0e9e553da794c8c809bb8b5aada359b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:26.207100 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922b126-9db9-4be6-8259-a7609a5c2025 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:26.225789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 846/1710] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:26.230665 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d4f78-a181-4cb5-87d9-1d98b35af995 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:26.278560 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d4f78-a181-4cb5-87d9-1d98b35af995 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:26.304521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ec637-5e90-4ece-b83e-120a7bc2689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:26.309174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ec637-5e90-4ece-b83e-120a7bc2689a admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:26.309606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ec637-5e90-4ece-b83e-120a7bc2689a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:26.310006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ec637-5e90-4ece-b83e-120a7bc2689a admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:26.310837 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ec637-5e90-4ece-b83e-120a7bc2689a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:26.313724 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ec637-5e90-4ece-b83e-120a7bc2689a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:26.360588 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 847/1711] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:26.365429 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa206b0-d71d-43ff-aa17-dd0b6e42d1e2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:26.365870 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa206b0-d71d-43ff-aa17-dd0b6e42d1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:26.366351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa206b0-d71d-43ff-aa17-dd0b6e42d1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:26.392874 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f922b126-9db9-4be6-8259-a7609a5c2025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0e9e553da794c8c809bb8b5aada359b', 'request_id': 'req-f922b126-9db9-4be6-8259-a7609a5c2025'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:26.413725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f922b126-9db9-4be6-8259-a7609a5c2025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0e9e553da794c8c809bb8b5aada359b', 'request_id': 'req-f922b126-9db9-4be6-8259-a7609a5c2025'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:26.418991 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3aa206b0-d71d-43ff-aa17-dd0b6e42d1e2 None None] MFA Rules not processed for user `46da39cde1ca40c7a84bb457f0e3bf77`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:26.421236 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3aa206b0-d71d-43ff-aa17-dd0b6e42d1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:26.430583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f922b126-9db9-4be6-8259-a7609a5c2025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0e9e553da794c8c809bb8b5aada359b', 'request_id': 'req-f922b126-9db9-4be6-8259-a7609a5c2025'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:26.446923 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f922b126-9db9-4be6-8259-a7609a5c2025 admin admin] The token cache is being invalidate because project e0e9e553da794c8c809bb8b5aada359b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:26.447372 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f922b126-9db9-4be6-8259-a7609a5c2025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:26.448317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f922b126-9db9-4be6-8259-a7609a5c2025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:26.451202 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 865/1712] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:26 2022] DELETE /identity/v3/projects/e0e9e553da794c8c809bb8b5aada359b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:26.456497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922b126-9db9-4be6-8259-a7609a5c2025 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:26.458351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f922b126-9db9-4be6-8259-a7609a5c2025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:26.515822 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 848/1713] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:26.522511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9ef17-3f3e-4f70-90f4-cdefbc8bc0a5 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:26.523213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9ef17-3f3e-4f70-90f4-cdefbc8bc0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:26.523667 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9ef17-3f3e-4f70-90f4-cdefbc8bc0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:26.554700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-dbc9ef17-3f3e-4f70-90f4-cdefbc8bc0a5 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:26.557101 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-dbc9ef17-3f3e-4f70-90f4-cdefbc8bc0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:26.581196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922b126-9db9-4be6-8259-a7609a5c2025 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:26.585562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 849/1714] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:26.588208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9ef17-3f3e-4f70-90f4-cdefbc8bc0a5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:26.592518 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-dbc9ef17-3f3e-4f70-90f4-cdefbc8bc0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:26.598594 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bf4eb-d2da-440a-b045-bdc7f6d0e045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:26.599531 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bf4eb-d2da-440a-b045-bdc7f6d0e045 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:26.599884 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bf4eb-d2da-440a-b045-bdc7f6d0e045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:26.600232 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bf4eb-d2da-440a-b045-bdc7f6d0e045 admin admin] PATH_INFO: `/v3/projects/3080e5d2475b4507af5081808d839c2d/users/21a164cf8cf04a35902771036a2d376f/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:26.619145 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bf4eb-d2da-440a-b045-bdc7f6d0e045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3080e5d2475b4507af5081808d839c2d, user_id=21a164cf8cf04a35902771036a2d376f, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:26.623506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bf4eb-d2da-440a-b045-bdc7f6d0e045 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:26.652528 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 866/1715] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:26 2022] PUT /identity/v3/projects/3080e5d2475b4507af5081808d839c2d/users/21a164cf8cf04a35902771036a2d376f/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:26.659065 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461678d-e38c-4a32-9755-52d8affd0a18 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:26.659351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461678d-e38c-4a32-9755-52d8affd0a18 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:26.660661 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461678d-e38c-4a32-9755-52d8affd0a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:26.713648 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e461678d-e38c-4a32-9755-52d8affd0a18 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:26.718042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e461678d-e38c-4a32-9755-52d8affd0a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:26.806818 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9ef17-3f3e-4f70-90f4-cdefbc8bc0a5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:26.848390 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:26.876788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 867/1716] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:26.877292 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461678d-e38c-4a32-9755-52d8affd0a18 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:26.895707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461678d-e38c-4a32-9755-52d8affd0a18 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:26.911889 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866ffea-67c6-450f-aef9-717ae08aecc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:26.912543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866ffea-67c6-450f-aef9-717ae08aecc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:26.912816 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866ffea-67c6-450f-aef9-717ae08aecc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:26.913092 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866ffea-67c6-450f-aef9-717ae08aecc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:26.913797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866ffea-67c6-450f-aef9-717ae08aecc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:26.915682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866ffea-67c6-450f-aef9-717ae08aecc1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:26.947242 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:26.951473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 868/1717] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:26.962220 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866ffea-67c6-450f-aef9-717ae08aecc1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:26.971585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e66192-dcf4-4038-9c1d-b26e264e7910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:26.972238 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e66192-dcf4-4038-9c1d-b26e264e7910 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:26.972630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e66192-dcf4-4038-9c1d-b26e264e7910 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:26.973015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e66192-dcf4-4038-9c1d-b26e264e7910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:26.975848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-52e66192-dcf4-4038-9c1d-b26e264e7910 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:27.000589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866ffea-67c6-450f-aef9-717ae08aecc1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:27.005548 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb43f42-0584-433f-8169-6e9f19320232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:27.006238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb43f42-0584-433f-8169-6e9f19320232 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:27.006496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb43f42-0584-433f-8169-6e9f19320232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:27.006757 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb43f42-0584-433f-8169-6e9f19320232 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:27.007530 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb43f42-0584-433f-8169-6e9f19320232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:27.008391 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb43f42-0584-433f-8169-6e9f19320232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:27.010123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb43f42-0584-433f-8169-6e9f19320232 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:27.041308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 869/1718] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:27.042288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb43f42-0584-433f-8169-6e9f19320232 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:27.064884 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb43f42-0584-433f-8169-6e9f19320232 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:27.071723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b78d8-e080-4266-bbc7-95927dbd3ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:27.072458 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b78d8-e080-4266-bbc7-95927dbd3ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:27.072740 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b78d8-e080-4266-bbc7-95927dbd3ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:27.073083 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b78d8-e080-4266-bbc7-95927dbd3ed3 admin admin] PATH_INFO: `/v3/projects/3080e5d2475b4507af5081808d839c2d/users/21a164cf8cf04a35902771036a2d376f/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:27.083685 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b78d8-e080-4266-bbc7-95927dbd3ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3080e5d2475b4507af5081808d839c2d, user_id=21a164cf8cf04a35902771036a2d376f, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:27.086512 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b78d8-e080-4266-bbc7-95927dbd3ed3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:27.150422 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 870/1719] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:27 2022] PUT /identity/v3/projects/3080e5d2475b4507af5081808d839c2d/users/21a164cf8cf04a35902771036a2d376f/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:27.151458 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b78d8-e080-4266-bbc7-95927dbd3ed3 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:27.174709 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e66192-dcf4-4038-9c1d-b26e264e7910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:27.183519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e66192-dcf4-4038-9c1d-b26e264e7910 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:27.215766 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 850/1720] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:27.220450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53f49a-aade-4539-bfae-a3e7faba74ce None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:27.220925 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53f49a-aade-4539-bfae-a3e7faba74ce None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:27.223248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53f49a-aade-4539-bfae-a3e7faba74ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:27.332864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-0d53f49a-aade-4539-bfae-a3e7faba74ce None None] MFA Rules not processed for user `21a164cf8cf04a35902771036a2d376f`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:27.339300 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0d53f49a-aade-4539-bfae-a3e7faba74ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:27.358261 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b78d8-e080-4266-bbc7-95927dbd3ed3 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:27.378842 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c088825-16de-4a8a-aa58-736014b85aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:27.379473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c088825-16de-4a8a-aa58-736014b85aad admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:27.389959 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c088825-16de-4a8a-aa58-736014b85aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:27.390317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c088825-16de-4a8a-aa58-736014b85aad admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:27.406210 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c088825-16de-4a8a-aa58-736014b85aad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:27.410344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c088825-16de-4a8a-aa58-736014b85aad admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:27.536784 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 871/1721] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:27 2022] POST /identity/v3/projects => generated 381 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:27.554485 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c088825-16de-4a8a-aa58-736014b85aad admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:27.612274 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 851/1722] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:27.621606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a2af1-1ed9-4992-84e1-6f84283319fd None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:27.621898 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a2af1-1ed9-4992-84e1-6f84283319fd None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:27.622174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a2af1-1ed9-4992-84e1-6f84283319fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:27.753718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-cb4a2af1-1ed9-4992-84e1-6f84283319fd None None] MFA Rules not processed for user `2965ddfda61d4ba88eb46c48ab5b1f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:27.755018 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-cb4a2af1-1ed9-4992-84e1-6f84283319fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:27.791551 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c088825-16de-4a8a-aa58-736014b85aad admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:27.815999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98fe3a-f1a4-47b8-8f27-31183674980e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:27.816828 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98fe3a-f1a4-47b8-8f27-31183674980e admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:27.817225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98fe3a-f1a4-47b8-8f27-31183674980e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:27.817747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98fe3a-f1a4-47b8-8f27-31183674980e admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:27.818607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98fe3a-f1a4-47b8-8f27-31183674980e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:27.820725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98fe3a-f1a4-47b8-8f27-31183674980e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:27.895674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 872/1723] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:27 2022] POST /identity/v3/users => generated 291 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:27.903572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98fe3a-f1a4-47b8-8f27-31183674980e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:27.915771 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4e98fe3a-f1a4-47b8-8f27-31183674980e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:27.939610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 852/1724] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:31:27.940362 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a2af1-1ed9-4992-84e1-6f84283319fd None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:27.974002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a2af1-1ed9-4992-84e1-6f84283319fd None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:28.002265 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f831594-d813-48fe-b35f-e4bc02543e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:28.002903 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f831594-d813-48fe-b35f-e4bc02543e78 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:28.003707 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f831594-d813-48fe-b35f-e4bc02543e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:28.003707 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f831594-d813-48fe-b35f-e4bc02543e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:28.004456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f831594-d813-48fe-b35f-e4bc02543e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:28.006010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f831594-d813-48fe-b35f-e4bc02543e78 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:28.010217 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:28.045052 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 853/1725] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:28.047074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24340755-d795-4537-90eb-06dfdf31e4e3 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:28.047433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24340755-d795-4537-90eb-06dfdf31e4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:28.047870 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24340755-d795-4537-90eb-06dfdf31e4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:28.060476 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:28.139395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-24340755-d795-4537-90eb-06dfdf31e4e3 None None] MFA Rules not processed for user `2965ddfda61d4ba88eb46c48ab5b1f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:28.140752 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98fe3a-f1a4-47b8-8f27-31183674980e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:28.143771 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-24340755-d795-4537-90eb-06dfdf31e4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:28.159924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfaaf83-1e08-4ba5-b934-ac4d1d54f7df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:28.162269 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaaf83-1e08-4ba5-b934-ac4d1d54f7df service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:28.164771 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaaf83-1e08-4ba5-b934-ac4d1d54f7df service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:28.165112 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaaf83-1e08-4ba5-b934-ac4d1d54f7df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:28.169049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 854/1726] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:28.170358 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24340755-d795-4537-90eb-06dfdf31e4e3 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:28.226810 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24340755-d795-4537-90eb-06dfdf31e4e3 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:28.235350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfae012-b95b-48b0-983f-258ad68c08d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:28.235996 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfae012-b95b-48b0-983f-258ad68c08d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:28.236442 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfae012-b95b-48b0-983f-258ad68c08d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:28.236729 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfae012-b95b-48b0-983f-258ad68c08d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:28.237467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfae012-b95b-48b0-983f-258ad68c08d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:28.239237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfae012-b95b-48b0-983f-258ad68c08d5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:28.288941 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 855/1727] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:28.291512 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfae012-b95b-48b0-983f-258ad68c08d5 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:28.310042 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0dfae012-b95b-48b0-983f-258ad68c08d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:28.401023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfaaf83-1e08-4ba5-b934-ac4d1d54f7df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:28.405918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfaaf83-1e08-4ba5-b934-ac4d1d54f7df service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:28.457157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 873/1728] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:27 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:28.458372 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfaaf83-1e08-4ba5-b934-ac4d1d54f7df service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:28.498824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfaaf83-1e08-4ba5-b934-ac4d1d54f7df service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:28.537547 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9174f-af15-4894-87e0-7657ac0c78c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:28.560006 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9174f-af15-4894-87e0-7657ac0c78c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:28.560646 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9174f-af15-4894-87e0-7657ac0c78c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:28.561444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9174f-af15-4894-87e0-7657ac0c78c8 admin admin] PATH_INFO: `/v3/projects/aaf88a26b0d4405f9490d9f1ecfd2750/users/0035e5e55a144df9b7567cfbc16d1a81/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:28.591654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9174f-af15-4894-87e0-7657ac0c78c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf88a26b0d4405f9490d9f1ecfd2750, user_id=0035e5e55a144df9b7567cfbc16d1a81, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:28.595767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9174f-af15-4894-87e0-7657ac0c78c8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:28.641446 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 874/1729] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:28 2022] PUT /identity/v3/projects/aaf88a26b0d4405f9490d9f1ecfd2750/users/0035e5e55a144df9b7567cfbc16d1a81/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:28.646127 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e1711-362e-4934-9da5-ac2f7d9f6e48 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:28.646636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e1711-362e-4934-9da5-ac2f7d9f6e48 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:28.647029 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e1711-362e-4934-9da5-ac2f7d9f6e48 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:28.650149 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 875/1730] 10.222.0.52 () {54 vars in 912 bytes} [Mon Aug 29 20:31:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:28.658292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfae012-b95b-48b0-983f-258ad68c08d5 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:28.659550 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ec5cc-15a3-4da6-a820-0741600e23ba None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:28.659981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ec5cc-15a3-4da6-a820-0741600e23ba None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:28.660377 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ec5cc-15a3-4da6-a820-0741600e23ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:28.751542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-791ec5cc-15a3-4da6-a820-0741600e23ba None None] MFA Rules not processed for user `0035e5e55a144df9b7567cfbc16d1a81`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:28.754059 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-791ec5cc-15a3-4da6-a820-0741600e23ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:28.909729 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc768f6b-d45b-4f9a-ad30-baaf83405751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:28.910506 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc768f6b-d45b-4f9a-ad30-baaf83405751 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:28.911062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc768f6b-d45b-4f9a-ad30-baaf83405751 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:28.911471 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc768f6b-d45b-4f9a-ad30-baaf83405751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:29.022574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 876/1731] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:29.027241 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe7ba2-0d0f-4a01-b943-60484cec1177 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:29.028087 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe7ba2-0d0f-4a01-b943-60484cec1177 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:29.031093 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe7ba2-0d0f-4a01-b943-60484cec1177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:29.163186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc768f6b-d45b-4f9a-ad30-baaf83405751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:29.165066 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-34fe7ba2-0d0f-4a01-b943-60484cec1177 None None] MFA Rules not processed for user `382b0ee3bd634cc8800f1769c91b7a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:29.166428 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-34fe7ba2-0d0f-4a01-b943-60484cec1177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:29.168462 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc768f6b-d45b-4f9a-ad30-baaf83405751 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:29.206801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 856/1732] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 917 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:29.209331 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc768f6b-d45b-4f9a-ad30-baaf83405751 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:29.262686 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:29.262884 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:29.323501 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 877/1733] 10.222.0.52 () {58 vars in 1009 bytes} [Mon Aug 29 20:31:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:29.324838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe7ba2-0d0f-4a01-b943-60484cec1177 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:29.369380 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc768f6b-d45b-4f9a-ad30-baaf83405751 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:29.381815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca6584-5018-4f20-95c9-c8a750b399ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:29.383031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca6584-5018-4f20-95c9-c8a750b399ce service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:29.383580 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca6584-5018-4f20-95c9-c8a750b399ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:29.384049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca6584-5018-4f20-95c9-c8a750b399ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:29.389034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-feca6584-5018-4f20-95c9-c8a750b399ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:29.511318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe7ba2-0d0f-4a01-b943-60484cec1177 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:29.530713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce11cc-9372-4d33-9aca-52a1d0baccde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:29.531661 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce11cc-9372-4d33-9aca-52a1d0baccde admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:29.532501 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce11cc-9372-4d33-9aca-52a1d0baccde admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:29.532894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce11cc-9372-4d33-9aca-52a1d0baccde admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:29.534960 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce11cc-9372-4d33-9aca-52a1d0baccde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:29.542193 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce11cc-9372-4d33-9aca-52a1d0baccde admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:29.552163 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca6584-5018-4f20-95c9-c8a750b399ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:29.556813 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca6584-5018-4f20-95c9-c8a750b399ce service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:29.582731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 857/1734] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:29.584623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca6584-5018-4f20-95c9-c8a750b399ce service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:29.586669 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-feca6584-5018-4f20-95c9-c8a750b399ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:29.605483 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca6584-5018-4f20-95c9-c8a750b399ce service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:29.619232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ba58b-d570-48c2-ae97-ae691e711f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:29.619928 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ba58b-d570-48c2-ae97-ae691e711f4b service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:29.621440 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ba58b-d570-48c2-ae97-ae691e711f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:29.622143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ba58b-d570-48c2-ae97-ae691e711f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:29.643575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ba58b-d570-48c2-ae97-ae691e711f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:29.646287 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ba58b-d570-48c2-ae97-ae691e711f4b service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:29.652608 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 878/1735] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:29 2022] POST /identity/v3/projects => generated 381 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:29.658912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce11cc-9372-4d33-9aca-52a1d0baccde admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:29.672948 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 858/1736] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:29.986680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce11cc-9372-4d33-9aca-52a1d0baccde admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:30.030413 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf089e37-6002-4852-9bb5-2beb776d881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:30.039733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf089e37-6002-4852-9bb5-2beb776d881e admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:30.040672 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf089e37-6002-4852-9bb5-2beb776d881e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:30.044387 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf089e37-6002-4852-9bb5-2beb776d881e admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:30.046616 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf089e37-6002-4852-9bb5-2beb776d881e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:30.075191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf089e37-6002-4852-9bb5-2beb776d881e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:30.220238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 879/1737] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:29 2022] POST /identity/v3/users => generated 297 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:30.224823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ba58b-d570-48c2-ae97-ae691e711f4b service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:30.311549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ba58b-d570-48c2-ae97-ae691e711f4b service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:30.361349 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260ed5b-9af7-4ecd-b468-541ccded0ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:30.361988 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260ed5b-9af7-4ecd-b468-541ccded0ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:30.362268 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260ed5b-9af7-4ecd-b468-541ccded0ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:30.362538 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260ed5b-9af7-4ecd-b468-541ccded0ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:30.363260 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260ed5b-9af7-4ecd-b468-541ccded0ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:30.379440 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260ed5b-9af7-4ecd-b468-541ccded0ef9 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:30.431831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 859/1738] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:30.432784 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf089e37-6002-4852-9bb5-2beb776d881e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:30.448026 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf089e37-6002-4852-9bb5-2beb776d881e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:30.462124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869a90a-ad5a-4ca0-9fae-3eebcbe728b2 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:30.462473 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869a90a-ad5a-4ca0-9fae-3eebcbe728b2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:30.462805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869a90a-ad5a-4ca0-9fae-3eebcbe728b2 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:30.464687 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 860/1739] 10.222.0.52 () {54 vars in 912 bytes} [Mon Aug 29 20:31:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:30.475547 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49db00-7a38-4ce1-bf09-1b195f4efb28 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:30.475547 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49db00-7a38-4ce1-bf09-1b195f4efb28 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:30.476346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49db00-7a38-4ce1-bf09-1b195f4efb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:30.483021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3930b-9458-481e-a175-7992acec0c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:30.486048 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3930b-9458-481e-a175-7992acec0c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:30.486343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3930b-9458-481e-a175-7992acec0c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:30.486631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3930b-9458-481e-a175-7992acec0c17 admin admin] PATH_INFO: `/v3/projects/2e4eea46d3dc4c548790183411869de5/users/3d13bfd12c1142969ce6d393fc160654/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:30.533258 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7a49db00-7a38-4ce1-bf09-1b195f4efb28 None None] MFA Rules not processed for user `382b0ee3bd634cc8800f1769c91b7a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:30.536442 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7a49db00-7a38-4ce1-bf09-1b195f4efb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:30.590323 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3930b-9458-481e-a175-7992acec0c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e4eea46d3dc4c548790183411869de5, user_id=3d13bfd12c1142969ce6d393fc160654, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:30.600648 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3930b-9458-481e-a175-7992acec0c17 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:30.656926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 880/1740] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:30 2022] PUT /identity/v3/projects/2e4eea46d3dc4c548790183411869de5/users/3d13bfd12c1142969ce6d393fc160654/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:31:30.657239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3930b-9458-481e-a175-7992acec0c17 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:30.733100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 861/1741] 10.222.0.52 () {58 vars in 1009 bytes} [Mon Aug 29 20:31:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:30.840099 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:30.902118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49db00-7a38-4ce1-bf09-1b195f4efb28 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:30.921987 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49db00-7a38-4ce1-bf09-1b195f4efb28 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:30.930003 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3930b-9458-481e-a175-7992acec0c17 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:30.945164 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf16d8-6a8b-4e7c-b851-86fd2e045a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:30.951822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf16d8-6a8b-4e7c-b851-86fd2e045a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:30.952122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf16d8-6a8b-4e7c-b851-86fd2e045a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:30.955457 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf16d8-6a8b-4e7c-b851-86fd2e045a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:30.957435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf16d8-6a8b-4e7c-b851-86fd2e045a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:30.961686 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf16d8-6a8b-4e7c-b851-86fd2e045a2c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:31.014874 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 881/1742] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:31.015960 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf16d8-6a8b-4e7c-b851-86fd2e045a2c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:31.040263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf16d8-6a8b-4e7c-b851-86fd2e045a2c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:31.045640 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a07b2-bf74-44a2-89cf-d55030521731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:31.049466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a07b2-bf74-44a2-89cf-d55030521731 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:31.050583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a07b2-bf74-44a2-89cf-d55030521731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:31.051024 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a07b2-bf74-44a2-89cf-d55030521731 admin admin] PATH_INFO: `/v3/projects/2e4eea46d3dc4c548790183411869de5/users/3d13bfd12c1142969ce6d393fc160654/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:31.062548 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a07b2-bf74-44a2-89cf-d55030521731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e4eea46d3dc4c548790183411869de5, user_id=3d13bfd12c1142969ce6d393fc160654, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:31.069133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a07b2-bf74-44a2-89cf-d55030521731 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:31.125789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 882/1743] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:31 2022] PUT /identity/v3/projects/2e4eea46d3dc4c548790183411869de5/users/3d13bfd12c1142969ce6d393fc160654/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:31.138982 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f35a8-cd63-4701-bb27-9df5d16c1f2f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:31.139511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f35a8-cd63-4701-bb27-9df5d16c1f2f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:31.139941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f35a8-cd63-4701-bb27-9df5d16c1f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:31.144511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452d221-5ae1-42ad-9f5d-344476ac5088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:31.145328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452d221-5ae1-42ad-9f5d-344476ac5088 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:31.145805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452d221-5ae1-42ad-9f5d-344476ac5088 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:31.146332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452d221-5ae1-42ad-9f5d-344476ac5088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:31.169686 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452d221-5ae1-42ad-9f5d-344476ac5088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:31.171796 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452d221-5ae1-42ad-9f5d-344476ac5088 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:31.183664 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:31.204748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 862/1744] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:31:31.207896 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f9b81-5a06-4f39-a951-768ea8074c66 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:31.208188 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f9b81-5a06-4f39-a951-768ea8074c66 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:31.211046 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f9b81-5a06-4f39-a951-768ea8074c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:31.222000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1b7f35a8-cd63-4701-bb27-9df5d16c1f2f None None] MFA Rules not processed for user `960befc2f96b4565b9a99026d906f3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:31.225521 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1b7f35a8-cd63-4701-bb27-9df5d16c1f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:31.318298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-624f9b81-5a06-4f39-a951-768ea8074c66 None None] MFA Rules not processed for user `3d13bfd12c1142969ce6d393fc160654`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:31.325026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-624f9b81-5a06-4f39-a951-768ea8074c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:31.527205 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 883/1745] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:31.527916 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 863/1746] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:31.541460 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f35a8-cd63-4701-bb27-9df5d16c1f2f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:31.543964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1b7f35a8-cd63-4701-bb27-9df5d16c1f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:31.656152 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f9b81-5a06-4f39-a951-768ea8074c66 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:31.704952 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f35a8-cd63-4701-bb27-9df5d16c1f2f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:31.711086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd8ed4-1391-44fd-939c-9be4937c9fba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8295272eec349f8aa38e44c861faa47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:31.711767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd8ed4-1391-44fd-939c-9be4937c9fba service placement] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:31.712107 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd8ed4-1391-44fd-939c-9be4937c9fba service placement] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:31.712481 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd8ed4-1391-44fd-939c-9be4937c9fba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:31.715346 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-53cd8ed4-1391-44fd-939c-9be4937c9fba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:31.734905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd8ed4-1391-44fd-939c-9be4937c9fba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:31.736797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd8ed4-1391-44fd-939c-9be4937c9fba service placement] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:31.765471 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 884/1747] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:31.789231 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f9b81-5a06-4f39-a951-768ea8074c66 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:31.802600 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190516e-2c73-4d8c-8e39-354924d87e25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:31.803633 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190516e-2c73-4d8c-8e39-354924d87e25 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:31.804119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190516e-2c73-4d8c-8e39-354924d87e25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:31.805143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190516e-2c73-4d8c-8e39-354924d87e25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:31.831441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190516e-2c73-4d8c-8e39-354924d87e25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:31.834292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190516e-2c73-4d8c-8e39-354924d87e25 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:31.856549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 864/1748] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:31:31.986483 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190516e-2c73-4d8c-8e39-354924d87e25 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:31.987550 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3e8ac-3a29-4a8e-bf46-d81c06bb2724 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:31.987856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3e8ac-3a29-4a8e-bf46-d81c06bb2724 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:31.988122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3e8ac-3a29-4a8e-bf46-d81c06bb2724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:32.083718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-36d3e8ac-3a29-4a8e-bf46-d81c06bb2724 None None] MFA Rules not processed for user `46da39cde1ca40c7a84bb457f0e3bf77`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:32.092000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-36d3e8ac-3a29-4a8e-bf46-d81c06bb2724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:32.222301 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:32.278320 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 885/1749] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:32.341721 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190516e-2c73-4d8c-8e39-354924d87e25 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:32.356825 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f151c86-c684-4ad2-a753-b6fa2908020e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:32.358730 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f151c86-c684-4ad2-a753-b6fa2908020e service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:32.359018 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f151c86-c684-4ad2-a753-b6fa2908020e service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:32.359292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f151c86-c684-4ad2-a753-b6fa2908020e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:32.394016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f151c86-c684-4ad2-a753-b6fa2908020e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:32.395750 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f151c86-c684-4ad2-a753-b6fa2908020e service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:32.470807 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 865/1750] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:33.907279 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3e8ac-3a29-4a8e-bf46-d81c06bb2724 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:33.952763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3e8ac-3a29-4a8e-bf46-d81c06bb2724 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:33.985074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35c75a-9635-4552-ae62-60eadd09cacd tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d13bfd12c1142969ce6d393fc160654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4eea46d3dc4c548790183411869de5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:33.987743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35c75a-9635-4552-ae62-60eadd09cacd tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:33.988499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35c75a-9635-4552-ae62-60eadd09cacd tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:33.994212 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35c75a-9635-4552-ae62-60eadd09cacd tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:33.995728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35c75a-9635-4552-ae62-60eadd09cacd tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:33.996454 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35c75a-9635-4552-ae62-60eadd09cacd tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:34.000498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35c75a-9635-4552-ae62-60eadd09cacd tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:34.053813 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f151c86-c684-4ad2-a753-b6fa2908020e service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:34.054739 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 886/1751] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:34.091485 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f151c86-c684-4ad2-a753-b6fa2908020e service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:34.103438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61e865-2df6-4512-9fc3-84f1cff3fe90 tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d13bfd12c1142969ce6d393fc160654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4eea46d3dc4c548790183411869de5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:34.106036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61e865-2df6-4512-9fc3-84f1cff3fe90 tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:34.110062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61e865-2df6-4512-9fc3-84f1cff3fe90 tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:34.110556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61e865-2df6-4512-9fc3-84f1cff3fe90 tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:34.111998 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61e865-2df6-4512-9fc3-84f1cff3fe90 tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:34.114893 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61e865-2df6-4512-9fc3-84f1cff3fe90 tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:34.136117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:34.194390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 866/1752] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:34 2022] POST /identity/v3/projects => generated 353 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:34.197953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35c75a-9635-4552-ae62-60eadd09cacd tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:34.226436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35c75a-9635-4552-ae62-60eadd09cacd tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:34.502893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690a174-021b-429b-8722-a5cb25a20048 tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d13bfd12c1142969ce6d393fc160654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4eea46d3dc4c548790183411869de5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:34.503621 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a174-021b-429b-8722-a5cb25a20048 tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:34.503885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a174-021b-429b-8722-a5cb25a20048 tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:34.504163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a174-021b-429b-8722-a5cb25a20048 tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:34.504869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690a174-021b-429b-8722-a5cb25a20048 tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:34.513618 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690a174-021b-429b-8722-a5cb25a20048 tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:34.515284 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690a174-021b-429b-8722-a5cb25a20048 tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:34.574230 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 887/1753] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:35.170521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61e865-2df6-4512-9fc3-84f1cff3fe90 tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:35.218927 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61e865-2df6-4512-9fc3-84f1cff3fe90 tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:35.244985 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890ee43-51ae-4358-a616-d4192165cafb tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d13bfd12c1142969ce6d393fc160654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e4eea46d3dc4c548790183411869de5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:35.247392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890ee43-51ae-4358-a616-d4192165cafb tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:35.248428 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890ee43-51ae-4358-a616-d4192165cafb tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:35.248864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890ee43-51ae-4358-a616-d4192165cafb tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] PATH_INFO: `/v3/projects/4b33862e7d374e218365f9afeea91f7c` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:35.258143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890ee43-51ae-4358-a616-d4192165cafb tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4b33862e7d374e218365f9afeea91f7c)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:35.260676 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890ee43-51ae-4358-a616-d4192165cafb tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:35.533861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3890ee43-51ae-4358-a616-d4192165cafb tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b33862e7d374e218365f9afeea91f7c', 'request_id': 'req-3890ee43-51ae-4358-a616-d4192165cafb'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:35.557594 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3890ee43-51ae-4358-a616-d4192165cafb tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b33862e7d374e218365f9afeea91f7c', 'request_id': 'req-3890ee43-51ae-4358-a616-d4192165cafb'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:35.595738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3890ee43-51ae-4358-a616-d4192165cafb tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b33862e7d374e218365f9afeea91f7c', 'request_id': 'req-3890ee43-51ae-4358-a616-d4192165cafb'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:35.671319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3890ee43-51ae-4358-a616-d4192165cafb tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] The token cache is being invalidate because project 4b33862e7d374e218365f9afeea91f7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:35.671998 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3890ee43-51ae-4358-a616-d4192165cafb tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:35.677861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3890ee43-51ae-4358-a616-d4192165cafb tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:35.683354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 867/1754] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:35 2022] DELETE /identity/v3/projects/4b33862e7d374e218365f9afeea91f7c => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:37.005505 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce9f55-1b15-497c-8988-76553efe1665 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:37.006582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce9f55-1b15-497c-8988-76553efe1665 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:37.007050 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce9f55-1b15-497c-8988-76553efe1665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:37.149309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890ee43-51ae-4358-a616-d4192165cafb tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:37.151020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3890ee43-51ae-4358-a616-d4192165cafb tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:37.179492 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-edce9f55-1b15-497c-8988-76553efe1665 None None] MFA Rules not processed for user `0327aa38835f41a7a82802f9cad2e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:37.185034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-edce9f55-1b15-497c-8988-76553efe1665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:37.430215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890ee43-51ae-4358-a616-d4192165cafb tempest-VolumeQuotaClassesTest-1184920231 tempest-VolumeQuotaClassesTest-1184920231-project-admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:37.440078 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ae5b0-6f0f-40dc-9bf0-82d2ed37c054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:37.441041 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ae5b0-6f0f-40dc-9bf0-82d2ed37c054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:37.441544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ae5b0-6f0f-40dc-9bf0-82d2ed37c054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:37.442082 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ae5b0-6f0f-40dc-9bf0-82d2ed37c054 admin admin] PATH_INFO: `/v3/users/0035e5e55a144df9b7567cfbc16d1a81` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:37.444011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ae5b0-6f0f-40dc-9bf0-82d2ed37c054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0035e5e55a144df9b7567cfbc16d1a81)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:37.446345 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ae5b0-6f0f-40dc-9bf0-82d2ed37c054 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:37.529605 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 888/1755] 10.222.0.52 () {58 vars in 1009 bytes} [Mon Aug 29 20:31:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:31:37.597500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1f5ae5b0-6f0f-40dc-9bf0-82d2ed37c054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0035e5e55a144df9b7567cfbc16d1a81'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:37.670588 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1f5ae5b0-6f0f-40dc-9bf0-82d2ed37c054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0035e5e55a144df9b7567cfbc16d1a81'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:37.708015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1f5ae5b0-6f0f-40dc-9bf0-82d2ed37c054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0035e5e55a144df9b7567cfbc16d1a81'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:37.709743 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1f5ae5b0-6f0f-40dc-9bf0-82d2ed37c054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0035e5e55a144df9b7567cfbc16d1a81'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:37.713168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=82,keystone:INSERT=2,keystone:DELETE=16 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:37.735458 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1f5ae5b0-6f0f-40dc-9bf0-82d2ed37c054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0035e5e55a144df9b7567cfbc16d1a81'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:37.754513 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 868/1756] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:37 2022] DELETE /identity/v3/users/0035e5e55a144df9b7567cfbc16d1a81 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:37.759195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c211ba-be4a-4805-8ef6-2015ce6aade6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:37.759647 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c211ba-be4a-4805-8ef6-2015ce6aade6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:37.762105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c211ba-be4a-4805-8ef6-2015ce6aade6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:37.806265 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b4c211ba-be4a-4805-8ef6-2015ce6aade6 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:37.808935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b4c211ba-be4a-4805-8ef6-2015ce6aade6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:37.819909 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ae5b0-6f0f-40dc-9bf0-82d2ed37c054 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:37.819909 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1f5ae5b0-6f0f-40dc-9bf0-82d2ed37c054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:37.924540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:37.959456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ae5b0-6f0f-40dc-9bf0-82d2ed37c054 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:37.991986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 889/1757] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:37.994099 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c211ba-be4a-4805-8ef6-2015ce6aade6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:37.995978 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b4c211ba-be4a-4805-8ef6-2015ce6aade6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:38.009120 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a9bb4-6d8e-487c-9ad9-573f2f52d66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:38.011812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a9bb4-6d8e-487c-9ad9-573f2f52d66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:38.011812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a9bb4-6d8e-487c-9ad9-573f2f52d66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:38.011812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a9bb4-6d8e-487c-9ad9-573f2f52d66b admin admin] PATH_INFO: `/v3/users/17f6b1d08cc044b4a9bd7af490c336a8` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:38.016286 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a9bb4-6d8e-487c-9ad9-573f2f52d66b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f6b1d08cc044b4a9bd7af490c336a8)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:38.020638 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a9bb4-6d8e-487c-9ad9-573f2f52d66b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:38.121395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-017a9bb4-6d8e-487c-9ad9-573f2f52d66b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f6b1d08cc044b4a9bd7af490c336a8'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:38.142321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-017a9bb4-6d8e-487c-9ad9-573f2f52d66b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f6b1d08cc044b4a9bd7af490c336a8'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:38.152450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-017a9bb4-6d8e-487c-9ad9-573f2f52d66b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f6b1d08cc044b4a9bd7af490c336a8'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:38.154036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-017a9bb4-6d8e-487c-9ad9-573f2f52d66b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f6b1d08cc044b4a9bd7af490c336a8'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:38.167484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-017a9bb4-6d8e-487c-9ad9-573f2f52d66b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f6b1d08cc044b4a9bd7af490c336a8'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:38.201710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 869/1758] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:37 2022] DELETE /identity/v3/users/17f6b1d08cc044b4a9bd7af490c336a8 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:38.204562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a9bb4-6d8e-487c-9ad9-573f2f52d66b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:38.210833 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-017a9bb4-6d8e-487c-9ad9-573f2f52d66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:38.333739 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c211ba-be4a-4805-8ef6-2015ce6aade6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:38.583133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a9bb4-6d8e-487c-9ad9-573f2f52d66b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:38.596973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be3168-f212-4c75-88bc-7cc7b68db4a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:38.599494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be3168-f212-4c75-88bc-7cc7b68db4a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:38.604911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be3168-f212-4c75-88bc-7cc7b68db4a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:38.605585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be3168-f212-4c75-88bc-7cc7b68db4a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:38.609800 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b8be3168-f212-4c75-88bc-7cc7b68db4a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:38.667189 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:38.673879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225806b-1ec4-4eff-a450-2e87f20d5b1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9791ea73d46b191ad9fc146297565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:38.676156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225806b-1ec4-4eff-a450-2e87f20d5b1d service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:38.676462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225806b-1ec4-4eff-a450-2e87f20d5b1d service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:38.676722 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225806b-1ec4-4eff-a450-2e87f20d5b1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:38.686844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7225806b-1ec4-4eff-a450-2e87f20d5b1d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:38.812679 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be3168-f212-4c75-88bc-7cc7b68db4a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:38.813702 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be3168-f212-4c75-88bc-7cc7b68db4a1 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:38.855626 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 870/1759] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:38.857943 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72ce61-3a78-4e3a-b65d-bf9941cab53d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:38.858422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72ce61-3a78-4e3a-b65d-bf9941cab53d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:38.858895 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72ce61-3a78-4e3a-b65d-bf9941cab53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:38.943131 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3a72ce61-3a78-4e3a-b65d-bf9941cab53d None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:38.945163 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3a72ce61-3a78-4e3a-b65d-bf9941cab53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:38.980838 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 871/1760] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:39.005002 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225806b-1ec4-4eff-a450-2e87f20d5b1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:39.006380 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225806b-1ec4-4eff-a450-2e87f20d5b1d service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:39.043870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 890/1761] 10.222.0.52 () {60 vars in 1384 bytes} [Mon Aug 29 20:31:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1051 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:31:39.058382 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72ce61-3a78-4e3a-b65d-bf9941cab53d None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:39.060514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3a72ce61-3a78-4e3a-b65d-bf9941cab53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:39.086205 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72ce61-3a78-4e3a-b65d-bf9941cab53d None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:39.090793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7194f-5173-4958-a767-38ca9ef816e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:39.091457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7194f-5173-4958-a767-38ca9ef816e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:39.091732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7194f-5173-4958-a767-38ca9ef816e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:39.092056 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7194f-5173-4958-a767-38ca9ef816e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:39.118382 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7194f-5173-4958-a767-38ca9ef816e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:39.120020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7194f-5173-4958-a767-38ca9ef816e5 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:39.147651 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 872/1762] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:39.297828 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225806b-1ec4-4eff-a450-2e87f20d5b1d service swift] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:39.310962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7225806b-1ec4-4eff-a450-2e87f20d5b1d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:39.323772 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:39.358813 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7194f-5173-4958-a767-38ca9ef816e5 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:39.361142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e6f7194f-5173-4958-a767-38ca9ef816e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:39.368005 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225806b-1ec4-4eff-a450-2e87f20d5b1d service swift] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:39.412580 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7194f-5173-4958-a767-38ca9ef816e5 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:39.419321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761de43-0fae-474b-b1fc-51708b750ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:39.420209 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761de43-0fae-474b-b1fc-51708b750ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:39.420475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761de43-0fae-474b-b1fc-51708b750ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:39.420710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761de43-0fae-474b-b1fc-51708b750ed0 admin admin] PATH_INFO: `/v3/users/d9039382706d4681865feec689d648cc` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:39.432444 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2255c-efba-4fcf-bc93-d274bb9bdad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:39.453626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761de43-0fae-474b-b1fc-51708b750ed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9039382706d4681865feec689d648cc)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:39.454158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2255c-efba-4fcf-bc93-d274bb9bdad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:39.455686 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2255c-efba-4fcf-bc93-d274bb9bdad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:39.459325 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2255c-efba-4fcf-bc93-d274bb9bdad5 admin admin] PATH_INFO: `/v3/users/14b4535bad63457abd1a928f46846a8e` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:39.464079 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2255c-efba-4fcf-bc93-d274bb9bdad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b4535bad63457abd1a928f46846a8e)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:39.473389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761de43-0fae-474b-b1fc-51708b750ed0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:39.474792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2255c-efba-4fcf-bc93-d274bb9bdad5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:39.647922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5761de43-0fae-474b-b1fc-51708b750ed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9039382706d4681865feec689d648cc'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:39.669812 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5761de43-0fae-474b-b1fc-51708b750ed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9039382706d4681865feec689d648cc'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:39.718889 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-48d2255c-efba-4fcf-bc93-d274bb9bdad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b4535bad63457abd1a928f46846a8e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:39.723521 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5761de43-0fae-474b-b1fc-51708b750ed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9039382706d4681865feec689d648cc'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:39.727218 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5761de43-0fae-474b-b1fc-51708b750ed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9039382706d4681865feec689d648cc'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:39.729871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5761de43-0fae-474b-b1fc-51708b750ed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9039382706d4681865feec689d648cc'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:39.770571 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 891/1763] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:39 2022] DELETE /identity/v3/users/d9039382706d4681865feec689d648cc => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:39.773240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-48d2255c-efba-4fcf-bc93-d274bb9bdad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b4535bad63457abd1a928f46846a8e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:39.776986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88144d2c-563c-40a5-86e6-96a7bbdadd5f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:39.777426 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88144d2c-563c-40a5-86e6-96a7bbdadd5f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:39.777661 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88144d2c-563c-40a5-86e6-96a7bbdadd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:39.798083 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-48d2255c-efba-4fcf-bc93-d274bb9bdad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b4535bad63457abd1a928f46846a8e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:39.809514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-48d2255c-efba-4fcf-bc93-d274bb9bdad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b4535bad63457abd1a928f46846a8e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:39.838747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-48d2255c-efba-4fcf-bc93-d274bb9bdad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b4535bad63457abd1a928f46846a8e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:39.857463 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-88144d2c-563c-40a5-86e6-96a7bbdadd5f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:39.859741 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 873/1764] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:39 2022] DELETE /identity/v3/users/14b4535bad63457abd1a928f46846a8e => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:39.865064 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fda686-cce2-4f1f-92bf-847660281566 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:39.865821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fda686-cce2-4f1f-92bf-847660281566 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:39.866318 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fda686-cce2-4f1f-92bf-847660281566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:39.867926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-88144d2c-563c-40a5-86e6-96a7bbdadd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:39.922560 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-24fda686-cce2-4f1f-92bf-847660281566 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:39.924441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-24fda686-cce2-4f1f-92bf-847660281566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:40.086981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 874/1765] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:40.128484 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 892/1766] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:40.132669 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fda686-cce2-4f1f-92bf-847660281566 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:40.137284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-24fda686-cce2-4f1f-92bf-847660281566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:40.164286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88144d2c-563c-40a5-86e6-96a7bbdadd5f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:40.167436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-88144d2c-563c-40a5-86e6-96a7bbdadd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:40.201687 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:40.404907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fda686-cce2-4f1f-92bf-847660281566 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:40.442948 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49734356-59cd-456e-b38e-8d77a6910354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:40.444280 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49734356-59cd-456e-b38e-8d77a6910354 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:40.444589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49734356-59cd-456e-b38e-8d77a6910354 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:40.444956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49734356-59cd-456e-b38e-8d77a6910354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:40.454180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88144d2c-563c-40a5-86e6-96a7bbdadd5f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:40.468132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5755088-099f-4fc9-b9c6-cc65b5133517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:40.471155 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5755088-099f-4fc9-b9c6-cc65b5133517 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:40.472801 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5755088-099f-4fc9-b9c6-cc65b5133517 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:40.473302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5755088-099f-4fc9-b9c6-cc65b5133517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:40.491472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5755088-099f-4fc9-b9c6-cc65b5133517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:40.493786 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49734356-59cd-456e-b38e-8d77a6910354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:40.494068 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5755088-099f-4fc9-b9c6-cc65b5133517 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:40.495319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49734356-59cd-456e-b38e-8d77a6910354 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:40.511112 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 893/1767] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:40.512717 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5755088-099f-4fc9-b9c6-cc65b5133517 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:40.514240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d5755088-099f-4fc9-b9c6-cc65b5133517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:40.542621 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 875/1768] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:40.555916 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5755088-099f-4fc9-b9c6-cc65b5133517 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:40.580519 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46828d-d73a-4753-9d7c-8c05ab03df57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:40.582588 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46828d-d73a-4753-9d7c-8c05ab03df57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:40.584168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46828d-d73a-4753-9d7c-8c05ab03df57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:40.584582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46828d-d73a-4753-9d7c-8c05ab03df57 admin admin] PATH_INFO: `/v3/users/75683bc93b194eddb72540008507b2c4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:40.589074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46828d-d73a-4753-9d7c-8c05ab03df57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75683bc93b194eddb72540008507b2c4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:40.599319 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46828d-d73a-4753-9d7c-8c05ab03df57 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:40.650174 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:40.793052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-db46828d-d73a-4753-9d7c-8c05ab03df57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75683bc93b194eddb72540008507b2c4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:40.835133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-db46828d-d73a-4753-9d7c-8c05ab03df57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75683bc93b194eddb72540008507b2c4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:40.865322 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-db46828d-d73a-4753-9d7c-8c05ab03df57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75683bc93b194eddb72540008507b2c4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:40.868170 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-db46828d-d73a-4753-9d7c-8c05ab03df57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75683bc93b194eddb72540008507b2c4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:40.870070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-db46828d-d73a-4753-9d7c-8c05ab03df57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75683bc93b194eddb72540008507b2c4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:40.903111 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 894/1769] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:40 2022] DELETE /identity/v3/users/75683bc93b194eddb72540008507b2c4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:40.908678 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83188040-8324-46ff-bf96-99428dbe3eda None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:40.909116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83188040-8324-46ff-bf96-99428dbe3eda None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:40.909649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83188040-8324-46ff-bf96-99428dbe3eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:40.997989 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-83188040-8324-46ff-bf96-99428dbe3eda None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:41.001063 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-83188040-8324-46ff-bf96-99428dbe3eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:41.380246 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 876/1770] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:41.429032 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46828d-d73a-4753-9d7c-8c05ab03df57 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:41.431678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-db46828d-d73a-4753-9d7c-8c05ab03df57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:41.520192 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0fdc5-977f-4837-8601-2ba50415661a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:41.520866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0fdc5-977f-4837-8601-2ba50415661a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:41.521186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0fdc5-977f-4837-8601-2ba50415661a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:41.632020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-01e0fdc5-977f-4837-8601-2ba50415661a None None] MFA Rules not processed for user `382b0ee3bd634cc8800f1769c91b7a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:41.634165 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-01e0fdc5-977f-4837-8601-2ba50415661a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:41.641889 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46828d-d73a-4753-9d7c-8c05ab03df57 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:41.647843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848cb65-f93b-4c2a-a15f-07fa4b60f459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:41.648626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848cb65-f93b-4c2a-a15f-07fa4b60f459 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:41.648962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848cb65-f93b-4c2a-a15f-07fa4b60f459 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:41.649315 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848cb65-f93b-4c2a-a15f-07fa4b60f459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:41.670945 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848cb65-f93b-4c2a-a15f-07fa4b60f459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:41.674749 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848cb65-f93b-4c2a-a15f-07fa4b60f459 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:41.688857 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 877/1771] 10.222.0.69 () {58 vars in 1015 bytes} [Mon Aug 29 20:31:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:41.719174 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 895/1772] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:41.726616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0fdc5-977f-4837-8601-2ba50415661a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:41.758397 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0fdc5-977f-4837-8601-2ba50415661a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:41.786373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4e76b-f8b9-4628-ae9b-fd141686b2c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:41.787509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e76b-f8b9-4628-ae9b-fd141686b2c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:41.788025 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e76b-f8b9-4628-ae9b-fd141686b2c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:41.788517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e76b-f8b9-4628-ae9b-fd141686b2c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:41.839184 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4e76b-f8b9-4628-ae9b-fd141686b2c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:41.842205 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4e76b-f8b9-4628-ae9b-fd141686b2c0 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:41.892330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 878/1773] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:42.055497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c623486-eacf-4aed-8811-c18f5ffc5189 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:42.061825 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c623486-eacf-4aed-8811-c18f5ffc5189 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:42.063967 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c623486-eacf-4aed-8811-c18f5ffc5189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:42.141494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2c623486-eacf-4aed-8811-c18f5ffc5189 None None] MFA Rules not processed for user `960befc2f96b4565b9a99026d906f3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:42.141494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2c623486-eacf-4aed-8811-c18f5ffc5189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:42.370447 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 896/1774] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:42.490936 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4e76b-f8b9-4628-ae9b-fd141686b2c0 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:42.493101 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-19d4e76b-f8b9-4628-ae9b-fd141686b2c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:42.554662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4e76b-f8b9-4628-ae9b-fd141686b2c0 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:42.585770 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefbd91-a04e-439b-9ade-e07747d7a339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:42.586479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefbd91-a04e-439b-9ade-e07747d7a339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:42.586761 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefbd91-a04e-439b-9ade-e07747d7a339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:42.587034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefbd91-a04e-439b-9ade-e07747d7a339 admin admin] PATH_INFO: `/v3/projects/22c85428a881485eaf03584752b42594` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:42.588824 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefbd91-a04e-439b-9ade-e07747d7a339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c85428a881485eaf03584752b42594)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:42.592578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefbd91-a04e-439b-9ade-e07747d7a339 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:42.722205 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8aefbd91-a04e-439b-9ade-e07747d7a339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c85428a881485eaf03584752b42594', 'request_id': 'req-8aefbd91-a04e-439b-9ade-e07747d7a339'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:42.741420 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8aefbd91-a04e-439b-9ade-e07747d7a339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c85428a881485eaf03584752b42594', 'request_id': 'req-8aefbd91-a04e-439b-9ade-e07747d7a339'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:42.754490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8aefbd91-a04e-439b-9ade-e07747d7a339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c85428a881485eaf03584752b42594', 'request_id': 'req-8aefbd91-a04e-439b-9ade-e07747d7a339'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:42.779717 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8aefbd91-a04e-439b-9ade-e07747d7a339 admin admin] The token cache is being invalidate because project 22c85428a881485eaf03584752b42594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:42.780028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8aefbd91-a04e-439b-9ade-e07747d7a339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:42.781063 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8aefbd91-a04e-439b-9ade-e07747d7a339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:42.787028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 879/1775] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:42 2022] DELETE /identity/v3/projects/22c85428a881485eaf03584752b42594 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:42.788607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c623486-eacf-4aed-8811-c18f5ffc5189 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:42.812942 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c623486-eacf-4aed-8811-c18f5ffc5189 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:42.919073 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:42.976429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfe3dd-8e85-4606-b372-b44243bd16e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:42.977422 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfe3dd-8e85-4606-b372-b44243bd16e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:42.977880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfe3dd-8e85-4606-b372-b44243bd16e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:42.978333 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfe3dd-8e85-4606-b372-b44243bd16e4 admin admin] PATH_INFO: `/v3/users/21a164cf8cf04a35902771036a2d376f` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:42.980434 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cfe3dd-8e85-4606-b372-b44243bd16e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a164cf8cf04a35902771036a2d376f)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:42.982689 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cfe3dd-8e85-4606-b372-b44243bd16e4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:43.213854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-82cfe3dd-8e85-4606-b372-b44243bd16e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a164cf8cf04a35902771036a2d376f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.236493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-82cfe3dd-8e85-4606-b372-b44243bd16e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a164cf8cf04a35902771036a2d376f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.285338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-82cfe3dd-8e85-4606-b372-b44243bd16e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a164cf8cf04a35902771036a2d376f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.287970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-82cfe3dd-8e85-4606-b372-b44243bd16e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a164cf8cf04a35902771036a2d376f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.289902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-82cfe3dd-8e85-4606-b372-b44243bd16e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a164cf8cf04a35902771036a2d376f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:43.346045 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 897/1776] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:42 2022] DELETE /identity/v3/users/21a164cf8cf04a35902771036a2d376f => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:44.393335 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefbd91-a04e-439b-9ade-e07747d7a339 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:44.396043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8aefbd91-a04e-439b-9ade-e07747d7a339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:44.421147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefbd91-a04e-439b-9ade-e07747d7a339 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:44.475616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:44.742175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf820cb-46f3-49e2-8adc-6f09f9289c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:44.743452 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf820cb-46f3-49e2-8adc-6f09f9289c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:44.744217 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf820cb-46f3-49e2-8adc-6f09f9289c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:44.745161 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf820cb-46f3-49e2-8adc-6f09f9289c34 admin admin] PATH_INFO: `/v3/projects/aaf88a26b0d4405f9490d9f1ecfd2750` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:44.747011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf820cb-46f3-49e2-8adc-6f09f9289c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaf88a26b0d4405f9490d9f1ecfd2750)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:44.752273 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf820cb-46f3-49e2-8adc-6f09f9289c34 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:44.977421 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-abf820cb-46f3-49e2-8adc-6f09f9289c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaf88a26b0d4405f9490d9f1ecfd2750', 'request_id': 'req-abf820cb-46f3-49e2-8adc-6f09f9289c34'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:45.011900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-abf820cb-46f3-49e2-8adc-6f09f9289c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaf88a26b0d4405f9490d9f1ecfd2750', 'request_id': 'req-abf820cb-46f3-49e2-8adc-6f09f9289c34'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:45.028084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-abf820cb-46f3-49e2-8adc-6f09f9289c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaf88a26b0d4405f9490d9f1ecfd2750', 'request_id': 'req-abf820cb-46f3-49e2-8adc-6f09f9289c34'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:45.052108 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfe3dd-8e85-4606-b372-b44243bd16e4 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:45.054630 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-82cfe3dd-8e85-4606-b372-b44243bd16e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:45.057776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-abf820cb-46f3-49e2-8adc-6f09f9289c34 admin admin] The token cache is being invalidate because project aaf88a26b0d4405f9490d9f1ecfd2750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:45.058180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-abf820cb-46f3-49e2-8adc-6f09f9289c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:45.059060 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-abf820cb-46f3-49e2-8adc-6f09f9289c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:45.064183 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 880/1777] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:44 2022] DELETE /identity/v3/projects/aaf88a26b0d4405f9490d9f1ecfd2750 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:45.068936 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf820cb-46f3-49e2-8adc-6f09f9289c34 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:45.072399 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-abf820cb-46f3-49e2-8adc-6f09f9289c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:45.107453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfe3dd-8e85-4606-b372-b44243bd16e4 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:45.219343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf820cb-46f3-49e2-8adc-6f09f9289c34 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:45.257425 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b4001-9299-4673-9bf5-6d1fc4b08991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:45.258509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4001-9299-4673-9bf5-6d1fc4b08991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:45.258931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4001-9299-4673-9bf5-6d1fc4b08991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:45.259525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4001-9299-4673-9bf5-6d1fc4b08991 admin admin] PATH_INFO: `/v3/users/3d13bfd12c1142969ce6d393fc160654` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:45.262225 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b4001-9299-4673-9bf5-6d1fc4b08991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d13bfd12c1142969ce6d393fc160654)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:45.264942 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b4001-9299-4673-9bf5-6d1fc4b08991 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:45.415053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-409b4001-9299-4673-9bf5-6d1fc4b08991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d13bfd12c1142969ce6d393fc160654'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:45.439404 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:45.464083 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:45.464779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:45.465303 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:45.465684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-409b4001-9299-4673-9bf5-6d1fc4b08991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d13bfd12c1142969ce6d393fc160654'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:45.465801 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4 admin admin] PATH_INFO: `/v3/projects/d42d6f9eebef47fda1d04f780c5eb843` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:45.467026 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d42d6f9eebef47fda1d04f780c5eb843)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:45.470273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:45.486973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-409b4001-9299-4673-9bf5-6d1fc4b08991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d13bfd12c1142969ce6d393fc160654'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:45.489549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-409b4001-9299-4673-9bf5-6d1fc4b08991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d13bfd12c1142969ce6d393fc160654'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:45.508204 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-409b4001-9299-4673-9bf5-6d1fc4b08991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d13bfd12c1142969ce6d393fc160654'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:45.527535 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 881/1778] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:45 2022] DELETE /identity/v3/users/3d13bfd12c1142969ce6d393fc160654 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:45.529212 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b4001-9299-4673-9bf5-6d1fc4b08991 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:45.535593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-409b4001-9299-4673-9bf5-6d1fc4b08991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:45.548517 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd42d6f9eebef47fda1d04f780c5eb843', 'request_id': 'req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:45.559914 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd42d6f9eebef47fda1d04f780c5eb843', 'request_id': 'req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:45.570089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:45.582696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd42d6f9eebef47fda1d04f780c5eb843', 'request_id': 'req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:45.632618 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4 admin admin] The token cache is being invalidate because project d42d6f9eebef47fda1d04f780c5eb843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:45.634563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:45.636454 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:45.643395 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 898/1779] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:45 2022] DELETE /identity/v3/projects/d42d6f9eebef47fda1d04f780c5eb843 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:45.647471 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:45.650196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:45.723395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b4001-9299-4673-9bf5-6d1fc4b08991 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:45.837147 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dca3d5-ffd9-4709-8e3e-3da57fdd54e4 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:45.858789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504cfef-495c-4ea9-964d-415d32426279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:45.858789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504cfef-495c-4ea9-964d-415d32426279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:45.858789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504cfef-495c-4ea9-964d-415d32426279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:45.858789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504cfef-495c-4ea9-964d-415d32426279 admin admin] PATH_INFO: `/v3/projects/eeae3fbf337e47c8a79bae272823e3f1` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:45.865555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504cfef-495c-4ea9-964d-415d32426279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeae3fbf337e47c8a79bae272823e3f1)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:45.871518 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504cfef-495c-4ea9-964d-415d32426279 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:45.918395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb192a9-0569-4578-814e-3f89dd4d6d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:45.922511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb192a9-0569-4578-814e-3f89dd4d6d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:45.923240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb192a9-0569-4578-814e-3f89dd4d6d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:45.926202 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb192a9-0569-4578-814e-3f89dd4d6d6a admin admin] PATH_INFO: `/v3/projects/d563f96aa2dd4b01ac0f4dbcd4bb9a02` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:45.929516 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb192a9-0569-4578-814e-3f89dd4d6d6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d563f96aa2dd4b01ac0f4dbcd4bb9a02)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:45.939807 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb192a9-0569-4578-814e-3f89dd4d6d6a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:46.099416 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3504cfef-495c-4ea9-964d-415d32426279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeae3fbf337e47c8a79bae272823e3f1', 'request_id': 'req-3504cfef-495c-4ea9-964d-415d32426279'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.118829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3504cfef-495c-4ea9-964d-415d32426279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeae3fbf337e47c8a79bae272823e3f1', 'request_id': 'req-3504cfef-495c-4ea9-964d-415d32426279'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.151568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3504cfef-495c-4ea9-964d-415d32426279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeae3fbf337e47c8a79bae272823e3f1', 'request_id': 'req-3504cfef-495c-4ea9-964d-415d32426279'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.186982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-dcb192a9-0569-4578-814e-3f89dd4d6d6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd563f96aa2dd4b01ac0f4dbcd4bb9a02', 'request_id': 'req-dcb192a9-0569-4578-814e-3f89dd4d6d6a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.188762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3504cfef-495c-4ea9-964d-415d32426279 admin admin] The token cache is being invalidate because project eeae3fbf337e47c8a79bae272823e3f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:46.189149 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3504cfef-495c-4ea9-964d-415d32426279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.191070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3504cfef-495c-4ea9-964d-415d32426279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.196951 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 899/1780] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:45 2022] DELETE /identity/v3/projects/eeae3fbf337e47c8a79bae272823e3f1 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:46.201372 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504cfef-495c-4ea9-964d-415d32426279 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:46.206509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-dcb192a9-0569-4578-814e-3f89dd4d6d6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd563f96aa2dd4b01ac0f4dbcd4bb9a02', 'request_id': 'req-dcb192a9-0569-4578-814e-3f89dd4d6d6a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.207681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3504cfef-495c-4ea9-964d-415d32426279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:46.229608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-dcb192a9-0569-4578-814e-3f89dd4d6d6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd563f96aa2dd4b01ac0f4dbcd4bb9a02', 'request_id': 'req-dcb192a9-0569-4578-814e-3f89dd4d6d6a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.263762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-dcb192a9-0569-4578-814e-3f89dd4d6d6a admin admin] The token cache is being invalidate because project d563f96aa2dd4b01ac0f4dbcd4bb9a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:46.264141 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-dcb192a9-0569-4578-814e-3f89dd4d6d6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.266414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-dcb192a9-0569-4578-814e-3f89dd4d6d6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.275831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 882/1781] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:45 2022] DELETE /identity/v3/projects/d563f96aa2dd4b01ac0f4dbcd4bb9a02 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:46.280450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb533e-7c71-4e99-857f-e1be65a4a584 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:46.280894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb533e-7c71-4e99-857f-e1be65a4a584 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:46.281282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb533e-7c71-4e99-857f-e1be65a4a584 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:46.293835 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 883/1782] 10.222.0.52 () {54 vars in 921 bytes} [Mon Aug 29 20:31:46 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:46.294977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb533e-7c71-4e99-857f-e1be65a4a584 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:46.304844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fffb533e-7c71-4e99-857f-e1be65a4a584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:46.337988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504cfef-495c-4ea9-964d-415d32426279 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:46.364764 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:46.391707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:46.535361 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb533e-7c71-4e99-857f-e1be65a4a584 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:46.542830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19096c49-3dfd-48b1-a399-99182f20b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:46.544767 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19096c49-3dfd-48b1-a399-99182f20b70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:46.545119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19096c49-3dfd-48b1-a399-99182f20b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:46.545504 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19096c49-3dfd-48b1-a399-99182f20b70f admin admin] PATH_INFO: `/v3/users/50752e8d5bbe4fc3a14e504288f3b613` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:46.554140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19096c49-3dfd-48b1-a399-99182f20b70f admin admin] RBAC: Authorizing `identity:delete_user(user_id=50752e8d5bbe4fc3a14e504288f3b613)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:46.558651 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19096c49-3dfd-48b1-a399-99182f20b70f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:46.584137 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc4a99-d38b-40bb-8e48-ef492138c68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:46.585835 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc4a99-d38b-40bb-8e48-ef492138c68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:46.586343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc4a99-d38b-40bb-8e48-ef492138c68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:46.589880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc4a99-d38b-40bb-8e48-ef492138c68a admin admin] PATH_INFO: `/v3/users/0e20070b7ff94633a708a582f937f1f0` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:46.598300 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc4a99-d38b-40bb-8e48-ef492138c68a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e20070b7ff94633a708a582f937f1f0)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:46.610422 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc4a99-d38b-40bb-8e48-ef492138c68a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:46.723610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-19096c49-3dfd-48b1-a399-99182f20b70f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50752e8d5bbe4fc3a14e504288f3b613'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.777403 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-19096c49-3dfd-48b1-a399-99182f20b70f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50752e8d5bbe4fc3a14e504288f3b613'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.793125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-61fc4a99-d38b-40bb-8e48-ef492138c68a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e20070b7ff94633a708a582f937f1f0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.801322 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-19096c49-3dfd-48b1-a399-99182f20b70f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50752e8d5bbe4fc3a14e504288f3b613'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.803265 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-19096c49-3dfd-48b1-a399-99182f20b70f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50752e8d5bbe4fc3a14e504288f3b613'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.837884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-19096c49-3dfd-48b1-a399-99182f20b70f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50752e8d5bbe4fc3a14e504288f3b613'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.859119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 884/1783] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:46 2022] DELETE /identity/v3/users/50752e8d5bbe4fc3a14e504288f3b613 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:46.872077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19096c49-3dfd-48b1-a399-99182f20b70f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:46.872341 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-61fc4a99-d38b-40bb-8e48-ef492138c68a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e20070b7ff94633a708a582f937f1f0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.878276 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-19096c49-3dfd-48b1-a399-99182f20b70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:46.944011 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-61fc4a99-d38b-40bb-8e48-ef492138c68a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e20070b7ff94633a708a582f937f1f0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.948743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-61fc4a99-d38b-40bb-8e48-ef492138c68a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e20070b7ff94633a708a582f937f1f0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:46.954334 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-61fc4a99-d38b-40bb-8e48-ef492138c68a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e20070b7ff94633a708a582f937f1f0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:47.027656 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 900/1784] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:46 2022] DELETE /identity/v3/users/0e20070b7ff94633a708a582f937f1f0 => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:47.035366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc34e5f-d1cc-4ef7-a05f-ddcc339e82a5 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:47.036402 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc34e5f-d1cc-4ef7-a05f-ddcc339e82a5 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:47.037105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc34e5f-d1cc-4ef7-a05f-ddcc339e82a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:47.119001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-dcc34e5f-d1cc-4ef7-a05f-ddcc339e82a5 None None] MFA Rules not processed for user `9c95d16fd4da4fa7987b893eae0b3ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:47.123619 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-dcc34e5f-d1cc-4ef7-a05f-ddcc339e82a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:47.279922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19096c49-3dfd-48b1-a399-99182f20b70f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:47.360139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:47.392892 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 901/1785] 10.222.0.52 () {58 vars in 1018 bytes} [Mon Aug 29 20:31:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:47.436436 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90fa0c-88a5-4cf4-b35f-96ad50227ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:47.436873 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90fa0c-88a5-4cf4-b35f-96ad50227ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:47.437297 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90fa0c-88a5-4cf4-b35f-96ad50227ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:47.437674 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90fa0c-88a5-4cf4-b35f-96ad50227ccb admin admin] PATH_INFO: `/v3/users/4b9f8b4aeeab40b986d35d130b5aa362` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:47.439111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90fa0c-88a5-4cf4-b35f-96ad50227ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b9f8b4aeeab40b986d35d130b5aa362)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:47.441756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90fa0c-88a5-4cf4-b35f-96ad50227ccb admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:47.565691 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-aa90fa0c-88a5-4cf4-b35f-96ad50227ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b9f8b4aeeab40b986d35d130b5aa362'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:47.727628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc34e5f-d1cc-4ef7-a05f-ddcc339e82a5 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:47.734331 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-dcc34e5f-d1cc-4ef7-a05f-ddcc339e82a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:47.744506 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-aa90fa0c-88a5-4cf4-b35f-96ad50227ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b9f8b4aeeab40b986d35d130b5aa362'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:47.783180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-aa90fa0c-88a5-4cf4-b35f-96ad50227ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b9f8b4aeeab40b986d35d130b5aa362'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:47.789757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-aa90fa0c-88a5-4cf4-b35f-96ad50227ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b9f8b4aeeab40b986d35d130b5aa362'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:47.803773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc34e5f-d1cc-4ef7-a05f-ddcc339e82a5 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:47.825043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-aa90fa0c-88a5-4cf4-b35f-96ad50227ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b9f8b4aeeab40b986d35d130b5aa362'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:47.847846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 885/1786] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:46 2022] DELETE /identity/v3/users/4b9f8b4aeeab40b986d35d130b5aa362 => generated 0 bytes in 981 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:47.850628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ab30a-9929-4dc0-9334-200f4af668ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:47.851534 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90fa0c-88a5-4cf4-b35f-96ad50227ccb admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:47.851910 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ab30a-9929-4dc0-9334-200f4af668ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:47.853732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ab30a-9929-4dc0-9334-200f4af668ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:47.854297 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ab30a-9929-4dc0-9334-200f4af668ab admin admin] PATH_INFO: `/v3/projects/3080e5d2475b4507af5081808d839c2d` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:47.854623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-aa90fa0c-88a5-4cf4-b35f-96ad50227ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:47.857075 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ab30a-9929-4dc0-9334-200f4af668ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=3080e5d2475b4507af5081808d839c2d)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:47.859780 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ab30a-9929-4dc0-9334-200f4af668ab admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:47.979183 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:48.028566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4a1ab30a-9929-4dc0-9334-200f4af668ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3080e5d2475b4507af5081808d839c2d', 'request_id': 'req-4a1ab30a-9929-4dc0-9334-200f4af668ab'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.053517 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4a1ab30a-9929-4dc0-9334-200f4af668ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3080e5d2475b4507af5081808d839c2d', 'request_id': 'req-4a1ab30a-9929-4dc0-9334-200f4af668ab'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.075831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4a1ab30a-9929-4dc0-9334-200f4af668ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3080e5d2475b4507af5081808d839c2d', 'request_id': 'req-4a1ab30a-9929-4dc0-9334-200f4af668ab'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.126840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90fa0c-88a5-4cf4-b35f-96ad50227ccb admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:48.129917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4a1ab30a-9929-4dc0-9334-200f4af668ab admin admin] The token cache is being invalidate because project 3080e5d2475b4507af5081808d839c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:48.131337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4a1ab30a-9929-4dc0-9334-200f4af668ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.133144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4a1ab30a-9929-4dc0-9334-200f4af668ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.137078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 902/1787] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:47 2022] DELETE /identity/v3/projects/3080e5d2475b4507af5081808d839c2d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:48.144233 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032836-6e25-4150-b06d-91a9a1e38334 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:48.144523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032836-6e25-4150-b06d-91a9a1e38334 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:48.144796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032836-6e25-4150-b06d-91a9a1e38334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:48.222105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e4032836-6e25-4150-b06d-91a9a1e38334 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:48.223115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e4032836-6e25-4150-b06d-91a9a1e38334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:48.262642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:48.373097 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991793a-c25a-48fe-b636-55e9aff88574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:48.374260 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991793a-c25a-48fe-b636-55e9aff88574 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:48.374785 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991793a-c25a-48fe-b636-55e9aff88574 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:48.375305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991793a-c25a-48fe-b636-55e9aff88574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:48.388321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f991793a-c25a-48fe-b636-55e9aff88574 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:48.408170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991793a-c25a-48fe-b636-55e9aff88574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:48.420379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991793a-c25a-48fe-b636-55e9aff88574 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:48.441740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 886/1788] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:48.469529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 903/1789] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:48.472859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ca131-221a-4ce6-99fc-ca04c1c217f4 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:48.473252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ca131-221a-4ce6-99fc-ca04c1c217f4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:48.473839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ca131-221a-4ce6-99fc-ca04c1c217f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:48.527412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-606ca131-221a-4ce6-99fc-ca04c1c217f4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:48.530403 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-606ca131-221a-4ce6-99fc-ca04c1c217f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:48.578587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 887/1790] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:31:48.579914 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4032836-6e25-4150-b06d-91a9a1e38334 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:48.605993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4032836-6e25-4150-b06d-91a9a1e38334 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:48.608350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ca131-221a-4ce6-99fc-ca04c1c217f4 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:48.610797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-606ca131-221a-4ce6-99fc-ca04c1c217f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:48.628625 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02837b71-226d-478c-b443-10731494ca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:48.629800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02837b71-226d-478c-b443-10731494ca42 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:48.630245 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02837b71-226d-478c-b443-10731494ca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:48.631743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02837b71-226d-478c-b443-10731494ca42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:48.634650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02837b71-226d-478c-b443-10731494ca42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:48.635790 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02837b71-226d-478c-b443-10731494ca42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:48.638549 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02837b71-226d-478c-b443-10731494ca42 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:48.671504 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ca131-221a-4ce6-99fc-ca04c1c217f4 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:48.674325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 904/1791] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:31:48.678864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02837b71-226d-478c-b443-10731494ca42 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:48.692702 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b50d68-47bb-4898-997e-f57c0cf95aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:48.693467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b50d68-47bb-4898-997e-f57c0cf95aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:48.693721 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b50d68-47bb-4898-997e-f57c0cf95aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:48.694106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b50d68-47bb-4898-997e-f57c0cf95aca admin admin] PATH_INFO: `/v3/projects/2e4eea46d3dc4c548790183411869de5` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:48.695522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b50d68-47bb-4898-997e-f57c0cf95aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e4eea46d3dc4c548790183411869de5)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:48.697574 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b50d68-47bb-4898-997e-f57c0cf95aca admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:48.717231 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02837b71-226d-478c-b443-10731494ca42 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:48.725809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c25a6-a042-4e25-a5e0-1eda4a0560fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:48.726765 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c25a6-a042-4e25-a5e0-1eda4a0560fc admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:48.727401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c25a6-a042-4e25-a5e0-1eda4a0560fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:48.727852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c25a6-a042-4e25-a5e0-1eda4a0560fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:48.730860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c25a6-a042-4e25-a5e0-1eda4a0560fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:48.734153 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c25a6-a042-4e25-a5e0-1eda4a0560fc admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:48.849592 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-37b50d68-47bb-4898-997e-f57c0cf95aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e4eea46d3dc4c548790183411869de5', 'request_id': 'req-37b50d68-47bb-4898-997e-f57c0cf95aca'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.861846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-37b50d68-47bb-4898-997e-f57c0cf95aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e4eea46d3dc4c548790183411869de5', 'request_id': 'req-37b50d68-47bb-4898-997e-f57c0cf95aca'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.864115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 905/1792] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:48 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:48.868452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c25a6-a042-4e25-a5e0-1eda4a0560fc admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:48.892610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-37b50d68-47bb-4898-997e-f57c0cf95aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e4eea46d3dc4c548790183411869de5', 'request_id': 'req-37b50d68-47bb-4898-997e-f57c0cf95aca'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.955046 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-37b50d68-47bb-4898-997e-f57c0cf95aca admin admin] The token cache is being invalidate because project 2e4eea46d3dc4c548790183411869de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:48.955577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-37b50d68-47bb-4898-997e-f57c0cf95aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.956389 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-37b50d68-47bb-4898-997e-f57c0cf95aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:48.959480 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 888/1793] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:48 2022] DELETE /identity/v3/projects/2e4eea46d3dc4c548790183411869de5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:48.964913 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031a4f7-5e36-4d4d-ace6-11e07276ba07 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:48.965225 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031a4f7-5e36-4d4d-ace6-11e07276ba07 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:48.965932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031a4f7-5e36-4d4d-ace6-11e07276ba07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.013045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-2031a4f7-5e36-4d4d-ace6-11e07276ba07 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:49.015813 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2031a4f7-5e36-4d4d-ace6-11e07276ba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:49.166390 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c25a6-a042-4e25-a5e0-1eda4a0560fc admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:49.177049 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f252fba-733e-443c-a0aa-733863a7fbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:49.177914 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f252fba-733e-443c-a0aa-733863a7fbcf admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.178296 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f252fba-733e-443c-a0aa-733863a7fbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.178687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f252fba-733e-443c-a0aa-733863a7fbcf admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.179494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f252fba-733e-443c-a0aa-733863a7fbcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:49.185656 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f252fba-733e-443c-a0aa-733863a7fbcf admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:49.199663 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 889/1794] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:49.209172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f4938-019a-4cfc-9a7f-4b42372db65b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.209710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f4938-019a-4cfc-9a7f-4b42372db65b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.210187 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f4938-019a-4cfc-9a7f-4b42372db65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.240810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 906/1795] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:48 2022] POST /identity/v3/users => generated 290 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:49.242152 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f252fba-733e-443c-a0aa-733863a7fbcf admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:49.246475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5f252fba-733e-443c-a0aa-733863a7fbcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:49.279252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-557f4938-019a-4cfc-9a7f-4b42372db65b None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:49.280627 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-557f4938-019a-4cfc-9a7f-4b42372db65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:49.284502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f252fba-733e-443c-a0aa-733863a7fbcf admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:49.303592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bcec3-ecd6-4b41-87e6-a0cb3def90f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:49.310922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bcec3-ecd6-4b41-87e6-a0cb3def90f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.311334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 890/1796] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:49.312283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bcec3-ecd6-4b41-87e6-a0cb3def90f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.314165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bcec3-ecd6-4b41-87e6-a0cb3def90f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.317155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f4938-019a-4cfc-9a7f-4b42372db65b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:49.323952 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bcec3-ecd6-4b41-87e6-a0cb3def90f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:49.327027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bcec3-ecd6-4b41-87e6-a0cb3def90f0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:49.378616 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 907/1797] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:49.381138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bcec3-ecd6-4b41-87e6-a0cb3def90f0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:49.390531 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f4938-019a-4cfc-9a7f-4b42372db65b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:49.404036 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:49.404306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263a53b-4e32-41da-87bb-7063f79acc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:49.404672 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263a53b-4e32-41da-87bb-7063f79acc36 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.404951 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263a53b-4e32-41da-87bb-7063f79acc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.405223 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263a53b-4e32-41da-87bb-7063f79acc36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.405929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263a53b-4e32-41da-87bb-7063f79acc36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:49.406229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263a53b-4e32-41da-87bb-7063f79acc36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:49.415123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263a53b-4e32-41da-87bb-7063f79acc36 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:49.423639 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bcec3-ecd6-4b41-87e6-a0cb3def90f0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:49.438273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd30b9-cdd9-48d8-ba15-652f544b36a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:49.439207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd30b9-cdd9-48d8-ba15-652f544b36a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.439379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd30b9-cdd9-48d8-ba15-652f544b36a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.439826 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd30b9-cdd9-48d8-ba15-652f544b36a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.440534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd30b9-cdd9-48d8-ba15-652f544b36a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:49.446030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd30b9-cdd9-48d8-ba15-652f544b36a6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:49.455226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 891/1798] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:49.461249 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263a53b-4e32-41da-87bb-7063f79acc36 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:49.488398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 908/1799] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:49.488398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd30b9-cdd9-48d8-ba15-652f544b36a6 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:49.492233 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263a53b-4e32-41da-87bb-7063f79acc36 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:49.511511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8f2b9-65e7-480b-8b15-ea80a2c44322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:49.512071 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd30b9-cdd9-48d8-ba15-652f544b36a6 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:49.512391 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8f2b9-65e7-480b-8b15-ea80a2c44322 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.512694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8f2b9-65e7-480b-8b15-ea80a2c44322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.512970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8f2b9-65e7-480b-8b15-ea80a2c44322 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.513754 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8f2b9-65e7-480b-8b15-ea80a2c44322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:49.515724 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8f2b9-65e7-480b-8b15-ea80a2c44322 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:49.528645 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677c91b-a8fa-43fb-963a-5581682dace3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:49.529347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c91b-a8fa-43fb-963a-5581682dace3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.529701 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c91b-a8fa-43fb-963a-5581682dace3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.529979 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c91b-a8fa-43fb-963a-5581682dace3 admin admin] PATH_INFO: `/v3/projects/3fee3fa620964a01bc74b641e4c4b0f1/users/ece04e1bf55f4033a8c90679466e1254/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.566787 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677c91b-a8fa-43fb-963a-5581682dace3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fee3fa620964a01bc74b641e4c4b0f1, user_id=ece04e1bf55f4033a8c90679466e1254, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:49.569696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677c91b-a8fa-43fb-963a-5581682dace3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:49.597073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 892/1800] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:49 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:49.606315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8f2b9-65e7-480b-8b15-ea80a2c44322 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:49.627766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 909/1801] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:49 2022] PUT /identity/v3/projects/3fee3fa620964a01bc74b641e4c4b0f1/users/ece04e1bf55f4033a8c90679466e1254/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:49.633612 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:49.640814 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fbba5-361c-4e39-8fb3-b17e575788bd None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.641518 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fbba5-361c-4e39-8fb3-b17e575788bd None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.642070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fbba5-361c-4e39-8fb3-b17e575788bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.747526 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-584fbba5-361c-4e39-8fb3-b17e575788bd None None] MFA Rules not processed for user `ece04e1bf55f4033a8c90679466e1254`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:49.762775 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-584fbba5-361c-4e39-8fb3-b17e575788bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:49.815988 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8f2b9-65e7-480b-8b15-ea80a2c44322 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:49.829042 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1332e2-e3fc-4b0f-a4ba-30edefaa3a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:49.833422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1332e2-e3fc-4b0f-a4ba-30edefaa3a87 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.834811 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1332e2-e3fc-4b0f-a4ba-30edefaa3a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.835345 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1332e2-e3fc-4b0f-a4ba-30edefaa3a87 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.836621 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1332e2-e3fc-4b0f-a4ba-30edefaa3a87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:49.851485 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1332e2-e3fc-4b0f-a4ba-30edefaa3a87 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:49.914042 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 893/1802] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:49 2022] POST /identity/v3/users => generated 294 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:49.921499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1332e2-e3fc-4b0f-a4ba-30edefaa3a87 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:49.965909 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 910/1803] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:49.966165 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1332e2-e3fc-4b0f-a4ba-30edefaa3a87 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:49.972207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fbba5-361c-4e39-8fb3-b17e575788bd None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:49.983579 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8bcbe-5531-461c-b46d-175ad449bad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:49.984302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8bcbe-5531-461c-b46d-175ad449bad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:49.984582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8bcbe-5531-461c-b46d-175ad449bad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:49.984884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8bcbe-5531-461c-b46d-175ad449bad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:49.989642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8bcbe-5531-461c-b46d-175ad449bad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:49.991135 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fbba5-361c-4e39-8fb3-b17e575788bd None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:49.991599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8bcbe-5531-461c-b46d-175ad449bad7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:50.001901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868682-9084-4a99-8a38-395c39d786f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:50.004139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868682-9084-4a99-8a38-395c39d786f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:50.006405 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868682-9084-4a99-8a38-395c39d786f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:50.009728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868682-9084-4a99-8a38-395c39d786f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:50.012545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82868682-9084-4a99-8a38-395c39d786f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:50.020110 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82868682-9084-4a99-8a38-395c39d786f1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:50.030907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 894/1804] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:50.038257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8bcbe-5531-461c-b46d-175ad449bad7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:50.064877 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8bcbe-5531-461c-b46d-175ad449bad7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:50.082805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff288b37-d927-4509-9ef4-1d4b92787bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:50.083541 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff288b37-d927-4509-9ef4-1d4b92787bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:50.083846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff288b37-d927-4509-9ef4-1d4b92787bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:50.084118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff288b37-d927-4509-9ef4-1d4b92787bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:50.084782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff288b37-d927-4509-9ef4-1d4b92787bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:50.086557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff288b37-d927-4509-9ef4-1d4b92787bb7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:50.097708 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 911/1805] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:49 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:50.103217 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 895/1806] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:50.103585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868682-9084-4a99-8a38-395c39d786f1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:50.109914 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff288b37-d927-4509-9ef4-1d4b92787bb7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:50.136872 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff288b37-d927-4509-9ef4-1d4b92787bb7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:50.251145 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e5989-af3d-489f-8b19-d37564489bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:50.252333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e5989-af3d-489f-8b19-d37564489bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:50.252842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e5989-af3d-489f-8b19-d37564489bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:50.253589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e5989-af3d-489f-8b19-d37564489bfe admin admin] PATH_INFO: `/v3/projects/e6601b8b298e4b32ba4c6113872f8939/users/02e9460b6c6b4c4aae21aa7ec1372ef9/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:50.270684 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868682-9084-4a99-8a38-395c39d786f1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:50.278873 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e5989-af3d-489f-8b19-d37564489bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6601b8b298e4b32ba4c6113872f8939, user_id=02e9460b6c6b4c4aae21aa7ec1372ef9, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:50.284548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e5989-af3d-489f-8b19-d37564489bfe admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:50.285737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455407f-0aa4-4320-a9bd-1c06be99c6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:50.287794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455407f-0aa4-4320-a9bd-1c06be99c6a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:50.288185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455407f-0aa4-4320-a9bd-1c06be99c6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:50.288966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455407f-0aa4-4320-a9bd-1c06be99c6a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:50.291143 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455407f-0aa4-4320-a9bd-1c06be99c6a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:50.296590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455407f-0aa4-4320-a9bd-1c06be99c6a9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:50.326419 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 896/1807] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:50 2022] PUT /identity/v3/projects/e6601b8b298e4b32ba4c6113872f8939/users/02e9460b6c6b4c4aae21aa7ec1372ef9/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:50.327908 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e5989-af3d-489f-8b19-d37564489bfe admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:50.330197 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-090e5989-af3d-489f-8b19-d37564489bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:50.382634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 912/1808] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:50 2022] POST /identity/v3/users => generated 290 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:50.401860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605375f-2925-40aa-a709-1f773bc55f10 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:50.402385 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605375f-2925-40aa-a709-1f773bc55f10 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:50.402714 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605375f-2925-40aa-a709-1f773bc55f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:50.520957 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4605375f-2925-40aa-a709-1f773bc55f10 None None] MFA Rules not processed for user `02e9460b6c6b4c4aae21aa7ec1372ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:50.522489 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4605375f-2925-40aa-a709-1f773bc55f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:50.600422 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:50.672943 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e5989-af3d-489f-8b19-d37564489bfe admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:50.690331 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918efad0-e636-4216-a37e-0c4c1772fe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:50.691525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918efad0-e636-4216-a37e-0c4c1772fe86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:50.692051 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918efad0-e636-4216-a37e-0c4c1772fe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:50.692527 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918efad0-e636-4216-a37e-0c4c1772fe86 admin admin] PATH_INFO: `/v3/projects/ee728956e88c416d812eed539af3f84f` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:50.695065 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918efad0-e636-4216-a37e-0c4c1772fe86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee728956e88c416d812eed539af3f84f)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:50.697512 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918efad0-e636-4216-a37e-0c4c1772fe86 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:50.714962 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:50.845138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 913/1809] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:50.846445 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605375f-2925-40aa-a709-1f773bc55f10 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:50.855236 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-918efad0-e636-4216-a37e-0c4c1772fe86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee728956e88c416d812eed539af3f84f', 'request_id': 'req-918efad0-e636-4216-a37e-0c4c1772fe86'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:50.953984 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-918efad0-e636-4216-a37e-0c4c1772fe86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee728956e88c416d812eed539af3f84f', 'request_id': 'req-918efad0-e636-4216-a37e-0c4c1772fe86'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:50.988399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605375f-2925-40aa-a709-1f773bc55f10 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:50.991215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-918efad0-e636-4216-a37e-0c4c1772fe86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee728956e88c416d812eed539af3f84f', 'request_id': 'req-918efad0-e636-4216-a37e-0c4c1772fe86'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:51.054653 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-918efad0-e636-4216-a37e-0c4c1772fe86 admin admin] The token cache is being invalidate because project ee728956e88c416d812eed539af3f84f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:51.055210 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-918efad0-e636-4216-a37e-0c4c1772fe86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:51.058171 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-918efad0-e636-4216-a37e-0c4c1772fe86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:51.067142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 897/1810] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:50 2022] DELETE /identity/v3/projects/ee728956e88c416d812eed539af3f84f => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:51.077053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ed34c-3f68-46ed-9b91-9d7d06244824 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:51.077501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ed34c-3f68-46ed-9b91-9d7d06244824 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:51.077934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ed34c-3f68-46ed-9b91-9d7d06244824 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:51.079738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 898/1811] 10.222.0.52 () {54 vars in 921 bytes} [Mon Aug 29 20:31:51 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:51.082997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ed34c-3f68-46ed-9b91-9d7d06244824 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:51.093932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b74ed34c-3f68-46ed-9b91-9d7d06244824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:51.203116 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905d25b-26da-47dc-bcb5-e7d72b7cba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:51.203925 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905d25b-26da-47dc-bcb5-e7d72b7cba33 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:51.204421 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905d25b-26da-47dc-bcb5-e7d72b7cba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:51.204796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905d25b-26da-47dc-bcb5-e7d72b7cba33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:51.205633 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905d25b-26da-47dc-bcb5-e7d72b7cba33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:51.207494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905d25b-26da-47dc-bcb5-e7d72b7cba33 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:51.228736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 914/1812] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:51.228736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae5fbc-83a3-4a34-b166-ca3e13c22b95 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:51.228736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae5fbc-83a3-4a34-b166-ca3e13c22b95 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:51.228736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae5fbc-83a3-4a34-b166-ca3e13c22b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:51.278369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3dae5fbc-83a3-4a34-b166-ca3e13c22b95 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:51.279922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3dae5fbc-83a3-4a34-b166-ca3e13c22b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:51.293961 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 915/1813] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:51.295535 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae5fbc-83a3-4a34-b166-ca3e13c22b95 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:51.297801 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3dae5fbc-83a3-4a34-b166-ca3e13c22b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:51.365919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae5fbc-83a3-4a34-b166-ca3e13c22b95 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:51.376977 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb476a-98b0-4569-b236-d736f1b0d801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:51.378027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb476a-98b0-4569-b236-d736f1b0d801 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:51.378553 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb476a-98b0-4569-b236-d736f1b0d801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:51.379151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb476a-98b0-4569-b236-d736f1b0d801 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:51.380192 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb476a-98b0-4569-b236-d736f1b0d801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:51.384042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb476a-98b0-4569-b236-d736f1b0d801 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:51.409476 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 916/1814] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:51.411060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363147ef-106d-4a84-8ac9-6e43ff42697f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:51.411407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363147ef-106d-4a84-8ac9-6e43ff42697f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:51.413184 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363147ef-106d-4a84-8ac9-6e43ff42697f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:51.464759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-363147ef-106d-4a84-8ac9-6e43ff42697f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:51.469134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-363147ef-106d-4a84-8ac9-6e43ff42697f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:51.470119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ed34c-3f68-46ed-9b91-9d7d06244824 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:51.491120 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0e7f2-ca60-4779-8972-ef8817c121d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:51.495292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e7f2-ca60-4779-8972-ef8817c121d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:51.498561 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e7f2-ca60-4779-8972-ef8817c121d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:51.500810 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e7f2-ca60-4779-8972-ef8817c121d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:51.505337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 917/1815] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:51.506449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0e7f2-ca60-4779-8972-ef8817c121d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:51.513153 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99445b3a-f86e-4e56-92dc-2ce88e93074d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:51.513743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99445b3a-f86e-4e56-92dc-2ce88e93074d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:51.514338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99445b3a-f86e-4e56-92dc-2ce88e93074d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:51.517793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0e7f2-ca60-4779-8972-ef8817c121d1 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:51.571804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-99445b3a-f86e-4e56-92dc-2ce88e93074d None None] MFA Rules not processed for user `9c95d16fd4da4fa7987b893eae0b3ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:51.574461 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-99445b3a-f86e-4e56-92dc-2ce88e93074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:51.615135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 899/1816] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:51 2022] POST /identity/v3/projects => generated 385 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:51.616309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0e7f2-ca60-4779-8972-ef8817c121d1 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:51.622731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5fe0e7f2-ca60-4779-8972-ef8817c121d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:51.789590 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0e7f2-ca60-4779-8972-ef8817c121d1 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:51.806233 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221e175-d5b3-448a-997b-b81ee7e58dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:51.807608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221e175-d5b3-448a-997b-b81ee7e58dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:51.808248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221e175-d5b3-448a-997b-b81ee7e58dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:51.809040 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221e175-d5b3-448a-997b-b81ee7e58dbd admin admin] PATH_INFO: `/v3/projects/4a52d96099f94467a84c00a9115dc3fa` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:51.811445 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221e175-d5b3-448a-997b-b81ee7e58dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a52d96099f94467a84c00a9115dc3fa)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:51.816922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221e175-d5b3-448a-997b-b81ee7e58dbd admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:51.847995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 918/1817] 10.222.0.52 () {58 vars in 1018 bytes} [Mon Aug 29 20:31:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:51.849937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99445b3a-f86e-4e56-92dc-2ce88e93074d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:51.867250 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:51.869856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99445b3a-f86e-4e56-92dc-2ce88e93074d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:51.903044 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76639675-23f3-498c-84b9-a5d20fe5b609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:51.904773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76639675-23f3-498c-84b9-a5d20fe5b609 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:51.905311 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76639675-23f3-498c-84b9-a5d20fe5b609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:51.905624 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76639675-23f3-498c-84b9-a5d20fe5b609 admin admin] PATH_INFO: `/v3/projects/b1de817d7a2e44db9fff648c467f704c/users/2b7d704d8ebe494cac7df7e10f73b6e3/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:51.954578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9221e175-d5b3-448a-997b-b81ee7e58dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a52d96099f94467a84c00a9115dc3fa', 'request_id': 'req-9221e175-d5b3-448a-997b-b81ee7e58dbd'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:51.959451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76639675-23f3-498c-84b9-a5d20fe5b609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1de817d7a2e44db9fff648c467f704c, user_id=2b7d704d8ebe494cac7df7e10f73b6e3, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:51.966389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76639675-23f3-498c-84b9-a5d20fe5b609 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:51.974933 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9221e175-d5b3-448a-997b-b81ee7e58dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a52d96099f94467a84c00a9115dc3fa', 'request_id': 'req-9221e175-d5b3-448a-997b-b81ee7e58dbd'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:51.981609 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:51.985022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9221e175-d5b3-448a-997b-b81ee7e58dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a52d96099f94467a84c00a9115dc3fa', 'request_id': 'req-9221e175-d5b3-448a-997b-b81ee7e58dbd'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:52.003202 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9221e175-d5b3-448a-997b-b81ee7e58dbd admin admin] The token cache is being invalidate because project 4a52d96099f94467a84c00a9115dc3fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:52.003690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9221e175-d5b3-448a-997b-b81ee7e58dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:52.004590 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9221e175-d5b3-448a-997b-b81ee7e58dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:52.006851 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 900/1818] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:51 2022] DELETE /identity/v3/projects/4a52d96099f94467a84c00a9115dc3fa => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:52.007744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221e175-d5b3-448a-997b-b81ee7e58dbd admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:52.009227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9221e175-d5b3-448a-997b-b81ee7e58dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:52.015547 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 919/1819] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:51 2022] PUT /identity/v3/projects/b1de817d7a2e44db9fff648c467f704c/users/2b7d704d8ebe494cac7df7e10f73b6e3/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:52.015977 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76639675-23f3-498c-84b9-a5d20fe5b609 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:52.018075 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-76639675-23f3-498c-84b9-a5d20fe5b609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:52.107665 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221e175-d5b3-448a-997b-b81ee7e58dbd admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:52.204644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76639675-23f3-498c-84b9-a5d20fe5b609 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:52.207567 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25e750-a401-4c14-92e3-009a7c6e20e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:52.208740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25e750-a401-4c14-92e3-009a7c6e20e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:52.209524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25e750-a401-4c14-92e3-009a7c6e20e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:52.210416 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25e750-a401-4c14-92e3-009a7c6e20e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:52.211786 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25e750-a401-4c14-92e3-009a7c6e20e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:52.212454 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25e750-a401-4c14-92e3-009a7c6e20e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:52.213709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c66b28-851a-4c67-b57e-6714353d316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:52.214638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66b28-851a-4c67-b57e-6714353d316f admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:52.215330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66b28-851a-4c67-b57e-6714353d316f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:52.215931 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66b28-851a-4c67-b57e-6714353d316f admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:52.216476 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25e750-a401-4c14-92e3-009a7c6e20e6 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:52.217467 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c66b28-851a-4c67-b57e-6714353d316f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:52.221834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c66b28-851a-4c67-b57e-6714353d316f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:52.248209 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 901/1820] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:52.250171 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42e455-4450-44b8-a34b-a7137b236684 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:52.250696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42e455-4450-44b8-a34b-a7137b236684 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:52.251194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42e455-4450-44b8-a34b-a7137b236684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:52.278940 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 920/1821] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:52 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:52.287599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3158b58-adc8-43e1-914b-4352cfcc866f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:52.288676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3158b58-adc8-43e1-914b-4352cfcc866f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:52.289654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3158b58-adc8-43e1-914b-4352cfcc866f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:52.293816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-0f42e455-4450-44b8-a34b-a7137b236684 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:52.295891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0f42e455-4450-44b8-a34b-a7137b236684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:52.332181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 902/1822] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:52.332181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42e455-4450-44b8-a34b-a7137b236684 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:52.356982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42e455-4450-44b8-a34b-a7137b236684 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:52.376124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6179c5-8019-4e2c-b9f3-0a6bae503fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:52.377383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6179c5-8019-4e2c-b9f3-0a6bae503fff admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:52.377700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6179c5-8019-4e2c-b9f3-0a6bae503fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:52.378026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6179c5-8019-4e2c-b9f3-0a6bae503fff admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:52.378646 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6179c5-8019-4e2c-b9f3-0a6bae503fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:52.381006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6179c5-8019-4e2c-b9f3-0a6bae503fff admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:52.417911 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d3158b58-adc8-43e1-914b-4352cfcc866f None None] MFA Rules not processed for user `2b7d704d8ebe494cac7df7e10f73b6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:52.422155 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d3158b58-adc8-43e1-914b-4352cfcc866f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:52.465923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 903/1823] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:52 2022] POST /identity/v3/projects => generated 363 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:52.466986 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6179c5-8019-4e2c-b9f3-0a6bae503fff admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:52.476438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-af6179c5-8019-4e2c-b9f3-0a6bae503fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:52.528377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:52.551581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 921/1824] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:52.551581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3158b58-adc8-43e1-914b-4352cfcc866f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:52.563557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3158b58-adc8-43e1-914b-4352cfcc866f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:52.657145 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6179c5-8019-4e2c-b9f3-0a6bae503fff admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:52.663755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366374b-5411-4507-9a82-ba806e044cdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:52.664525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366374b-5411-4507-9a82-ba806e044cdc service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:52.664808 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366374b-5411-4507-9a82-ba806e044cdc service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:52.665105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366374b-5411-4507-9a82-ba806e044cdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:52.667099 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8366374b-5411-4507-9a82-ba806e044cdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:52.688341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366374b-5411-4507-9a82-ba806e044cdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:52.690510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366374b-5411-4507-9a82-ba806e044cdc service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:52.696121 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a63a4-cb98-48a2-bcf4-90eea700ed64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:52.696770 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a63a4-cb98-48a2-bcf4-90eea700ed64 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:52.697048 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a63a4-cb98-48a2-bcf4-90eea700ed64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:52.697321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a63a4-cb98-48a2-bcf4-90eea700ed64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:52.698009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a63a4-cb98-48a2-bcf4-90eea700ed64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:52.699682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a63a4-cb98-48a2-bcf4-90eea700ed64 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:52.718107 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 904/1825] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:52.719794 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec2df7-1e64-46e6-beec-5c743ad80240 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:52.719945 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec2df7-1e64-46e6-beec-5c743ad80240 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:52.720207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec2df7-1e64-46e6-beec-5c743ad80240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:52.727178 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 922/1826] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:52.728164 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a63a4-cb98-48a2-bcf4-90eea700ed64 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:52.730716 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2c8a63a4-cb98-48a2-bcf4-90eea700ed64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:52.748175 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a63a4-cb98-48a2-bcf4-90eea700ed64 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:52.756498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446cc11-3690-496d-9a9d-0a0b0ed5c836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:52.757349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446cc11-3690-496d-9a9d-0a0b0ed5c836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:52.757804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446cc11-3690-496d-9a9d-0a0b0ed5c836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:52.758151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446cc11-3690-496d-9a9d-0a0b0ed5c836 admin admin] PATH_INFO: `/v3/projects/1428ab6294724eddb6a18a007e954d93` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:52.759602 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446cc11-3690-496d-9a9d-0a0b0ed5c836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1428ab6294724eddb6a18a007e954d93)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:52.762915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446cc11-3690-496d-9a9d-0a0b0ed5c836 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:52.766561 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:52.783930 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-9aec2df7-1e64-46e6-beec-5c743ad80240 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:52.790117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9aec2df7-1e64-46e6-beec-5c743ad80240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:52.818763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 905/1827] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:52.820725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec2df7-1e64-46e6-beec-5c743ad80240 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:52.844419 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec2df7-1e64-46e6-beec-5c743ad80240 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:52.863134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2446cc11-3690-496d-9a9d-0a0b0ed5c836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1428ab6294724eddb6a18a007e954d93', 'request_id': 'req-2446cc11-3690-496d-9a9d-0a0b0ed5c836'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:52.875585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2446cc11-3690-496d-9a9d-0a0b0ed5c836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1428ab6294724eddb6a18a007e954d93', 'request_id': 'req-2446cc11-3690-496d-9a9d-0a0b0ed5c836'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:52.887102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2446cc11-3690-496d-9a9d-0a0b0ed5c836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1428ab6294724eddb6a18a007e954d93', 'request_id': 'req-2446cc11-3690-496d-9a9d-0a0b0ed5c836'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:52.901993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2446cc11-3690-496d-9a9d-0a0b0ed5c836 admin admin] The token cache is being invalidate because project 1428ab6294724eddb6a18a007e954d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:52.902559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2446cc11-3690-496d-9a9d-0a0b0ed5c836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:52.903566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2446cc11-3690-496d-9a9d-0a0b0ed5c836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:52.905901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 923/1828] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:52 2022] DELETE /identity/v3/projects/1428ab6294724eddb6a18a007e954d93 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:52.906896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446cc11-3690-496d-9a9d-0a0b0ed5c836 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:52.911926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2446cc11-3690-496d-9a9d-0a0b0ed5c836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:52.959759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200da4b3-16b1-41a9-89e8-9624c9e86aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:52.961009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200da4b3-16b1-41a9-89e8-9624c9e86aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:52.961554 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200da4b3-16b1-41a9-89e8-9624c9e86aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:52.962136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200da4b3-16b1-41a9-89e8-9624c9e86aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:52.964135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200da4b3-16b1-41a9-89e8-9624c9e86aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:52.967192 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200da4b3-16b1-41a9-89e8-9624c9e86aa5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:53.005763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 906/1829] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:52 2022] POST /identity/v3/users => generated 282 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:53.007923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200da4b3-16b1-41a9-89e8-9624c9e86aa5 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:53.010409 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446cc11-3690-496d-9a9d-0a0b0ed5c836 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:53.013776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-200da4b3-16b1-41a9-89e8-9624c9e86aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:53.018934 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442399ec-5b90-4e43-8646-c2aaf8830b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:53.020432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442399ec-5b90-4e43-8646-c2aaf8830b7c admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.020819 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442399ec-5b90-4e43-8646-c2aaf8830b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.021747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442399ec-5b90-4e43-8646-c2aaf8830b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.023187 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442399ec-5b90-4e43-8646-c2aaf8830b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:53.026419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442399ec-5b90-4e43-8646-c2aaf8830b7c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:53.031242 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200da4b3-16b1-41a9-89e8-9624c9e86aa5 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:53.042339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262b90d-3850-4ae1-b5a1-d55c486e62c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:53.044195 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262b90d-3850-4ae1-b5a1-d55c486e62c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.044965 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262b90d-3850-4ae1-b5a1-d55c486e62c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.046521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262b90d-3850-4ae1-b5a1-d55c486e62c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.050493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262b90d-3850-4ae1-b5a1-d55c486e62c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:53.053929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262b90d-3850-4ae1-b5a1-d55c486e62c9 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:53.075430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 907/1830] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:53.076468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262b90d-3850-4ae1-b5a1-d55c486e62c9 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:53.078674 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6262b90d-3850-4ae1-b5a1-d55c486e62c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:53.085874 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 924/1831] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:52 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:53.089868 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367e87b-94be-4842-ae7f-d09b9182d9f1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.091318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367e87b-94be-4842-ae7f-d09b9182d9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.091881 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367e87b-94be-4842-ae7f-d09b9182d9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.097791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262b90d-3850-4ae1-b5a1-d55c486e62c9 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:53.121092 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f367e87b-94be-4842-ae7f-d09b9182d9f1 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:53.122766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f367e87b-94be-4842-ae7f-d09b9182d9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:53.210264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51406ae6-f535-4afd-a45f-282ca5646cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:53.211546 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406ae6-f535-4afd-a45f-282ca5646cca admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.211975 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406ae6-f535-4afd-a45f-282ca5646cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.212400 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406ae6-f535-4afd-a45f-282ca5646cca admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.213445 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 925/1832] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:53.215282 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367e87b-94be-4842-ae7f-d09b9182d9f1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:53.217518 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f367e87b-94be-4842-ae7f-d09b9182d9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:53.222454 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51406ae6-f535-4afd-a45f-282ca5646cca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:53.223774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51406ae6-f535-4afd-a45f-282ca5646cca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:53.229492 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51406ae6-f535-4afd-a45f-282ca5646cca admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:53.241291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367e87b-94be-4842-ae7f-d09b9182d9f1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:53.248623 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bbbf6-87d5-400b-82ed-dc0b2b62206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:53.249535 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bbbf6-87d5-400b-82ed-dc0b2b62206c admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.249882 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bbbf6-87d5-400b-82ed-dc0b2b62206c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.250214 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bbbf6-87d5-400b-82ed-dc0b2b62206c admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.251703 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bbbf6-87d5-400b-82ed-dc0b2b62206c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:53.253673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bbbf6-87d5-400b-82ed-dc0b2b62206c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:53.272090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 908/1833] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:53.273980 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 926/1834] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:53.275926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bbbf6-87d5-400b-82ed-dc0b2b62206c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:53.276295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51406ae6-f535-4afd-a45f-282ca5646cca admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:53.292338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bbbf6-87d5-400b-82ed-dc0b2b62206c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:53.299648 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03496e3-0056-4179-9982-a11e66f20525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:53.299970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03496e3-0056-4179-9982-a11e66f20525 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.300189 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03496e3-0056-4179-9982-a11e66f20525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.300607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03496e3-0056-4179-9982-a11e66f20525 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.301628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03496e3-0056-4179-9982-a11e66f20525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:53.303559 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51406ae6-f535-4afd-a45f-282ca5646cca admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:53.304425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03496e3-0056-4179-9982-a11e66f20525 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:53.313450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7b641-7364-4258-9e28-5de4d5ebe4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:53.315724 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7b641-7364-4258-9e28-5de4d5ebe4b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.316360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7b641-7364-4258-9e28-5de4d5ebe4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.316897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7b641-7364-4258-9e28-5de4d5ebe4b2 admin admin] PATH_INFO: `/v3/projects/ec41f37cb11c4784a2c6edaeb522ffaa/users/0e83a1564ca94ca6b12bc1b37d9431aa/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.327949 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:53.365680 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:53.373320 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 927/1835] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:53 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:53.376905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7b641-7364-4258-9e28-5de4d5ebe4b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec41f37cb11c4784a2c6edaeb522ffaa, user_id=0e83a1564ca94ca6b12bc1b37d9431aa, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:53.377652 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73fa92-b6e8-44ff-bbdd-ee3e33afa666 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.381660 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73fa92-b6e8-44ff-bbdd-ee3e33afa666 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.382430 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73fa92-b6e8-44ff-bbdd-ee3e33afa666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.385713 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7b641-7364-4258-9e28-5de4d5ebe4b2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:53.436840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 909/1836] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:53 2022] PUT /identity/v3/projects/ec41f37cb11c4784a2c6edaeb522ffaa/users/0e83a1564ca94ca6b12bc1b37d9431aa/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:53.445623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7b641-7364-4258-9e28-5de4d5ebe4b2 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:53.459479 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-bf73fa92-b6e8-44ff-bbdd-ee3e33afa666 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:53.463230 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bf73fa92-b6e8-44ff-bbdd-ee3e33afa666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:53.593294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 928/1837] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:53.596119 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73fa92-b6e8-44ff-bbdd-ee3e33afa666 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:53.625776 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73fa92-b6e8-44ff-bbdd-ee3e33afa666 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:53.635274 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542e0d0-53c0-42a7-b6cd-4cf990be8301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:53.636504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542e0d0-53c0-42a7-b6cd-4cf990be8301 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.637136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542e0d0-53c0-42a7-b6cd-4cf990be8301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.638255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542e0d0-53c0-42a7-b6cd-4cf990be8301 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.639661 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542e0d0-53c0-42a7-b6cd-4cf990be8301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:53.644133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542e0d0-53c0-42a7-b6cd-4cf990be8301 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:53.649997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7b641-7364-4258-9e28-5de4d5ebe4b2 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:53.675932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 929/1838] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:53.675932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542e0d0-53c0-42a7-b6cd-4cf990be8301 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:53.677541 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3b29d-5578-4dfa-974f-0f88f67a01fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:53.678233 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3b29d-5578-4dfa-974f-0f88f67a01fb admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.678512 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3b29d-5578-4dfa-974f-0f88f67a01fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.678854 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3b29d-5578-4dfa-974f-0f88f67a01fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.679434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3b29d-5578-4dfa-974f-0f88f67a01fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:53.681856 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3b29d-5578-4dfa-974f-0f88f67a01fb admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:53.710120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542e0d0-53c0-42a7-b6cd-4cf990be8301 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:53.719526 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c664f-b755-46f5-bb20-fb71a52e68f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:53.720550 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c664f-b755-46f5-bb20-fb71a52e68f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.721112 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c664f-b755-46f5-bb20-fb71a52e68f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.721624 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c664f-b755-46f5-bb20-fb71a52e68f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.722764 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c664f-b755-46f5-bb20-fb71a52e68f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:53.724155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 910/1839] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:53 2022] POST /identity/v3/projects => generated 385 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:53.725189 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68c92-fff7-4972-b11c-79234d7d995f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.725536 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68c92-fff7-4972-b11c-79234d7d995f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.725816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68c92-fff7-4972-b11c-79234d7d995f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.726854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c664f-b755-46f5-bb20-fb71a52e68f0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:53.753812 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 930/1840] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:53.753812 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c664f-b755-46f5-bb20-fb71a52e68f0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:53.790827 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c664f-b755-46f5-bb20-fb71a52e68f0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:53.801177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e2f68c92-fff7-4972-b11c-79234d7d995f None None] MFA Rules not processed for user `0e83a1564ca94ca6b12bc1b37d9431aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:53.803275 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e2f68c92-fff7-4972-b11c-79234d7d995f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:53.873785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28cd4f-cf3a-45ef-aea4-675465135000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:53.874476 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28cd4f-cf3a-45ef-aea4-675465135000 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.874716 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28cd4f-cf3a-45ef-aea4-675465135000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.875067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28cd4f-cf3a-45ef-aea4-675465135000 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.876351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28cd4f-cf3a-45ef-aea4-675465135000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:31:53.877070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28cd4f-cf3a-45ef-aea4-675465135000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:53.879675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28cd4f-cf3a-45ef-aea4-675465135000 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:53.903964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 931/1841] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:31:53.906530 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28cd4f-cf3a-45ef-aea4-675465135000 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:53.925589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28cd4f-cf3a-45ef-aea4-675465135000 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:53.927552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 911/1842] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:53.928852 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f68c92-fff7-4972-b11c-79234d7d995f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:53.932590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57377b-a1dd-4d98-8b8e-a742b9ba9c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:53.933292 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57377b-a1dd-4d98-8b8e-a742b9ba9c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.933625 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57377b-a1dd-4d98-8b8e-a742b9ba9c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.933901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57377b-a1dd-4d98-8b8e-a742b9ba9c8f admin admin] PATH_INFO: `/v3/projects/c55e5745e6ac47f993ae34a4888b3dcc/users/33afe9c143ae4aa1a8d0f51660b24a7a/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.942369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f68c92-fff7-4972-b11c-79234d7d995f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:53.952834 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80ecc0-44ad-4c24-8171-5ccd522b5d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:53.953870 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80ecc0-44ad-4c24-8171-5ccd522b5d8e admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:53.953988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57377b-a1dd-4d98-8b8e-a742b9ba9c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c55e5745e6ac47f993ae34a4888b3dcc, user_id=33afe9c143ae4aa1a8d0f51660b24a7a, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:53.954341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80ecc0-44ad-4c24-8171-5ccd522b5d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:53.954802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80ecc0-44ad-4c24-8171-5ccd522b5d8e admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:53.956625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80ecc0-44ad-4c24-8171-5ccd522b5d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:53.957488 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57377b-a1dd-4d98-8b8e-a742b9ba9c8f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:53.962332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80ecc0-44ad-4c24-8171-5ccd522b5d8e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:53.982667 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 932/1843] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:53 2022] PUT /identity/v3/projects/c55e5745e6ac47f993ae34a4888b3dcc/users/33afe9c143ae4aa1a8d0f51660b24a7a/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:53.983822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57377b-a1dd-4d98-8b8e-a742b9ba9c8f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:54.007476 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 912/1844] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:53 2022] POST /identity/v3/users => generated 293 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:54.009749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80ecc0-44ad-4c24-8171-5ccd522b5d8e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:54.030671 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80ecc0-44ad-4c24-8171-5ccd522b5d8e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:54.052899 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:54.105230 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57377b-a1dd-4d98-8b8e-a742b9ba9c8f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:54.113812 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ddcb1-380f-473c-aaf4-13ff915f8d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:54.115506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ddcb1-380f-473c-aaf4-13ff915f8d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.116218 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ddcb1-380f-473c-aaf4-13ff915f8d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.116917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ddcb1-380f-473c-aaf4-13ff915f8d0d admin admin] PATH_INFO: `/v3/projects/de989dab400b4ba69d24a13b338067b5/users/6b309d2eafaa42c384790787536a6ead/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.146363 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:54.149755 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ddcb1-380f-473c-aaf4-13ff915f8d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de989dab400b4ba69d24a13b338067b5, user_id=6b309d2eafaa42c384790787536a6ead, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:54.154877 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ddcb1-380f-473c-aaf4-13ff915f8d0d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:54.199777 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 933/1845] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:53 2022] PUT /identity/v3/projects/de989dab400b4ba69d24a13b338067b5/users/6b309d2eafaa42c384790787536a6ead/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:54.201937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ddcb1-380f-473c-aaf4-13ff915f8d0d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:54.235722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0aa27-432a-4ae4-b0e9-2677862f530f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:54.236357 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0aa27-432a-4ae4-b0e9-2677862f530f admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.236789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0aa27-432a-4ae4-b0e9-2677862f530f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.237314 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0aa27-432a-4ae4-b0e9-2677862f530f admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.240833 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0aa27-432a-4ae4-b0e9-2677862f530f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:54.247197 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0aa27-432a-4ae4-b0e9-2677862f530f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:54.322180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 913/1846] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:54 2022] POST /identity/v3/projects => generated 387 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:54.323793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8d597-3539-4d7d-9b38-4dff8df00072 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.324779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8d597-3539-4d7d-9b38-4dff8df00072 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.325585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8d597-3539-4d7d-9b38-4dff8df00072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.356480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ddcb1-380f-473c-aaf4-13ff915f8d0d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:54.399901 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-cdf8d597-3539-4d7d-9b38-4dff8df00072 None None] MFA Rules not processed for user `33afe9c143ae4aa1a8d0f51660b24a7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:54.401855 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-cdf8d597-3539-4d7d-9b38-4dff8df00072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:54.471426 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65d560-de9a-48a9-babf-b50e8d56da82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:54.472437 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65d560-de9a-48a9-babf-b50e8d56da82 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.472919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65d560-de9a-48a9-babf-b50e8d56da82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.473423 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65d560-de9a-48a9-babf-b50e8d56da82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.474522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65d560-de9a-48a9-babf-b50e8d56da82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:54.477628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65d560-de9a-48a9-babf-b50e8d56da82 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:54.529305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 934/1847] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:54 2022] POST /identity/v3/projects => generated 387 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:54.530667 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65d560-de9a-48a9-babf-b50e8d56da82 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:54.549401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 914/1848] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:54.551916 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8d597-3539-4d7d-9b38-4dff8df00072 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:54.576847 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8d597-3539-4d7d-9b38-4dff8df00072 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:54.683746 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:54.692185 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701adf1-c768-45e6-b790-16926ecc2747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:54.693284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701adf1-c768-45e6-b790-16926ecc2747 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.693816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701adf1-c768-45e6-b790-16926ecc2747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.694284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701adf1-c768-45e6-b790-16926ecc2747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.695279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701adf1-c768-45e6-b790-16926ecc2747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:54.712490 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65d560-de9a-48a9-babf-b50e8d56da82 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:54.719429 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701adf1-c768-45e6-b790-16926ecc2747 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:54.723782 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0903ef-ddf2-4f53-ba26-24a6dd85cf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:54.725341 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0903ef-ddf2-4f53-ba26-24a6dd85cf77 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.725735 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0903ef-ddf2-4f53-ba26-24a6dd85cf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.726116 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0903ef-ddf2-4f53-ba26-24a6dd85cf77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.727507 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0903ef-ddf2-4f53-ba26-24a6dd85cf77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:54.731091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0903ef-ddf2-4f53-ba26-24a6dd85cf77 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:54.758795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 915/1849] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:54.761032 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701adf1-c768-45e6-b790-16926ecc2747 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:54.769777 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 935/1850] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:54.771339 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0903ef-ddf2-4f53-ba26-24a6dd85cf77 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:54.789714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701adf1-c768-45e6-b790-16926ecc2747 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:54.802447 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0903ef-ddf2-4f53-ba26-24a6dd85cf77 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:54.802736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cfe05-63c4-4263-8325-44461874ad6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:54.803430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cfe05-63c4-4263-8325-44461874ad6e admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.803430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cfe05-63c4-4263-8325-44461874ad6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.803731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cfe05-63c4-4263-8325-44461874ad6e admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.804780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909cfe05-63c4-4263-8325-44461874ad6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:54.806813 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909cfe05-63c4-4263-8325-44461874ad6e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:54.817599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00063405-ff39-47d5-b51b-e77de00db09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:54.818606 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00063405-ff39-47d5-b51b-e77de00db09d admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.819047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00063405-ff39-47d5-b51b-e77de00db09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.819409 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00063405-ff39-47d5-b51b-e77de00db09d admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.820522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00063405-ff39-47d5-b51b-e77de00db09d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:54.824089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00063405-ff39-47d5-b51b-e77de00db09d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:54.851464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 916/1851] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:54 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:54.851464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cfe05-63c4-4263-8325-44461874ad6e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:54.874807 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cfe05-63c4-4263-8325-44461874ad6e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:54.880226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3215a9-c570-4f27-ab0c-a58a123870e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:54.881448 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3215a9-c570-4f27-ab0c-a58a123870e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.881822 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3215a9-c570-4f27-ab0c-a58a123870e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.882155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3215a9-c570-4f27-ab0c-a58a123870e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.883006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3215a9-c570-4f27-ab0c-a58a123870e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:54.887775 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 936/1852] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:54 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:54.888250 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3215a9-c570-4f27-ab0c-a58a123870e2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:54.888395 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00063405-ff39-47d5-b51b-e77de00db09d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:54.924830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00063405-ff39-47d5-b51b-e77de00db09d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:54.933505 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 917/1853] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:54 2022] POST /identity/v3/projects => generated 363 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:54.934860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3215a9-c570-4f27-ab0c-a58a123870e2 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:54.943357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589d3ad-8eab-4a6b-9739-130540dc4ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:54.944172 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589d3ad-8eab-4a6b-9739-130540dc4ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:54.944601 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589d3ad-8eab-4a6b-9739-130540dc4ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:54.944938 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589d3ad-8eab-4a6b-9739-130540dc4ec0 admin admin] PATH_INFO: `/v3/projects/de989dab400b4ba69d24a13b338067b5/users/6b309d2eafaa42c384790787536a6ead/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:54.954922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589d3ad-8eab-4a6b-9739-130540dc4ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de989dab400b4ba69d24a13b338067b5, user_id=6b309d2eafaa42c384790787536a6ead, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:54.959267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589d3ad-8eab-4a6b-9739-130540dc4ec0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:54.968150 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:55.001327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 937/1854] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:54 2022] PUT /identity/v3/projects/de989dab400b4ba69d24a13b338067b5/users/6b309d2eafaa42c384790787536a6ead/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:55.003003 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589d3ad-8eab-4a6b-9739-130540dc4ec0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:55.080359 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3215a9-c570-4f27-ab0c-a58a123870e2 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.165724 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589d3ad-8eab-4a6b-9739-130540dc4ec0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.165724 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454fc53-be9c-4786-a4c5-6b03cc07bf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.166886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454fc53-be9c-4786-a4c5-6b03cc07bf08 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.167178 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454fc53-be9c-4786-a4c5-6b03cc07bf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.167738 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454fc53-be9c-4786-a4c5-6b03cc07bf08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.169691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454fc53-be9c-4786-a4c5-6b03cc07bf08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.173985 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454fc53-be9c-4786-a4c5-6b03cc07bf08 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:55.196667 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 938/1855] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:55.198249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454fc53-be9c-4786-a4c5-6b03cc07bf08 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:55.212757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04266ce-2835-43f9-839e-3966be1ef40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.213882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04266ce-2835-43f9-839e-3966be1ef40c admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.214336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04266ce-2835-43f9-839e-3966be1ef40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.214646 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04266ce-2835-43f9-839e-3966be1ef40c admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.215704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04266ce-2835-43f9-839e-3966be1ef40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.217740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04266ce-2835-43f9-839e-3966be1ef40c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:55.218382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454fc53-be9c-4786-a4c5-6b03cc07bf08 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.225604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5e7f1-9963-4e82-a015-bf44cad880ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.226925 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5e7f1-9963-4e82-a015-bf44cad880ec admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.227315 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5e7f1-9963-4e82-a015-bf44cad880ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.227741 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5e7f1-9963-4e82-a015-bf44cad880ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.228772 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5e7f1-9963-4e82-a015-bf44cad880ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.231053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5e7f1-9963-4e82-a015-bf44cad880ec admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:55.237656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 918/1856] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:55.239347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04266ce-2835-43f9-839e-3966be1ef40c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:55.253211 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04266ce-2835-43f9-839e-3966be1ef40c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.261521 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 939/1857] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:55.262126 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da755d0-f003-4648-ba6e-87e5bde7108e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.262281 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da755d0-f003-4648-ba6e-87e5bde7108e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.262555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da755d0-f003-4648-ba6e-87e5bde7108e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.270507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323fde7-1970-4e7e-87aa-70114598fd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.271706 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323fde7-1970-4e7e-87aa-70114598fd4d admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.272585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323fde7-1970-4e7e-87aa-70114598fd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.274508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323fde7-1970-4e7e-87aa-70114598fd4d admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.275405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323fde7-1970-4e7e-87aa-70114598fd4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.278054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323fde7-1970-4e7e-87aa-70114598fd4d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:55.299503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5da755d0-f003-4648-ba6e-87e5bde7108e None None] MFA Rules not processed for user `6b309d2eafaa42c384790787536a6ead`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:55.300976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5da755d0-f003-4648-ba6e-87e5bde7108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:55.318510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 919/1858] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:55 2022] POST /identity/v3/users => generated 288 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:55.321431 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323fde7-1970-4e7e-87aa-70114598fd4d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:55.361774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323fde7-1970-4e7e-87aa-70114598fd4d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.369697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd2d27-af60-4b59-a3fe-41f4d0340c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.370894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd2d27-af60-4b59-a3fe-41f4d0340c66 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.371463 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd2d27-af60-4b59-a3fe-41f4d0340c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.372372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd2d27-af60-4b59-a3fe-41f4d0340c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.373614 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd2d27-af60-4b59-a3fe-41f4d0340c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.376744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd2d27-af60-4b59-a3fe-41f4d0340c66 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:55.444611 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 920/1859] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:55.446976 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd2d27-af60-4b59-a3fe-41f4d0340c66 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:55.455559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 940/1860] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:55.455559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da755d0-f003-4648-ba6e-87e5bde7108e None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:55.476669 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd2d27-af60-4b59-a3fe-41f4d0340c66 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.484119 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da755d0-f003-4648-ba6e-87e5bde7108e None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.490456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa7115-9ad4-4801-a8f3-77c3cbecd1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.490980 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559eecdd-019b-49a3-866a-d23efb21a3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.491573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7115-9ad4-4801-a8f3-77c3cbecd1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.491883 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eecdd-019b-49a3-866a-d23efb21a3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.492045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7115-9ad4-4801-a8f3-77c3cbecd1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.492187 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eecdd-019b-49a3-866a-d23efb21a3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.492477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eecdd-019b-49a3-866a-d23efb21a3c3 admin admin] PATH_INFO: `/v3/projects/0e35db9f98774b40b4f09467c6879589/users/5221b25ea86c4b66a5d7357ee9ed8c93/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.492639 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7115-9ad4-4801-a8f3-77c3cbecd1ee admin admin] PATH_INFO: `/v3/projects/8796b40d8e48425da4db4e1111cd1b45/users/611edac0ea904803889b167e4f38da42/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.517779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559eecdd-019b-49a3-866a-d23efb21a3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e35db9f98774b40b4f09467c6879589, user_id=5221b25ea86c4b66a5d7357ee9ed8c93, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.520742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559eecdd-019b-49a3-866a-d23efb21a3c3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:55.522222 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa7115-9ad4-4801-a8f3-77c3cbecd1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8796b40d8e48425da4db4e1111cd1b45, user_id=611edac0ea904803889b167e4f38da42, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.527530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa7115-9ad4-4801-a8f3-77c3cbecd1ee admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:55.541683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 941/1861] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:55 2022] PUT /identity/v3/projects/0e35db9f98774b40b4f09467c6879589/users/5221b25ea86c4b66a5d7357ee9ed8c93/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:55.544037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559eecdd-019b-49a3-866a-d23efb21a3c3 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:55.563693 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 921/1862] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:55 2022] PUT /identity/v3/projects/8796b40d8e48425da4db4e1111cd1b45/users/611edac0ea904803889b167e4f38da42/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:55.563921 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:55.564009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa7115-9ad4-4801-a8f3-77c3cbecd1ee admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:55.648507 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559eecdd-019b-49a3-866a-d23efb21a3c3 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.681449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa7115-9ad4-4801-a8f3-77c3cbecd1ee admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.689872 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8582d-497a-4150-aaa5-5ac287f092e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.690893 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8582d-497a-4150-aaa5-5ac287f092e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.691272 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8582d-497a-4150-aaa5-5ac287f092e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.691658 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8582d-497a-4150-aaa5-5ac287f092e7 admin admin] PATH_INFO: `/v3/projects/dee9648f0c774ec18336058b79824698/users/321c6cd1123b44f88b864a4796d6b1bc/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.716933 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:55.724012 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8582d-497a-4150-aaa5-5ac287f092e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee9648f0c774ec18336058b79824698, user_id=321c6cd1123b44f88b864a4796d6b1bc, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.729295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8582d-497a-4150-aaa5-5ac287f092e7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:55.739337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c94c4-04a1-4eb0-952e-5d47104dd9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.740977 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c94c4-04a1-4eb0-952e-5d47104dd9ee admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.741295 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c94c4-04a1-4eb0-952e-5d47104dd9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.741668 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c94c4-04a1-4eb0-952e-5d47104dd9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.742448 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c94c4-04a1-4eb0-952e-5d47104dd9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.746897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c94c4-04a1-4eb0-952e-5d47104dd9ee admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:55.755493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 922/1863] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:55 2022] PUT /identity/v3/projects/dee9648f0c774ec18336058b79824698/users/321c6cd1123b44f88b864a4796d6b1bc/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:55.757011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8582d-497a-4150-aaa5-5ac287f092e7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:55.760142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-51d8582d-497a-4150-aaa5-5ac287f092e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:55.774625 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 942/1864] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:55.776163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c94c4-04a1-4eb0-952e-5d47104dd9ee admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:55.795858 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c94c4-04a1-4eb0-952e-5d47104dd9ee admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.843405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8582d-497a-4150-aaa5-5ac287f092e7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:55.852548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934b6db-977e-4f44-823e-5cd75573fce3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.853476 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934b6db-977e-4f44-823e-5cd75573fce3 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.853890 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934b6db-977e-4f44-823e-5cd75573fce3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.854201 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934b6db-977e-4f44-823e-5cd75573fce3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.898845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e6037-e023-4d0a-8299-5eb284f3b76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:55.900084 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e6037-e023-4d0a-8299-5eb284f3b76c admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.900566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e6037-e023-4d0a-8299-5eb284f3b76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.901089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e6037-e023-4d0a-8299-5eb284f3b76c admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.902143 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e6037-e023-4d0a-8299-5eb284f3b76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:55.905080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e6037-e023-4d0a-8299-5eb284f3b76c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:55.924296 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 943/1865] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:55.926155 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94f3b0-5ca0-4107-b621-32a465741aee None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:55.926565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94f3b0-5ca0-4107-b621-32a465741aee None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:55.926935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94f3b0-5ca0-4107-b621-32a465741aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:55.972248 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2e94f3b0-5ca0-4107-b621-32a465741aee None None] MFA Rules not processed for user `611edac0ea904803889b167e4f38da42`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:55.974715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2e94f3b0-5ca0-4107-b621-32a465741aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:56.015457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934b6db-977e-4f44-823e-5cd75573fce3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:56.018239 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934b6db-977e-4f44-823e-5cd75573fce3 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:56.035737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 923/1866] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:56.038137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b48d7-b7e0-42fb-a1bd-701209f44fdd None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.038813 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b48d7-b7e0-42fb-a1bd-701209f44fdd None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.039436 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b48d7-b7e0-42fb-a1bd-701209f44fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.044755 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:56.125244 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 944/1867] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:56.126322 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94f3b0-5ca0-4107-b621-32a465741aee None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:56.129011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d30b48d7-b7e0-42fb-a1bd-701209f44fdd None None] MFA Rules not processed for user `321c6cd1123b44f88b864a4796d6b1bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:56.133503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d30b48d7-b7e0-42fb-a1bd-701209f44fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:56.170026 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94f3b0-5ca0-4107-b621-32a465741aee None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:56.191734 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5911d-69bc-4c8e-a6f7-9d5943c8b73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:56.193554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5911d-69bc-4c8e-a6f7-9d5943c8b73f admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.194353 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5911d-69bc-4c8e-a6f7-9d5943c8b73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.194792 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5911d-69bc-4c8e-a6f7-9d5943c8b73f admin admin] PATH_INFO: `/v3/projects/c76fed412a1342ab8b6718892a1ca427/users/f7ea81fb74014917ac26e67260303a84/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.252697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5911d-69bc-4c8e-a6f7-9d5943c8b73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76fed412a1342ab8b6718892a1ca427, user_id=f7ea81fb74014917ac26e67260303a84, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:56.258539 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5911d-69bc-4c8e-a6f7-9d5943c8b73f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:56.300533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 945/1868] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:56 2022] PUT /identity/v3/projects/c76fed412a1342ab8b6718892a1ca427/users/f7ea81fb74014917ac26e67260303a84/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:56.305429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5911d-69bc-4c8e-a6f7-9d5943c8b73f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:56.359984 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 924/1869] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:56.365454 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b48d7-b7e0-42fb-a1bd-701209f44fdd None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:56.365454 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d30b48d7-b7e0-42fb-a1bd-701209f44fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:56.393506 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b48d7-b7e0-42fb-a1bd-701209f44fdd None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:56.447039 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:56.507801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897bfcc-8851-42f7-8568-45e0ad7fe825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:56.508534 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897bfcc-8851-42f7-8568-45e0ad7fe825 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.508872 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897bfcc-8851-42f7-8568-45e0ad7fe825 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.509210 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897bfcc-8851-42f7-8568-45e0ad7fe825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.518455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5897bfcc-8851-42f7-8568-45e0ad7fe825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:56.528885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5911d-69bc-4c8e-a6f7-9d5943c8b73f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:56.542444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87e557-9ede-4c4b-b5e7-9d374fceb7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:56.544928 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87e557-9ede-4c4b-b5e7-9d374fceb7b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.545822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87e557-9ede-4c4b-b5e7-9d374fceb7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.546616 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87e557-9ede-4c4b-b5e7-9d374fceb7b8 admin admin] PATH_INFO: `/v3/projects/0e35db9f98774b40b4f09467c6879589/users/5221b25ea86c4b66a5d7357ee9ed8c93/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.550775 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87e557-9ede-4c4b-b5e7-9d374fceb7b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e35db9f98774b40b4f09467c6879589, user_id=5221b25ea86c4b66a5d7357ee9ed8c93, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:56.557677 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87e557-9ede-4c4b-b5e7-9d374fceb7b8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:56.582884 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 946/1870] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:56 2022] PUT /identity/v3/projects/0e35db9f98774b40b4f09467c6879589/users/5221b25ea86c4b66a5d7357ee9ed8c93/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:56.585103 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87e557-9ede-4c4b-b5e7-9d374fceb7b8 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:56.714852 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897bfcc-8851-42f7-8568-45e0ad7fe825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:56.717461 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897bfcc-8851-42f7-8568-45e0ad7fe825 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:56.737504 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 925/1871] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:56.739361 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897bfcc-8851-42f7-8568-45e0ad7fe825 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:56.760863 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897bfcc-8851-42f7-8568-45e0ad7fe825 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:56.769847 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121822c6-0b03-42f0-babd-caacde67129d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:56.770957 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121822c6-0b03-42f0-babd-caacde67129d admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.772500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121822c6-0b03-42f0-babd-caacde67129d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.772500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121822c6-0b03-42f0-babd-caacde67129d admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.773479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121822c6-0b03-42f0-babd-caacde67129d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:56.776939 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121822c6-0b03-42f0-babd-caacde67129d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:56.787338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87e557-9ede-4c4b-b5e7-9d374fceb7b8 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:56.804659 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52128d-442b-4b4b-a0d1-e63dc6abb04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:56.805293 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52128d-442b-4b4b-a0d1-e63dc6abb04c admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.805618 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52128d-442b-4b4b-a0d1-e63dc6abb04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.805880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52128d-442b-4b4b-a0d1-e63dc6abb04c admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.806523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52128d-442b-4b4b-a0d1-e63dc6abb04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:56.808459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52128d-442b-4b4b-a0d1-e63dc6abb04c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:56.825572 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 926/1872] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:56.827516 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121822c6-0b03-42f0-babd-caacde67129d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:56.848760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121822c6-0b03-42f0-babd-caacde67129d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:56.864913 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe1c13-f5c1-48a2-91e5-23566f8d3b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:56.871235 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe1c13-f5c1-48a2-91e5-23566f8d3b34 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.871819 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe1c13-f5c1-48a2-91e5-23566f8d3b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.872264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe1c13-f5c1-48a2-91e5-23566f8d3b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.876931 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 947/1873] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:56 2022] POST /identity/v3/projects => generated 387 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:56.877266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe1c13-f5c1-48a2-91e5-23566f8d3b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:56.878569 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982edb3-42bc-45fb-97c3-fc3879c753e2 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:56.878862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982edb3-42bc-45fb-97c3-fc3879c753e2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:56.879436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982edb3-42bc-45fb-97c3-fc3879c753e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:56.886875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe1c13-f5c1-48a2-91e5-23566f8d3b34 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:56.930911 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e982edb3-42bc-45fb-97c3-fc3879c753e2 None None] MFA Rules not processed for user `5221b25ea86c4b66a5d7357ee9ed8c93`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:56.932538 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e982edb3-42bc-45fb-97c3-fc3879c753e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:56.975866 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:56.993544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 927/1874] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:31:56 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:56.993544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe1c13-f5c1-48a2-91e5-23566f8d3b34 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.120849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe1c13-f5c1-48a2-91e5-23566f8d3b34 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.127614 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c71693-c1ec-44d9-890a-3f9e134a667f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.128670 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c71693-c1ec-44d9-890a-3f9e134a667f admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.129169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c71693-c1ec-44d9-890a-3f9e134a667f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.129886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c71693-c1ec-44d9-890a-3f9e134a667f admin admin] PATH_INFO: `/v3/projects/c76fed412a1342ab8b6718892a1ca427/users/f7ea81fb74014917ac26e67260303a84/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.133350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c71693-c1ec-44d9-890a-3f9e134a667f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76fed412a1342ab8b6718892a1ca427, user_id=f7ea81fb74014917ac26e67260303a84, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.137334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c71693-c1ec-44d9-890a-3f9e134a667f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.156773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 928/1875] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:56 2022] PUT /identity/v3/projects/c76fed412a1342ab8b6718892a1ca427/users/f7ea81fb74014917ac26e67260303a84/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:57.158176 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c71693-c1ec-44d9-890a-3f9e134a667f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.201241 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 948/1876] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:57.201241 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982edb3-42bc-45fb-97c3-fc3879c753e2 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.318386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:57.396351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c71693-c1ec-44d9-890a-3f9e134a667f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.406813 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c63167-0ddb-4886-adc8-6a2f3f01f989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.407593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c63167-0ddb-4886-adc8-6a2f3f01f989 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.409208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982edb3-42bc-45fb-97c3-fc3879c753e2 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.409763 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c63167-0ddb-4886-adc8-6a2f3f01f989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.410077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c63167-0ddb-4886-adc8-6a2f3f01f989 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.411334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c63167-0ddb-4886-adc8-6a2f3f01f989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.413616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c63167-0ddb-4886-adc8-6a2f3f01f989 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.420093 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12295e-5c9e-404d-bf2b-0352a3856063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.421181 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12295e-5c9e-404d-bf2b-0352a3856063 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.421691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12295e-5c9e-404d-bf2b-0352a3856063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.422175 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12295e-5c9e-404d-bf2b-0352a3856063 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.423400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12295e-5c9e-404d-bf2b-0352a3856063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.432486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12295e-5c9e-404d-bf2b-0352a3856063 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.463123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 929/1877] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:57 2022] POST /identity/v3/users => generated 300 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:57.466274 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72375c40-7d79-44c8-9990-fe5246c1d5be None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.466569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72375c40-7d79-44c8-9990-fe5246c1d5be None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.466848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72375c40-7d79-44c8-9990-fe5246c1d5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.527804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 949/1878] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:31:57 2022] POST /identity/v3/users => generated 299 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:31:57.527804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12295e-5c9e-404d-bf2b-0352a3856063 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.539544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-72375c40-7d79-44c8-9990-fe5246c1d5be None None] MFA Rules not processed for user `f7ea81fb74014917ac26e67260303a84`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:57.541238 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-72375c40-7d79-44c8-9990-fe5246c1d5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:57.656943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12295e-5c9e-404d-bf2b-0352a3856063 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.667631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ac116-4758-4cdf-9011-dadbff72e91a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.668408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ac116-4758-4cdf-9011-dadbff72e91a service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.668875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ac116-4758-4cdf-9011-dadbff72e91a service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.669173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ac116-4758-4cdf-9011-dadbff72e91a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.678230 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 930/1879] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:57.679539 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72375c40-7d79-44c8-9990-fe5246c1d5be None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.692767 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72375c40-7d79-44c8-9990-fe5246c1d5be None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.701865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb7f4f-5890-456e-b632-e79693ac93d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.702816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb7f4f-5890-456e-b632-e79693ac93d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.703098 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb7f4f-5890-456e-b632-e79693ac93d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.703371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb7f4f-5890-456e-b632-e79693ac93d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.704248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb7f4f-5890-456e-b632-e79693ac93d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.709506 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb7f4f-5890-456e-b632-e79693ac93d8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.725489 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 931/1880] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:57.726430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb7f4f-5890-456e-b632-e79693ac93d8 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.760292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb7f4f-5890-456e-b632-e79693ac93d8 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.775343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec141b0e-644f-4bb0-a98b-e3fab3aa2022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.776277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec141b0e-644f-4bb0-a98b-e3fab3aa2022 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.776748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec141b0e-644f-4bb0-a98b-e3fab3aa2022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.777023 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec141b0e-644f-4bb0-a98b-e3fab3aa2022 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.777879 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec141b0e-644f-4bb0-a98b-e3fab3aa2022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.779586 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec141b0e-644f-4bb0-a98b-e3fab3aa2022 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.780158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:57.791007 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ac116-4758-4cdf-9011-dadbff72e91a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.794754 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ac116-4758-4cdf-9011-dadbff72e91a service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.827503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 932/1881] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:57.832734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec141b0e-644f-4bb0-a98b-e3fab3aa2022 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.837295 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 950/1882] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:57.838962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ac116-4758-4cdf-9011-dadbff72e91a service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.889549 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ac116-4758-4cdf-9011-dadbff72e91a service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.906803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c244a-db09-4acd-92ef-e43a2ca5272b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.908740 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c244a-db09-4acd-92ef-e43a2ca5272b admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.909219 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c244a-db09-4acd-92ef-e43a2ca5272b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.909825 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c244a-db09-4acd-92ef-e43a2ca5272b admin admin] PATH_INFO: `/v3/projects/2d532fdb4524485e8d4ef0aaa7b79bc8/users/81ba9af485814116bceef2ba3b30a634/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.911569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec141b0e-644f-4bb0-a98b-e3fab3aa2022 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:57.930403 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8aedfc-5281-4e63-9e5d-9e1b0d6fa25c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:57.931477 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8aedfc-5281-4e63-9e5d-9e1b0d6fa25c service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:57.931973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8aedfc-5281-4e63-9e5d-9e1b0d6fa25c service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:57.932469 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8aedfc-5281-4e63-9e5d-9e1b0d6fa25c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:57.942189 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c244a-db09-4acd-92ef-e43a2ca5272b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d532fdb4524485e8d4ef0aaa7b79bc8, user_id=81ba9af485814116bceef2ba3b30a634, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.948225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c244a-db09-4acd-92ef-e43a2ca5272b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:57.971904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 951/1883] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:57 2022] PUT /identity/v3/projects/2d532fdb4524485e8d4ef0aaa7b79bc8/users/81ba9af485814116bceef2ba3b30a634/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:57.973405 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c244a-db09-4acd-92ef-e43a2ca5272b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:57.984514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8aedfc-5281-4e63-9e5d-9e1b0d6fa25c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:57.988759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8aedfc-5281-4e63-9e5d-9e1b0d6fa25c service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:58.011407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 933/1884] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:58.013014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8aedfc-5281-4e63-9e5d-9e1b0d6fa25c service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:58.042874 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8aedfc-5281-4e63-9e5d-9e1b0d6fa25c service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:58.157931 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c244a-db09-4acd-92ef-e43a2ca5272b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:58.164693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2e5fc-d086-4bc9-bb73-81ca2f1d6e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:58.165450 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2e5fc-d086-4bc9-bb73-81ca2f1d6e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.165899 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2e5fc-d086-4bc9-bb73-81ca2f1d6e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.166180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2e5fc-d086-4bc9-bb73-81ca2f1d6e3a admin admin] PATH_INFO: `/v3/projects/fc21fe1855774163858cb428938af8f9/users/8bec066427164b6bb08ced04da28cbf6/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.226924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2e5fc-d086-4bc9-bb73-81ca2f1d6e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc21fe1855774163858cb428938af8f9, user_id=8bec066427164b6bb08ced04da28cbf6, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:58.231911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e99cfc-2b1b-4e9d-b953-1b811f183bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:58.232243 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2e5fc-d086-4bc9-bb73-81ca2f1d6e3a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:58.232671 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e99cfc-2b1b-4e9d-b953-1b811f183bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.233124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e99cfc-2b1b-4e9d-b953-1b811f183bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.233498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e99cfc-2b1b-4e9d-b953-1b811f183bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.234406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e99cfc-2b1b-4e9d-b953-1b811f183bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:58.236549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e99cfc-2b1b-4e9d-b953-1b811f183bc9 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:58.261917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 934/1885] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:58.263967 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 952/1886] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:57 2022] PUT /identity/v3/projects/fc21fe1855774163858cb428938af8f9/users/8bec066427164b6bb08ced04da28cbf6/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:58.265139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2e5fc-d086-4bc9-bb73-81ca2f1d6e3a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:58.266430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e99cfc-2b1b-4e9d-b953-1b811f183bc9 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:58.303131 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:58.368583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e99cfc-2b1b-4e9d-b953-1b811f183bc9 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:58.447037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2e5fc-d086-4bc9-bb73-81ca2f1d6e3a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:58.457668 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb587a-9423-4cb8-a3ea-3ac2f9b4ecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:58.458946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb587a-9423-4cb8-a3ea-3ac2f9b4ecdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.459528 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb587a-9423-4cb8-a3ea-3ac2f9b4ecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.460074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb587a-9423-4cb8-a3ea-3ac2f9b4ecdb admin admin] PATH_INFO: `/v3/projects/2d532fdb4524485e8d4ef0aaa7b79bc8/users/81ba9af485814116bceef2ba3b30a634/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.464674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb587a-9423-4cb8-a3ea-3ac2f9b4ecdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d532fdb4524485e8d4ef0aaa7b79bc8, user_id=81ba9af485814116bceef2ba3b30a634, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:58.470901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb587a-9423-4cb8-a3ea-3ac2f9b4ecdb admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:58.506001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 953/1887] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:58 2022] PUT /identity/v3/projects/2d532fdb4524485e8d4ef0aaa7b79bc8/users/81ba9af485814116bceef2ba3b30a634/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:58.510602 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb587a-9423-4cb8-a3ea-3ac2f9b4ecdb admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:58.545956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08d939-2864-4cab-a09e-154fb727fd48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:58.546958 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08d939-2864-4cab-a09e-154fb727fd48 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.547424 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08d939-2864-4cab-a09e-154fb727fd48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.547879 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08d939-2864-4cab-a09e-154fb727fd48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.631169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:58.686848 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb587a-9423-4cb8-a3ea-3ac2f9b4ecdb admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:58.695874 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f83ad-ab4f-4c9c-992d-9e572063b40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:58.696927 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f83ad-ab4f-4c9c-992d-9e572063b40a admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.697487 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f83ad-ab4f-4c9c-992d-9e572063b40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.697975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f83ad-ab4f-4c9c-992d-9e572063b40a admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.700725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f83ad-ab4f-4c9c-992d-9e572063b40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:58.727592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f83ad-ab4f-4c9c-992d-9e572063b40a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:58.744027 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08d939-2864-4cab-a09e-154fb727fd48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:58.748637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08d939-2864-4cab-a09e-154fb727fd48 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:58.757785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 954/1888] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:31:58.760191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef25d9-86ed-4727-ac22-3ff1ce5963d1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.760875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef25d9-86ed-4727-ac22-3ff1ce5963d1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.761470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef25d9-86ed-4727-ac22-3ff1ce5963d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.794879 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 935/1889] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:58.796685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08d939-2864-4cab-a09e-154fb727fd48 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:58.833801 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c5ef25d9-86ed-4727-ac22-3ff1ce5963d1 None None] MFA Rules not processed for user `81ba9af485814116bceef2ba3b30a634`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:58.836495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c5ef25d9-86ed-4727-ac22-3ff1ce5963d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:58.845121 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08d939-2864-4cab-a09e-154fb727fd48 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:58.864316 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c2514-d761-41ed-87f6-5eaeed113737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:58.865296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c2514-d761-41ed-87f6-5eaeed113737 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.865792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c2514-d761-41ed-87f6-5eaeed113737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.866258 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c2514-d761-41ed-87f6-5eaeed113737 admin admin] PATH_INFO: `/v3/projects/fc21fe1855774163858cb428938af8f9/users/8bec066427164b6bb08ced04da28cbf6/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.870111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c2514-d761-41ed-87f6-5eaeed113737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc21fe1855774163858cb428938af8f9, user_id=8bec066427164b6bb08ced04da28cbf6, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:58.877278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c2514-d761-41ed-87f6-5eaeed113737 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:58.902176 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 936/1890] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:31:58 2022] PUT /identity/v3/projects/fc21fe1855774163858cb428938af8f9/users/8bec066427164b6bb08ced04da28cbf6/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:58.924817 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc648d-0343-45a1-8517-87a915768941 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.925757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc648d-0343-45a1-8517-87a915768941 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.926368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc648d-0343-45a1-8517-87a915768941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:59.058713 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c8bc648d-0343-45a1-8517-87a915768941 None None] MFA Rules not processed for user `8bec066427164b6bb08ced04da28cbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:59.067816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c8bc648d-0343-45a1-8517-87a915768941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:59.135906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 955/1891] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:59.138786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5c8a5-212c-4e05-9712-49981e83f5fc None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:59.139291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5c8a5-212c-4e05-9712-49981e83f5fc None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:59.139772 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5c8a5-212c-4e05-9712-49981e83f5fc None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:59.142797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 956/1892] 10.222.0.52 () {54 vars in 921 bytes} [Mon Aug 29 20:31:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:31:59.178028 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf9c7-1b4a-4e36-a07d-adcedc738ee3 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:59.181219 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf9c7-1b4a-4e36-a07d-adcedc738ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:59.182587 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf9c7-1b4a-4e36-a07d-adcedc738ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:59.310463 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e7bbf9c7-1b4a-4e36-a07d-adcedc738ee3 None None] MFA Rules not processed for user `9c95d16fd4da4fa7987b893eae0b3ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:59.319286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e7bbf9c7-1b4a-4e36-a07d-adcedc738ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:59.447173 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 937/1893] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:31:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 524 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:31:59.450489 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc648d-0343-45a1-8517-87a915768941 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:59.463484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:59.552051 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 957/1894] 10.222.0.52 () {58 vars in 1018 bytes} [Mon Aug 29 20:31:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:59.676180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc648d-0343-45a1-8517-87a915768941 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:59.691330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf9c7-1b4a-4e36-a07d-adcedc738ee3 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:59.696540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334525dc-42bb-4a14-9c7b-1b88fdb9544e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:59.697934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334525dc-42bb-4a14-9c7b-1b88fdb9544e service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:59.698438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334525dc-42bb-4a14-9c7b-1b88fdb9544e service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:59.698929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334525dc-42bb-4a14-9c7b-1b88fdb9544e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:59.713877 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf9c7-1b4a-4e36-a07d-adcedc738ee3 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:59.719007 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875216a1-d387-4d19-b1a1-f97b4a74ff61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:59.719674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875216a1-d387-4d19-b1a1-f97b4a74ff61 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:59.719938 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875216a1-d387-4d19-b1a1-f97b4a74ff61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:59.720204 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875216a1-d387-4d19-b1a1-f97b4a74ff61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:59.754594 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875216a1-d387-4d19-b1a1-f97b4a74ff61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:59.762441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875216a1-d387-4d19-b1a1-f97b4a74ff61 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:59.798179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 958/1895] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:59.820359 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875216a1-d387-4d19-b1a1-f97b4a74ff61 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:59.829718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-875216a1-d387-4d19-b1a1-f97b4a74ff61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:59.864992 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875216a1-d387-4d19-b1a1-f97b4a74ff61 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:59.882113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa4a4b-9965-4f58-ab34-bcb37b56836a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:59.883339 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa4a4b-9965-4f58-ab34-bcb37b56836a service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:59.885681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa4a4b-9965-4f58-ab34-bcb37b56836a service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:59.886240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa4a4b-9965-4f58-ab34-bcb37b56836a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:59.921189 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa4a4b-9965-4f58-ab34-bcb37b56836a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:59.925014 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa4a4b-9965-4f58-ab34-bcb37b56836a service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:59.925292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334525dc-42bb-4a14-9c7b-1b88fdb9544e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:59.929023 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334525dc-42bb-4a14-9c7b-1b88fdb9544e service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:59.959927 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 959/1896] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:59.973760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 938/1897] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:00.225535 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa4a4b-9965-4f58-ab34-bcb37b56836a service nova] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:00.347246 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:00.458486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa4a4b-9965-4f58-ab34-bcb37b56836a service nova] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:00.473374 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22d294-c0e2-4176-806b-4c88ab8c5584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:00.475230 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22d294-c0e2-4176-806b-4c88ab8c5584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:00.475873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22d294-c0e2-4176-806b-4c88ab8c5584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:00.476424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22d294-c0e2-4176-806b-4c88ab8c5584 admin admin] PATH_INFO: `/v3/users/611edac0ea904803889b167e4f38da42` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:00.478755 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22d294-c0e2-4176-806b-4c88ab8c5584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=611edac0ea904803889b167e4f38da42)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:00.483323 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22d294-c0e2-4176-806b-4c88ab8c5584 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:00.588009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-cf22d294-c0e2-4176-806b-4c88ab8c5584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '611edac0ea904803889b167e4f38da42'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:00.609950 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-cf22d294-c0e2-4176-806b-4c88ab8c5584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '611edac0ea904803889b167e4f38da42'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:00.645603 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334525dc-42bb-4a14-9c7b-1b88fdb9544e service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:00.660149 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334525dc-42bb-4a14-9c7b-1b88fdb9544e service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:00.664893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-cf22d294-c0e2-4176-806b-4c88ab8c5584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '611edac0ea904803889b167e4f38da42'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:00.665683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-cf22d294-c0e2-4176-806b-4c88ab8c5584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '611edac0ea904803889b167e4f38da42'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:00.666444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-cf22d294-c0e2-4176-806b-4c88ab8c5584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '611edac0ea904803889b167e4f38da42'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:00.666635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e2a8c-b3c2-4fb0-ae25-3be9c71c18c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:00.667661 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e2a8c-b3c2-4fb0-ae25-3be9c71c18c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:00.668303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e2a8c-b3c2-4fb0-ae25-3be9c71c18c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:00.668846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e2a8c-b3c2-4fb0-ae25-3be9c71c18c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:00.671659 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-955e2a8c-b3c2-4fb0-ae25-3be9c71c18c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:00.715797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 960/1898] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:00 2022] DELETE /identity/v3/users/611edac0ea904803889b167e4f38da42 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:00.719347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755594c2-9d96-4252-a1b6-9ae7158f59de None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:00.719932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755594c2-9d96-4252-a1b6-9ae7158f59de None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:00.721209 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755594c2-9d96-4252-a1b6-9ae7158f59de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:00.774529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e2a8c-b3c2-4fb0-ae25-3be9c71c18c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:00.776325 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e2a8c-b3c2-4fb0-ae25-3be9c71c18c4 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:00.787159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-755594c2-9d96-4252-a1b6-9ae7158f59de None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:00.789641 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-755594c2-9d96-4252-a1b6-9ae7158f59de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:00.802637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 939/1899] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:32:01.114843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 961/1900] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:01.157891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e2a8c-b3c2-4fb0-ae25-3be9c71c18c4 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:01.175531 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-955e2a8c-b3c2-4fb0-ae25-3be9c71c18c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:01.325503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e2a8c-b3c2-4fb0-ae25-3be9c71c18c4 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:01.335558 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:01.455857 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1208713-8542-44a2-ab74-97304f3be9d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:01.456757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1208713-8542-44a2-ab74-97304f3be9d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:01.457175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1208713-8542-44a2-ab74-97304f3be9d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:01.457871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1208713-8542-44a2-ab74-97304f3be9d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:01.474459 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1208713-8542-44a2-ab74-97304f3be9d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:01.477136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1208713-8542-44a2-ab74-97304f3be9d3 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:01.517210 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 940/1901] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:02.113956 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755594c2-9d96-4252-a1b6-9ae7158f59de None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:02.116639 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-755594c2-9d96-4252-a1b6-9ae7158f59de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:02.165326 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1208713-8542-44a2-ab74-97304f3be9d3 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:02.168492 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755594c2-9d96-4252-a1b6-9ae7158f59de None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:02.168681 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f1208713-8542-44a2-ab74-97304f3be9d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:02.176414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a9485-9e1f-4dce-9fe5-7059eee493c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:02.177909 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a9485-9e1f-4dce-9fe5-7059eee493c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:02.178513 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a9485-9e1f-4dce-9fe5-7059eee493c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:02.179010 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a9485-9e1f-4dce-9fe5-7059eee493c3 admin admin] PATH_INFO: `/v3/projects/8796b40d8e48425da4db4e1111cd1b45` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:02.182056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a9485-9e1f-4dce-9fe5-7059eee493c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8796b40d8e48425da4db4e1111cd1b45)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:02.187589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a9485-9e1f-4dce-9fe5-7059eee493c3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:02.190240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1208713-8542-44a2-ab74-97304f3be9d3 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:02.196936 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8921d-ff4c-4319-aa2d-17c76d455440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:02.197781 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8921d-ff4c-4319-aa2d-17c76d455440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:02.198246 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8921d-ff4c-4319-aa2d-17c76d455440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:02.198690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8921d-ff4c-4319-aa2d-17c76d455440 admin admin] PATH_INFO: `/v3/users/321c6cd1123b44f88b864a4796d6b1bc` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:02.200955 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8921d-ff4c-4319-aa2d-17c76d455440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=321c6cd1123b44f88b864a4796d6b1bc)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:02.204505 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8921d-ff4c-4319-aa2d-17c76d455440 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:02.271795 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:02.274394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-be6a9485-9e1f-4dce-9fe5-7059eee493c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8796b40d8e48425da4db4e1111cd1b45', 'request_id': 'req-be6a9485-9e1f-4dce-9fe5-7059eee493c3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:02.284209 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-12d8921d-ff4c-4319-aa2d-17c76d455440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321c6cd1123b44f88b864a4796d6b1bc'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:02.300104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-be6a9485-9e1f-4dce-9fe5-7059eee493c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8796b40d8e48425da4db4e1111cd1b45', 'request_id': 'req-be6a9485-9e1f-4dce-9fe5-7059eee493c3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:02.318122 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-12d8921d-ff4c-4319-aa2d-17c76d455440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321c6cd1123b44f88b864a4796d6b1bc'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:02.320572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-be6a9485-9e1f-4dce-9fe5-7059eee493c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8796b40d8e48425da4db4e1111cd1b45', 'request_id': 'req-be6a9485-9e1f-4dce-9fe5-7059eee493c3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:02.330778 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-12d8921d-ff4c-4319-aa2d-17c76d455440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321c6cd1123b44f88b864a4796d6b1bc'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:02.331777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-12d8921d-ff4c-4319-aa2d-17c76d455440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321c6cd1123b44f88b864a4796d6b1bc'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:02.351171 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-12d8921d-ff4c-4319-aa2d-17c76d455440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321c6cd1123b44f88b864a4796d6b1bc'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:02.364816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 941/1902] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:02 2022] DELETE /identity/v3/users/321c6cd1123b44f88b864a4796d6b1bc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:02.367642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df9bc5-2d95-4fdf-91f7-f8c7503c6404 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:02.368062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df9bc5-2d95-4fdf-91f7-f8c7503c6404 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:02.368356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-be6a9485-9e1f-4dce-9fe5-7059eee493c3 admin admin] The token cache is being invalidate because project 8796b40d8e48425da4db4e1111cd1b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:02.368529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df9bc5-2d95-4fdf-91f7-f8c7503c6404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:02.368675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-be6a9485-9e1f-4dce-9fe5-7059eee493c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:02.369497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-be6a9485-9e1f-4dce-9fe5-7059eee493c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:02.371363 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 962/1903] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:02 2022] DELETE /identity/v3/projects/8796b40d8e48425da4db4e1111cd1b45 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:02.377301 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a9485-9e1f-4dce-9fe5-7059eee493c3 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:02.379779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-be6a9485-9e1f-4dce-9fe5-7059eee493c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:02.400289 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-91df9bc5-2d95-4fdf-91f7-f8c7503c6404 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:02.401747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-91df9bc5-2d95-4fdf-91f7-f8c7503c6404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:02.498711 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 942/1904] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:02.511443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df9bc5-2d95-4fdf-91f7-f8c7503c6404 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:02.514299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-91df9bc5-2d95-4fdf-91f7-f8c7503c6404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:02.518084 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a9485-9e1f-4dce-9fe5-7059eee493c3 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:02.531640 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6ec32-5d6f-4d2a-8698-3a5a73d69111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:02.533900 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6ec32-5d6f-4d2a-8698-3a5a73d69111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:02.534606 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6ec32-5d6f-4d2a-8698-3a5a73d69111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:02.535219 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6ec32-5d6f-4d2a-8698-3a5a73d69111 admin admin] PATH_INFO: `/v3/users/81ba9af485814116bceef2ba3b30a634` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:02.537765 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6ec32-5d6f-4d2a-8698-3a5a73d69111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ba9af485814116bceef2ba3b30a634)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:02.540972 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6ec32-5d6f-4d2a-8698-3a5a73d69111 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:02.563977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:02.640291 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df9bc5-2d95-4fdf-91f7-f8c7503c6404 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:02.649327 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858b0bc-b79e-4041-a5dc-a71ff81528bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:02.650312 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858b0bc-b79e-4041-a5dc-a71ff81528bc service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:02.650800 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858b0bc-b79e-4041-a5dc-a71ff81528bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:02.652361 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858b0bc-b79e-4041-a5dc-a71ff81528bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:02.662229 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7ca6ec32-5d6f-4d2a-8698-3a5a73d69111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ba9af485814116bceef2ba3b30a634'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:02.674075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858b0bc-b79e-4041-a5dc-a71ff81528bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:02.678796 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858b0bc-b79e-4041-a5dc-a71ff81528bc service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:02.681045 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7ca6ec32-5d6f-4d2a-8698-3a5a73d69111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ba9af485814116bceef2ba3b30a634'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:02.699182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7ca6ec32-5d6f-4d2a-8698-3a5a73d69111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ba9af485814116bceef2ba3b30a634'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:02.700719 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7ca6ec32-5d6f-4d2a-8698-3a5a73d69111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ba9af485814116bceef2ba3b30a634'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:02.701522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 943/1905] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:32:02.702213 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7ca6ec32-5d6f-4d2a-8698-3a5a73d69111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ba9af485814116bceef2ba3b30a634'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:02.720045 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 963/1906] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:02 2022] DELETE /identity/v3/users/81ba9af485814116bceef2ba3b30a634 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:03.130816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858b0bc-b79e-4041-a5dc-a71ff81528bc service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:03.143949 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7858b0bc-b79e-4041-a5dc-a71ff81528bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:03.171520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858b0bc-b79e-4041-a5dc-a71ff81528bc service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:03.367520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762592d0-8ae9-40f4-8926-73077b8794fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:03.368819 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762592d0-8ae9-40f4-8926-73077b8794fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:03.369379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762592d0-8ae9-40f4-8926-73077b8794fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:03.369912 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762592d0-8ae9-40f4-8926-73077b8794fd admin admin] PATH_INFO: `/v3/users/ece04e1bf55f4033a8c90679466e1254` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:03.373790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762592d0-8ae9-40f4-8926-73077b8794fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece04e1bf55f4033a8c90679466e1254)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:03.379613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762592d0-8ae9-40f4-8926-73077b8794fd admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:03.431836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6ec32-5d6f-4d2a-8698-3a5a73d69111 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:03.436165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7ca6ec32-5d6f-4d2a-8698-3a5a73d69111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:03.499595 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6ec32-5d6f-4d2a-8698-3a5a73d69111 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:03.529876 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412dafe-bec6-4bce-b94d-2f2acdd821ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:03.535801 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412dafe-bec6-4bce-b94d-2f2acdd821ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:03.536308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412dafe-bec6-4bce-b94d-2f2acdd821ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:03.536850 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412dafe-bec6-4bce-b94d-2f2acdd821ae admin admin] PATH_INFO: `/v3/users/33afe9c143ae4aa1a8d0f51660b24a7a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:03.552753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412dafe-bec6-4bce-b94d-2f2acdd821ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=33afe9c143ae4aa1a8d0f51660b24a7a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:03.554874 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412dafe-bec6-4bce-b94d-2f2acdd821ae admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:03.652020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-762592d0-8ae9-40f4-8926-73077b8794fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece04e1bf55f4033a8c90679466e1254'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:03.668824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0412dafe-bec6-4bce-b94d-2f2acdd821ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33afe9c143ae4aa1a8d0f51660b24a7a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:03.677402 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=77,keystone:INSERT=3,keystone:DELETE=20 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:03.686528 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0412dafe-bec6-4bce-b94d-2f2acdd821ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33afe9c143ae4aa1a8d0f51660b24a7a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:03.711961 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0412dafe-bec6-4bce-b94d-2f2acdd821ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33afe9c143ae4aa1a8d0f51660b24a7a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:03.715510 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0412dafe-bec6-4bce-b94d-2f2acdd821ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33afe9c143ae4aa1a8d0f51660b24a7a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:03.716556 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0412dafe-bec6-4bce-b94d-2f2acdd821ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33afe9c143ae4aa1a8d0f51660b24a7a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:03.717694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-762592d0-8ae9-40f4-8926-73077b8794fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece04e1bf55f4033a8c90679466e1254'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:03.741649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-762592d0-8ae9-40f4-8926-73077b8794fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece04e1bf55f4033a8c90679466e1254'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:03.744968 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 964/1907] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:03 2022] DELETE /identity/v3/users/33afe9c143ae4aa1a8d0f51660b24a7a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:03.749326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412dafe-bec6-4bce-b94d-2f2acdd821ae admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:03.749503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-762592d0-8ae9-40f4-8926-73077b8794fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece04e1bf55f4033a8c90679466e1254'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:03.751904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0412dafe-bec6-4bce-b94d-2f2acdd821ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:03.772868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-762592d0-8ae9-40f4-8926-73077b8794fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece04e1bf55f4033a8c90679466e1254'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:03.801391 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 944/1908] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:03 2022] DELETE /identity/v3/users/ece04e1bf55f4033a8c90679466e1254 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:03.803449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6f1c-46f3-4713-b53a-9bdb12246b5e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:03.804659 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6f1c-46f3-4713-b53a-9bdb12246b5e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:03.805942 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6f1c-46f3-4713-b53a-9bdb12246b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:03.855914 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-991e6f1c-46f3-4713-b53a-9bdb12246b5e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:03.859656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-991e6f1c-46f3-4713-b53a-9bdb12246b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:03.891486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412dafe-bec6-4bce-b94d-2f2acdd821ae admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:03.963939 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:04.008676 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 945/1909] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:04.008968 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53f520-9379-437b-bf4d-9a7a2e90f6a4 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:04.009419 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53f520-9379-437b-bf4d-9a7a2e90f6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:04.009838 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53f520-9379-437b-bf4d-9a7a2e90f6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:04.049111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-af53f520-9379-437b-bf4d-9a7a2e90f6a4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:04.052024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-af53f520-9379-437b-bf4d-9a7a2e90f6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:04.055639 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d71d8-f217-4549-a481-c4d77b535d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:04.056716 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d71d8-f217-4549-a481-c4d77b535d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:04.057221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d71d8-f217-4549-a481-c4d77b535d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:04.059546 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d71d8-f217-4549-a481-c4d77b535d77 admin admin] PATH_INFO: `/v3/projects/2d532fdb4524485e8d4ef0aaa7b79bc8` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:04.062325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d71d8-f217-4549-a481-c4d77b535d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d532fdb4524485e8d4ef0aaa7b79bc8)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:04.069656 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d71d8-f217-4549-a481-c4d77b535d77 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:04.085223 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 946/1910] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:04.086821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53f520-9379-437b-bf4d-9a7a2e90f6a4 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:04.089532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-af53f520-9379-437b-bf4d-9a7a2e90f6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:04.171072 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e23d71d8-f217-4549-a481-c4d77b535d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d532fdb4524485e8d4ef0aaa7b79bc8', 'request_id': 'req-e23d71d8-f217-4549-a481-c4d77b535d77'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.184588 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e23d71d8-f217-4549-a481-c4d77b535d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d532fdb4524485e8d4ef0aaa7b79bc8', 'request_id': 'req-e23d71d8-f217-4549-a481-c4d77b535d77'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.191002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53f520-9379-437b-bf4d-9a7a2e90f6a4 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:04.199818 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e23d71d8-f217-4549-a481-c4d77b535d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d532fdb4524485e8d4ef0aaa7b79bc8', 'request_id': 'req-e23d71d8-f217-4549-a481-c4d77b535d77'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.220782 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e23d71d8-f217-4549-a481-c4d77b535d77 admin admin] The token cache is being invalidate because project 2d532fdb4524485e8d4ef0aaa7b79bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:04.221275 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e23d71d8-f217-4549-a481-c4d77b535d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.222413 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e23d71d8-f217-4549-a481-c4d77b535d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.224896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 965/1911] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:03 2022] DELETE /identity/v3/projects/2d532fdb4524485e8d4ef0aaa7b79bc8 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:04.226321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d71d8-f217-4549-a481-c4d77b535d77 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:04.228479 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e23d71d8-f217-4549-a481-c4d77b535d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:04.238823 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:04.260189 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568e42c-0d21-44d6-9540-0f1d67794106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:04.261210 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568e42c-0d21-44d6-9540-0f1d67794106 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:04.261718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568e42c-0d21-44d6-9540-0f1d67794106 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:04.262207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568e42c-0d21-44d6-9540-0f1d67794106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:04.265118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d568e42c-0d21-44d6-9540-0f1d67794106 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:04.345088 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d71d8-f217-4549-a481-c4d77b535d77 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:04.354565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa90f46-6d6b-451f-bc81-d82e0889d647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:04.355565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa90f46-6d6b-451f-bc81-d82e0889d647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:04.355998 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568e42c-0d21-44d6-9540-0f1d67794106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:04.356171 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa90f46-6d6b-451f-bc81-d82e0889d647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:04.356551 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa90f46-6d6b-451f-bc81-d82e0889d647 admin admin] PATH_INFO: `/v3/projects/dee9648f0c774ec18336058b79824698` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:04.357948 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568e42c-0d21-44d6-9540-0f1d67794106 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:04.358906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa90f46-6d6b-451f-bc81-d82e0889d647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee9648f0c774ec18336058b79824698)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:04.362511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa90f46-6d6b-451f-bc81-d82e0889d647 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:04.370629 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 947/1912] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:04.373191 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568e42c-0d21-44d6-9540-0f1d67794106 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:04.375393 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d568e42c-0d21-44d6-9540-0f1d67794106 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:04.394843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568e42c-0d21-44d6-9540-0f1d67794106 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:04.401425 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d64559-e42e-40e0-9e33-1004eba9774f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:04.402663 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d64559-e42e-40e0-9e33-1004eba9774f service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:04.403151 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d64559-e42e-40e0-9e33-1004eba9774f service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:04.403629 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d64559-e42e-40e0-9e33-1004eba9774f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:04.406721 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-95d64559-e42e-40e0-9e33-1004eba9774f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:04.434066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d64559-e42e-40e0-9e33-1004eba9774f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:04.437124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d64559-e42e-40e0-9e33-1004eba9774f service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:04.455029 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 948/1913] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:04.457127 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecf55c-e6de-4491-948a-2c9888642c45 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:04.457682 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecf55c-e6de-4491-948a-2c9888642c45 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:04.458439 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecf55c-e6de-4491-948a-2c9888642c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:04.465949 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1fa90f46-6d6b-451f-bc81-d82e0889d647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee9648f0c774ec18336058b79824698', 'request_id': 'req-1fa90f46-6d6b-451f-bc81-d82e0889d647'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.481088 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1fa90f46-6d6b-451f-bc81-d82e0889d647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee9648f0c774ec18336058b79824698', 'request_id': 'req-1fa90f46-6d6b-451f-bc81-d82e0889d647'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.494842 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1fa90f46-6d6b-451f-bc81-d82e0889d647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee9648f0c774ec18336058b79824698', 'request_id': 'req-1fa90f46-6d6b-451f-bc81-d82e0889d647'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.495855 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-77ecf55c-e6de-4491-948a-2c9888642c45 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:04.497891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-77ecf55c-e6de-4491-948a-2c9888642c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:04.518597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1fa90f46-6d6b-451f-bc81-d82e0889d647 admin admin] The token cache is being invalidate because project dee9648f0c774ec18336058b79824698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:04.519101 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1fa90f46-6d6b-451f-bc81-d82e0889d647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.520495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1fa90f46-6d6b-451f-bc81-d82e0889d647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.524558 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 966/1914] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:04 2022] DELETE /identity/v3/projects/dee9648f0c774ec18336058b79824698 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:04.530949 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa90f46-6d6b-451f-bc81-d82e0889d647 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:04.533645 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1fa90f46-6d6b-451f-bc81-d82e0889d647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:04.557253 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:04.687562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 949/1915] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:04.696704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c375b-bd4a-4687-9eb1-353f8fe0a7af None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:04.697190 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c375b-bd4a-4687-9eb1-353f8fe0a7af None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:04.697882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c375b-bd4a-4687-9eb1-353f8fe0a7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:04.702582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa90f46-6d6b-451f-bc81-d82e0889d647 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:04.713143 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff873393-7168-44b9-b39b-3565e466c530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:04.714008 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff873393-7168-44b9-b39b-3565e466c530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:04.714191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff873393-7168-44b9-b39b-3565e466c530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:04.714476 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff873393-7168-44b9-b39b-3565e466c530 admin admin] PATH_INFO: `/v3/users/8bec066427164b6bb08ced04da28cbf6` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:04.716622 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff873393-7168-44b9-b39b-3565e466c530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bec066427164b6bb08ced04da28cbf6)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:04.719234 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff873393-7168-44b9-b39b-3565e466c530 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:04.759104 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-388c375b-bd4a-4687-9eb1-353f8fe0a7af None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:04.770564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-388c375b-bd4a-4687-9eb1-353f8fe0a7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:04.812076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 950/1916] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:04.815608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c375b-bd4a-4687-9eb1-353f8fe0a7af None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:04.819901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:04.849641 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ff873393-7168-44b9-b39b-3565e466c530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bec066427164b6bb08ced04da28cbf6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.851729 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c375b-bd4a-4687-9eb1-353f8fe0a7af None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:04.869622 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2adcbc-6c2b-439b-8e02-4da81939508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:04.870624 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2adcbc-6c2b-439b-8e02-4da81939508d admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:04.871088 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2adcbc-6c2b-439b-8e02-4da81939508d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:04.871649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2adcbc-6c2b-439b-8e02-4da81939508d admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:04.871794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ff873393-7168-44b9-b39b-3565e466c530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bec066427164b6bb08ced04da28cbf6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.885320 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2adcbc-6c2b-439b-8e02-4da81939508d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:04.885976 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2adcbc-6c2b-439b-8e02-4da81939508d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:04.889305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2adcbc-6c2b-439b-8e02-4da81939508d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:04.913756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ff873393-7168-44b9-b39b-3565e466c530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bec066427164b6bb08ced04da28cbf6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.915052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ff873393-7168-44b9-b39b-3565e466c530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bec066427164b6bb08ced04da28cbf6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.917429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ff873393-7168-44b9-b39b-3565e466c530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bec066427164b6bb08ced04da28cbf6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.947629 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 951/1917] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:04.955286 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2adcbc-6c2b-439b-8e02-4da81939508d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:04.964899 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7c2adcbc-6c2b-439b-8e02-4da81939508d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:05.021830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 967/1918] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:04 2022] DELETE /identity/v3/users/8bec066427164b6bb08ced04da28cbf6 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:05.031319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2adcbc-6c2b-439b-8e02-4da81939508d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:05.172139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff873393-7168-44b9-b39b-3565e466c530 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:05.175291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ff873393-7168-44b9-b39b-3565e466c530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:05.272710 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f67a42-d040-45eb-a178-cd5b45581fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:05.273548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f67a42-d040-45eb-a178-cd5b45581fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.273796 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f67a42-d040-45eb-a178-cd5b45581fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.274134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f67a42-d040-45eb-a178-cd5b45581fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.274800 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f67a42-d040-45eb-a178-cd5b45581fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:05.279135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f67a42-d040-45eb-a178-cd5b45581fa4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:05.353644 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 952/1919] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:04 2022] POST /identity/v3/projects => generated 381 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:05.363186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f67a42-d040-45eb-a178-cd5b45581fa4 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:05.459328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff873393-7168-44b9-b39b-3565e466c530 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:05.503365 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f67a42-d040-45eb-a178-cd5b45581fa4 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:05.514650 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07b9aa-b6f3-4ce0-8cfd-ab94b326c6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:05.517221 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07b9aa-b6f3-4ce0-8cfd-ab94b326c6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.517970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07b9aa-b6f3-4ce0-8cfd-ab94b326c6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.518883 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07b9aa-b6f3-4ce0-8cfd-ab94b326c6f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.520316 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07b9aa-b6f3-4ce0-8cfd-ab94b326c6f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:05.525072 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07b9aa-b6f3-4ce0-8cfd-ab94b326c6f7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:05.582734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 953/1920] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:05 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:05.584688 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07b9aa-b6f3-4ce0-8cfd-ab94b326c6f7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:05.614107 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07b9aa-b6f3-4ce0-8cfd-ab94b326c6f7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:05.621599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0aec7d-3d53-4b1e-8c39-7d614a51b604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:05.623506 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0aec7d-3d53-4b1e-8c39-7d614a51b604 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.624193 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0aec7d-3d53-4b1e-8c39-7d614a51b604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.624614 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0aec7d-3d53-4b1e-8c39-7d614a51b604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.625650 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0aec7d-3d53-4b1e-8c39-7d614a51b604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:05.627659 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0aec7d-3d53-4b1e-8c39-7d614a51b604 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:05.635662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8c35d-ae58-4500-9cbb-a02d05a574e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:05.637641 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8c35d-ae58-4500-9cbb-a02d05a574e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.638142 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8c35d-ae58-4500-9cbb-a02d05a574e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.639053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8c35d-ae58-4500-9cbb-a02d05a574e0 admin admin] PATH_INFO: `/v3/projects/c55e5745e6ac47f993ae34a4888b3dcc` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.642000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8c35d-ae58-4500-9cbb-a02d05a574e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c55e5745e6ac47f993ae34a4888b3dcc)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:05.645079 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 954/1921] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:05.647875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8c35d-ae58-4500-9cbb-a02d05a574e0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:05.651061 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0aec7d-3d53-4b1e-8c39-7d614a51b604 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:05.701077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0aec7d-3d53-4b1e-8c39-7d614a51b604 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:05.712022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65decb5-03f3-4bb1-990b-00460eb230a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:05.712660 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65decb5-03f3-4bb1-990b-00460eb230a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.713296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65decb5-03f3-4bb1-990b-00460eb230a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.713296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65decb5-03f3-4bb1-990b-00460eb230a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.716399 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65decb5-03f3-4bb1-990b-00460eb230a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:05.718218 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65decb5-03f3-4bb1-990b-00460eb230a0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:05.753127 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 955/1922] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:05.754164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65decb5-03f3-4bb1-990b-00460eb230a0 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:05.759963 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d65decb5-03f3-4bb1-990b-00460eb230a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:05.793953 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:05.800328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65decb5-03f3-4bb1-990b-00460eb230a0 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:05.827464 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-20d8c35d-ae58-4500-9cbb-a02d05a574e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c55e5745e6ac47f993ae34a4888b3dcc', 'request_id': 'req-20d8c35d-ae58-4500-9cbb-a02d05a574e0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:05.854912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-20d8c35d-ae58-4500-9cbb-a02d05a574e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c55e5745e6ac47f993ae34a4888b3dcc', 'request_id': 'req-20d8c35d-ae58-4500-9cbb-a02d05a574e0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:05.873341 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-20d8c35d-ae58-4500-9cbb-a02d05a574e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c55e5745e6ac47f993ae34a4888b3dcc', 'request_id': 'req-20d8c35d-ae58-4500-9cbb-a02d05a574e0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:05.880996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:05.913663 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-20d8c35d-ae58-4500-9cbb-a02d05a574e0 admin admin] The token cache is being invalidate because project c55e5745e6ac47f993ae34a4888b3dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:05.915044 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-20d8c35d-ae58-4500-9cbb-a02d05a574e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:05.916375 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-20d8c35d-ae58-4500-9cbb-a02d05a574e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:05.919721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 968/1923] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:05 2022] DELETE /identity/v3/projects/c55e5745e6ac47f993ae34a4888b3dcc => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:05.921903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8c35d-ae58-4500-9cbb-a02d05a574e0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:05.927187 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-20d8c35d-ae58-4500-9cbb-a02d05a574e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:05.999731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:06.007551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:06.008468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:06.010492 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad admin admin] PATH_INFO: `/v3/projects/3fee3fa620964a01bc74b641e4c4b0f1` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:06.017020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fee3fa620964a01bc74b641e4c4b0f1)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:06.023312 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:06.095603 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8c35d-ae58-4500-9cbb-a02d05a574e0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:06.120973 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6756999-64a5-45c5-abb0-79ef3a22aa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:06.122303 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6756999-64a5-45c5-abb0-79ef3a22aa85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:06.122586 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6756999-64a5-45c5-abb0-79ef3a22aa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:06.123546 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6756999-64a5-45c5-abb0-79ef3a22aa85 admin admin] PATH_INFO: `/v3/projects/176a2baacc4840d8af766e44427d7b51/users/9cb88e1f559a4d1ead587025295644cb/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:06.158059 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fee3fa620964a01bc74b641e4c4b0f1', 'request_id': 'req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.173760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fee3fa620964a01bc74b641e4c4b0f1', 'request_id': 'req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.175203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6756999-64a5-45c5-abb0-79ef3a22aa85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=176a2baacc4840d8af766e44427d7b51, user_id=9cb88e1f559a4d1ead587025295644cb, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:06.181336 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6756999-64a5-45c5-abb0-79ef3a22aa85 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:06.197929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fee3fa620964a01bc74b641e4c4b0f1', 'request_id': 'req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.229807 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad admin admin] The token cache is being invalidate because project 3fee3fa620964a01bc74b641e4c4b0f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:06.230301 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.231641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.233991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 969/1924] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:05 2022] PUT /identity/v3/projects/176a2baacc4840d8af766e44427d7b51/users/9cb88e1f559a4d1ead587025295644cb/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:06.235591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6756999-64a5-45c5-abb0-79ef3a22aa85 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:06.239573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 956/1925] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:05 2022] DELETE /identity/v3/projects/3fee3fa620964a01bc74b641e4c4b0f1 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:06.241238 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:06.243799 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f6756999-64a5-45c5-abb0-79ef3a22aa85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:06.243997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:06.433044 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6756999-64a5-45c5-abb0-79ef3a22aa85 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:06.446779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e458787-7214-43a0-81a2-a9cace0be4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:06.448523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e458787-7214-43a0-81a2-a9cace0be4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:06.448802 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e458787-7214-43a0-81a2-a9cace0be4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:06.449084 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e458787-7214-43a0-81a2-a9cace0be4e4 admin admin] PATH_INFO: `/v3/users/f7ea81fb74014917ac26e67260303a84` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:06.450697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e458787-7214-43a0-81a2-a9cace0be4e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ea81fb74014917ac26e67260303a84)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:06.453398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e458787-7214-43a0-81a2-a9cace0be4e4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:06.467814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8c073-e7c6-4f4e-9663-8e15323d78ad admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:06.484275 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c318f4-dca7-44ab-8041-be8ccb368861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:06.485713 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c318f4-dca7-44ab-8041-be8ccb368861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:06.486150 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c318f4-dca7-44ab-8041-be8ccb368861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:06.486592 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c318f4-dca7-44ab-8041-be8ccb368861 admin admin] PATH_INFO: `/v3/users/2b7d704d8ebe494cac7df7e10f73b6e3` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:06.488477 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c318f4-dca7-44ab-8041-be8ccb368861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7d704d8ebe494cac7df7e10f73b6e3)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:06.492014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c318f4-dca7-44ab-8041-be8ccb368861 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:06.549117 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8e458787-7214-43a0-81a2-a9cace0be4e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ea81fb74014917ac26e67260303a84'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.560982 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8e458787-7214-43a0-81a2-a9cace0be4e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ea81fb74014917ac26e67260303a84'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.565776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:06.584370 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8e458787-7214-43a0-81a2-a9cace0be4e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ea81fb74014917ac26e67260303a84'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.585746 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8e458787-7214-43a0-81a2-a9cace0be4e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ea81fb74014917ac26e67260303a84'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.586255 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-49c318f4-dca7-44ab-8041-be8ccb368861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7d704d8ebe494cac7df7e10f73b6e3'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.586500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8e458787-7214-43a0-81a2-a9cace0be4e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ea81fb74014917ac26e67260303a84'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.594076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:06.614687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 970/1926] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:06 2022] DELETE /identity/v3/users/f7ea81fb74014917ac26e67260303a84 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:06.615604 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-49c318f4-dca7-44ab-8041-be8ccb368861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7d704d8ebe494cac7df7e10f73b6e3'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.616399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99aaf48-0903-4faf-a26a-f65dbd174a2e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:06.616750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99aaf48-0903-4faf-a26a-f65dbd174a2e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:06.617274 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99aaf48-0903-4faf-a26a-f65dbd174a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:06.630577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-49c318f4-dca7-44ab-8041-be8ccb368861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7d704d8ebe494cac7df7e10f73b6e3'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.632344 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-49c318f4-dca7-44ab-8041-be8ccb368861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7d704d8ebe494cac7df7e10f73b6e3'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.650995 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-49c318f4-dca7-44ab-8041-be8ccb368861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7d704d8ebe494cac7df7e10f73b6e3'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.672843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 957/1927] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:06 2022] DELETE /identity/v3/users/2b7d704d8ebe494cac7df7e10f73b6e3 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:06.674780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c318f4-dca7-44ab-8041-be8ccb368861 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:06.679307 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-49c318f4-dca7-44ab-8041-be8ccb368861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:06.717489 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c99aaf48-0903-4faf-a26a-f65dbd174a2e None None] MFA Rules not processed for user `9cb88e1f559a4d1ead587025295644cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:06.720785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c99aaf48-0903-4faf-a26a-f65dbd174a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:06.872304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c318f4-dca7-44ab-8041-be8ccb368861 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:06.880418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:06.881551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:06.882049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:06.882522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7 admin admin] PATH_INFO: `/v3/projects/fc21fe1855774163858cb428938af8f9` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:06.885220 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc21fe1855774163858cb428938af8f9)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:06.888612 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:06.930169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 971/1928] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:06.931975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99aaf48-0903-4faf-a26a-f65dbd174a2e None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:06.935091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c99aaf48-0903-4faf-a26a-f65dbd174a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:06.966296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc21fe1855774163858cb428938af8f9', 'request_id': 'req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.977388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc21fe1855774163858cb428938af8f9', 'request_id': 'req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.988195 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc21fe1855774163858cb428938af8f9', 'request_id': 'req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.007917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7 admin admin] The token cache is being invalidate because project fc21fe1855774163858cb428938af8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:07.008412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.009656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.014371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 958/1929] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:06 2022] DELETE /identity/v3/projects/fc21fe1855774163858cb428938af8f9 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:07.015370 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:07.016772 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:07.083054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:07.108771 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99aaf48-0903-4faf-a26a-f65dbd174a2e None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:07.111789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfe4fb-4ffe-4b9d-b554-523a3b7383c7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:07.119990 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbecf7-6ffa-4b9d-bfde-93b089e44f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:07.120449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbecf7-6ffa-4b9d-bfde-93b089e44f10 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.120729 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbecf7-6ffa-4b9d-bfde-93b089e44f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.120997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbecf7-6ffa-4b9d-bfde-93b089e44f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.122526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbecf7-6ffa-4b9d-bfde-93b089e44f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:07.124051 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbecf7-6ffa-4b9d-bfde-93b089e44f10 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:07.165454 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 959/1930] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:07 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:07.166955 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5794ec-d5f8-4e73-89d8-2501d5cf3469 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.167412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5794ec-d5f8-4e73-89d8-2501d5cf3469 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.167685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5794ec-d5f8-4e73-89d8-2501d5cf3469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.200396 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5c5794ec-d5f8-4e73-89d8-2501d5cf3469 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:07.201850 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5c5794ec-d5f8-4e73-89d8-2501d5cf3469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:07.257401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6c02a-0f2a-4d87-ba3c-9a57d3867927 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:07.257401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6c02a-0f2a-4d87-ba3c-9a57d3867927 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.257401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6c02a-0f2a-4d87-ba3c-9a57d3867927 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.257401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6c02a-0f2a-4d87-ba3c-9a57d3867927 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.258234 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3db6c02a-0f2a-4d87-ba3c-9a57d3867927 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:07.406294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 960/1931] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:07.407729 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5794ec-d5f8-4e73-89d8-2501d5cf3469 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:07.421036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5794ec-d5f8-4e73-89d8-2501d5cf3469 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:07.427513 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b8b65-8428-421b-a6b7-590ad8e72eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:07.428174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b8b65-8428-421b-a6b7-590ad8e72eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.428457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b8b65-8428-421b-a6b7-590ad8e72eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.428753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b8b65-8428-421b-a6b7-590ad8e72eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.430154 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b8b65-8428-421b-a6b7-590ad8e72eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:07.432846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b8b65-8428-421b-a6b7-590ad8e72eb4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:07.436998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:07.450344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6c02a-0f2a-4d87-ba3c-9a57d3867927 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:07.460627 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6c02a-0f2a-4d87-ba3c-9a57d3867927 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:07.463494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 961/1932] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:07 2022] POST /identity/v3/users => generated 297 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:07.465094 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f540f98-dd53-401c-9b1c-4fb13b73b1e0 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.465455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f540f98-dd53-401c-9b1c-4fb13b73b1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.465735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f540f98-dd53-401c-9b1c-4fb13b73b1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.492598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-0f540f98-dd53-401c-9b1c-4fb13b73b1e0 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:07.494201 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0f540f98-dd53-401c-9b1c-4fb13b73b1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:07.510246 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 972/1933] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:07.512340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 962/1934] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:07.513853 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f540f98-dd53-401c-9b1c-4fb13b73b1e0 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:07.516103 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6c02a-0f2a-4d87-ba3c-9a57d3867927 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:07.540884 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6c02a-0f2a-4d87-ba3c-9a57d3867927 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:07.541155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f540f98-dd53-401c-9b1c-4fb13b73b1e0 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:07.554171 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2e7df-d1de-4da9-8269-9f13b9a61eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:07.556158 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2e7df-d1de-4da9-8269-9f13b9a61eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.557489 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2e7df-d1de-4da9-8269-9f13b9a61eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.558418 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2e7df-d1de-4da9-8269-9f13b9a61eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.560900 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2e7df-d1de-4da9-8269-9f13b9a61eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:07.563906 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe11c5-4dcb-458b-ab88-264943828f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:07.564486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2e7df-d1de-4da9-8269-9f13b9a61eb6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:07.564977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe11c5-4dcb-458b-ab88-264943828f84 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.565525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe11c5-4dcb-458b-ab88-264943828f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.565990 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe11c5-4dcb-458b-ab88-264943828f84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.575219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe11c5-4dcb-458b-ab88-264943828f84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:07.575903 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe11c5-4dcb-458b-ab88-264943828f84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:07.586339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe11c5-4dcb-458b-ab88-264943828f84 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:07.587680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 973/1935] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:07.588975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2e7df-d1de-4da9-8269-9f13b9a61eb6 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:07.591873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2eb2e7df-d1de-4da9-8269-9f13b9a61eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:07.621971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2e7df-d1de-4da9-8269-9f13b9a61eb6 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:07.645020 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71baa03-5df0-4cfe-babd-d86c6b76f849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:07.645827 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71baa03-5df0-4cfe-babd-d86c6b76f849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.646107 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71baa03-5df0-4cfe-babd-d86c6b76f849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.646383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71baa03-5df0-4cfe-babd-d86c6b76f849 admin admin] PATH_INFO: `/v3/projects/b1de817d7a2e44db9fff648c467f704c` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.648842 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71baa03-5df0-4cfe-babd-d86c6b76f849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1de817d7a2e44db9fff648c467f704c)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:07.649456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 963/1936] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:07.651205 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe11c5-4dcb-458b-ab88-264943828f84 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:07.661970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71baa03-5df0-4cfe-babd-d86c6b76f849 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:07.675919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe11c5-4dcb-458b-ab88-264943828f84 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:07.687631 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053041f9-299c-4f5a-a3c3-6a7aee6bb693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:07.689127 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053041f9-299c-4f5a-a3c3-6a7aee6bb693 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.689246 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053041f9-299c-4f5a-a3c3-6a7aee6bb693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.689780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053041f9-299c-4f5a-a3c3-6a7aee6bb693 admin admin] PATH_INFO: `/v3/projects/eff4aa92477043bfbb016852c58d206c/users/a1dfdb48dc204325a82bd24d4437cf7d/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.730537 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053041f9-299c-4f5a-a3c3-6a7aee6bb693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff4aa92477043bfbb016852c58d206c, user_id=a1dfdb48dc204325a82bd24d4437cf7d, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:07.733945 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053041f9-299c-4f5a-a3c3-6a7aee6bb693 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:07.755601 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 964/1937] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:07 2022] PUT /identity/v3/projects/eff4aa92477043bfbb016852c58d206c/users/a1dfdb48dc204325a82bd24d4437cf7d/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:07.756381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053041f9-299c-4f5a-a3c3-6a7aee6bb693 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:07.789888 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f71baa03-5df0-4cfe-babd-d86c6b76f849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1de817d7a2e44db9fff648c467f704c', 'request_id': 'req-f71baa03-5df0-4cfe-babd-d86c6b76f849'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.799852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f71baa03-5df0-4cfe-babd-d86c6b76f849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1de817d7a2e44db9fff648c467f704c', 'request_id': 'req-f71baa03-5df0-4cfe-babd-d86c6b76f849'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.818940 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f71baa03-5df0-4cfe-babd-d86c6b76f849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1de817d7a2e44db9fff648c467f704c', 'request_id': 'req-f71baa03-5df0-4cfe-babd-d86c6b76f849'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.842736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f71baa03-5df0-4cfe-babd-d86c6b76f849 admin admin] The token cache is being invalidate because project b1de817d7a2e44db9fff648c467f704c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:07.843023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f71baa03-5df0-4cfe-babd-d86c6b76f849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.843983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f71baa03-5df0-4cfe-babd-d86c6b76f849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.847175 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 974/1938] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:07 2022] DELETE /identity/v3/projects/b1de817d7a2e44db9fff648c467f704c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:07.847390 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71baa03-5df0-4cfe-babd-d86c6b76f849 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:07.849984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f71baa03-5df0-4cfe-babd-d86c6b76f849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:07.906809 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053041f9-299c-4f5a-a3c3-6a7aee6bb693 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:07.929039 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:07.940723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71baa03-5df0-4cfe-babd-d86c6b76f849 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:07.945760 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a76fde-e65b-4ee2-b2c5-5931da7fe4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:07.946391 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a76fde-e65b-4ee2-b2c5-5931da7fe4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.946670 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a76fde-e65b-4ee2-b2c5-5931da7fe4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.947102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a76fde-e65b-4ee2-b2c5-5931da7fe4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.947804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a76fde-e65b-4ee2-b2c5-5931da7fe4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:07.950064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a76fde-e65b-4ee2-b2c5-5931da7fe4c9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:07.962888 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 975/1939] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:07.964008 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a76fde-e65b-4ee2-b2c5-5931da7fe4c9 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:07.968809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-35a76fde-e65b-4ee2-b2c5-5931da7fe4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:07.989792 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a76fde-e65b-4ee2-b2c5-5931da7fe4c9 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:07.999198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19235225-9383-4122-854c-123ab9da0c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:08.000247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19235225-9383-4122-854c-123ab9da0c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.000920 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19235225-9383-4122-854c-123ab9da0c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.001566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19235225-9383-4122-854c-123ab9da0c67 admin admin] PATH_INFO: `/v3/projects/c76fed412a1342ab8b6718892a1ca427` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.005971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19235225-9383-4122-854c-123ab9da0c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c76fed412a1342ab8b6718892a1ca427)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:08.009329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19235225-9383-4122-854c-123ab9da0c67 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:08.034036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6e15d-4650-4328-b189-37f6959fee64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:08.035027 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6e15d-4650-4328-b189-37f6959fee64 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.035410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6e15d-4650-4328-b189-37f6959fee64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.037037 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6e15d-4650-4328-b189-37f6959fee64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.038442 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6e15d-4650-4328-b189-37f6959fee64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:08.042388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6e15d-4650-4328-b189-37f6959fee64 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:08.093090 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-19235225-9383-4122-854c-123ab9da0c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c76fed412a1342ab8b6718892a1ca427', 'request_id': 'req-19235225-9383-4122-854c-123ab9da0c67'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:08.102956 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-19235225-9383-4122-854c-123ab9da0c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c76fed412a1342ab8b6718892a1ca427', 'request_id': 'req-19235225-9383-4122-854c-123ab9da0c67'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:08.106597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:08.116095 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-19235225-9383-4122-854c-123ab9da0c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c76fed412a1342ab8b6718892a1ca427', 'request_id': 'req-19235225-9383-4122-854c-123ab9da0c67'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:08.116303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 965/1940] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:07 2022] POST /identity/v3/projects => generated 385 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:08.117493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6e15d-4650-4328-b189-37f6959fee64 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:08.122949 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9ff6e15d-4650-4328-b189-37f6959fee64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:08.144445 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-19235225-9383-4122-854c-123ab9da0c67 admin admin] The token cache is being invalidate because project c76fed412a1342ab8b6718892a1ca427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:08.144848 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-19235225-9383-4122-854c-123ab9da0c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:08.147392 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-19235225-9383-4122-854c-123ab9da0c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:08.150669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 976/1941] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:07 2022] DELETE /identity/v3/projects/c76fed412a1342ab8b6718892a1ca427 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:08.154843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19235225-9383-4122-854c-123ab9da0c67 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:08.159240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-19235225-9383-4122-854c-123ab9da0c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:08.245088 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6e15d-4650-4328-b189-37f6959fee64 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:08.251556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606606cb-bbae-4998-9375-9fc636968896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:08.251798 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19235225-9383-4122-854c-123ab9da0c67 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:08.252747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606606cb-bbae-4998-9375-9fc636968896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.253204 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606606cb-bbae-4998-9375-9fc636968896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.253688 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606606cb-bbae-4998-9375-9fc636968896 admin admin] PATH_INFO: `/v3/users/6b309d2eafaa42c384790787536a6ead` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.255346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606606cb-bbae-4998-9375-9fc636968896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b309d2eafaa42c384790787536a6ead)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:08.257806 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606606cb-bbae-4998-9375-9fc636968896 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:08.258276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce399e-db0f-41a9-9fc8-b044d855d3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:08.258991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce399e-db0f-41a9-9fc8-b044d855d3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.259450 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce399e-db0f-41a9-9fc8-b044d855d3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.259631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce399e-db0f-41a9-9fc8-b044d855d3bd admin admin] PATH_INFO: `/v3/projects/eff4aa92477043bfbb016852c58d206c/users/a1dfdb48dc204325a82bd24d4437cf7d/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.262105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce399e-db0f-41a9-9fc8-b044d855d3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff4aa92477043bfbb016852c58d206c, user_id=a1dfdb48dc204325a82bd24d4437cf7d, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:08.266732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce399e-db0f-41a9-9fc8-b044d855d3bd admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:08.285111 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 977/1942] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:08 2022] PUT /identity/v3/projects/eff4aa92477043bfbb016852c58d206c/users/a1dfdb48dc204325a82bd24d4437cf7d/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:08.285649 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce399e-db0f-41a9-9fc8-b044d855d3bd admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:08.310879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a2ce399e-db0f-41a9-9fc8-b044d855d3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:08.379385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-606606cb-bbae-4998-9375-9fc636968896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b309d2eafaa42c384790787536a6ead'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:08.412008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-606606cb-bbae-4998-9375-9fc636968896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b309d2eafaa42c384790787536a6ead'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:08.428666 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-606606cb-bbae-4998-9375-9fc636968896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b309d2eafaa42c384790787536a6ead'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:08.430161 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-606606cb-bbae-4998-9375-9fc636968896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b309d2eafaa42c384790787536a6ead'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:08.447154 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-606606cb-bbae-4998-9375-9fc636968896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b309d2eafaa42c384790787536a6ead'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:08.469451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 966/1943] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:08 2022] DELETE /identity/v3/users/6b309d2eafaa42c384790787536a6ead => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:08.477449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090bfa1-9ce8-402b-96a3-481ca692f31f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.477866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090bfa1-9ce8-402b-96a3-481ca692f31f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.478097 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090bfa1-9ce8-402b-96a3-481ca692f31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.525132 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d090bfa1-9ce8-402b-96a3-481ca692f31f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:08.526990 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d090bfa1-9ce8-402b-96a3-481ca692f31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:08.552456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:08.565938 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce399e-db0f-41a9-9fc8-b044d855d3bd admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:08.721474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 967/1944] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:08.721474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d332-1097-46e6-896a-86dce80e2014 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.721474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d332-1097-46e6-896a-86dce80e2014 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.721474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d332-1097-46e6-896a-86dce80e2014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.722753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa3337-455c-49b0-aabd-56d2d3225254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:08.734019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3337-455c-49b0-aabd-56d2d3225254 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.734019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3337-455c-49b0-aabd-56d2d3225254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.734019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3337-455c-49b0-aabd-56d2d3225254 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.734019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa3337-455c-49b0-aabd-56d2d3225254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:08.734019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa3337-455c-49b0-aabd-56d2d3225254 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:08.801822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 978/1945] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:08 2022] POST /identity/v3/users => generated 293 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:08.810690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22491cde-d530-4686-8abb-59bd1476226b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.811625 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22491cde-d530-4686-8abb-59bd1476226b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.812090 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22491cde-d530-4686-8abb-59bd1476226b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.836905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b514d332-1097-46e6-896a-86dce80e2014 None None] MFA Rules not processed for user `a1dfdb48dc204325a82bd24d4437cf7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:08.838566 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b514d332-1097-46e6-896a-86dce80e2014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:08.872318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-22491cde-d530-4686-8abb-59bd1476226b None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:08.874194 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-22491cde-d530-4686-8abb-59bd1476226b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:08.901763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 979/1946] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:08.905823 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22491cde-d530-4686-8abb-59bd1476226b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:08.910252 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-22491cde-d530-4686-8abb-59bd1476226b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:08.946647 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22491cde-d530-4686-8abb-59bd1476226b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:08.953816 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadf560-4f8c-4b32-adef-ed4d10c5db0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:08.954731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadf560-4f8c-4b32-adef-ed4d10c5db0e admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.954890 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadf560-4f8c-4b32-adef-ed4d10c5db0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.955215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadf560-4f8c-4b32-adef-ed4d10c5db0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.955880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadf560-4f8c-4b32-adef-ed4d10c5db0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:08.958275 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadf560-4f8c-4b32-adef-ed4d10c5db0e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:08.967102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:08.983514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 980/1947] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:08.984767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadf560-4f8c-4b32-adef-ed4d10c5db0e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.000925 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadf560-4f8c-4b32-adef-ed4d10c5db0e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.010858 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0afa2-65ae-4f5e-ace7-a848104dc212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.011325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0afa2-65ae-4f5e-ace7-a848104dc212 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.011637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0afa2-65ae-4f5e-ace7-a848104dc212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.011938 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0afa2-65ae-4f5e-ace7-a848104dc212 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.013883 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0afa2-65ae-4f5e-ace7-a848104dc212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:09.015327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0afa2-65ae-4f5e-ace7-a848104dc212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.030212 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0afa2-65ae-4f5e-ace7-a848104dc212 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.057002 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 981/1948] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:09.058124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0afa2-65ae-4f5e-ace7-a848104dc212 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.075008 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0afa2-65ae-4f5e-ace7-a848104dc212 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.077845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 968/1949] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:09.079268 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514d332-1097-46e6-896a-86dce80e2014 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.082260 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b514d332-1097-46e6-896a-86dce80e2014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:09.086627 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851c92c-c455-4588-8635-27788f6cafe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.087342 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851c92c-c455-4588-8635-27788f6cafe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.087670 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851c92c-c455-4588-8635-27788f6cafe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.087964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851c92c-c455-4588-8635-27788f6cafe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.088743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851c92c-c455-4588-8635-27788f6cafe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.090767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851c92c-c455-4588-8635-27788f6cafe8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.107868 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 982/1950] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:09.108969 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851c92c-c455-4588-8635-27788f6cafe8 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.112451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514d332-1097-46e6-896a-86dce80e2014 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.124520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.125501 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851c92c-c455-4588-8635-27788f6cafe8 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.125828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.126351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.126846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda admin admin] PATH_INFO: `/v3/projects/de989dab400b4ba69d24a13b338067b5` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.128987 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda admin admin] RBAC: Authorizing `identity:delete_project(project_id=de989dab400b4ba69d24a13b338067b5)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.132123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5528c-0dd6-4aaa-bd32-818f0cb73845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.132789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.133095 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5528c-0dd6-4aaa-bd32-818f0cb73845 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.133493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5528c-0dd6-4aaa-bd32-818f0cb73845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.133936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5528c-0dd6-4aaa-bd32-818f0cb73845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.134667 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5528c-0dd6-4aaa-bd32-818f0cb73845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.137048 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5528c-0dd6-4aaa-bd32-818f0cb73845 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.188114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 983/1951] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:09 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:09.192995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5528c-0dd6-4aaa-bd32-818f0cb73845 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.195165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c8a5528c-0dd6-4aaa-bd32-818f0cb73845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:09.231170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de989dab400b4ba69d24a13b338067b5', 'request_id': 'req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:09.242658 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de989dab400b4ba69d24a13b338067b5', 'request_id': 'req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:09.253648 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de989dab400b4ba69d24a13b338067b5', 'request_id': 'req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:09.268189 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda admin admin] The token cache is being invalidate because project de989dab400b4ba69d24a13b338067b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:09.268536 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:09.269516 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:09.271165 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 969/1952] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:09 2022] DELETE /identity/v3/projects/de989dab400b4ba69d24a13b338067b5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:09.271971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.273647 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:09.309270 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5528c-0dd6-4aaa-bd32-818f0cb73845 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.351736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:09.412995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629abf81-b7db-4558-97e8-78a4159c4dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.415001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629abf81-b7db-4558-97e8-78a4159c4dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.415001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629abf81-b7db-4558-97e8-78a4159c4dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.415001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629abf81-b7db-4558-97e8-78a4159c4dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.425705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-629abf81-b7db-4558-97e8-78a4159c4dd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:09.435734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e5ee4-facc-43d4-ab96-dfe3b8974fda admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.445741 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd0c95-30ed-4955-8d55-c82b458bf0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.447182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd0c95-30ed-4955-8d55-c82b458bf0cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.447859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd0c95-30ed-4955-8d55-c82b458bf0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.448334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd0c95-30ed-4955-8d55-c82b458bf0cb admin admin] PATH_INFO: `/v3/projects/c8ec2474ea464a1a9e73619ca271bccd/users/df89a5fa3ae448f8b23d80f29dd31b39/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.483215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd0c95-30ed-4955-8d55-c82b458bf0cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ec2474ea464a1a9e73619ca271bccd, user_id=df89a5fa3ae448f8b23d80f29dd31b39, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.486726 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd0c95-30ed-4955-8d55-c82b458bf0cb admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.509255 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 970/1953] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:09 2022] PUT /identity/v3/projects/c8ec2474ea464a1a9e73619ca271bccd/users/df89a5fa3ae448f8b23d80f29dd31b39/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:09.511387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd0c95-30ed-4955-8d55-c82b458bf0cb admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.514454 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-49cd0c95-30ed-4955-8d55-c82b458bf0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:09.545263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629abf81-b7db-4558-97e8-78a4159c4dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.547327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629abf81-b7db-4558-97e8-78a4159c4dd5 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.562257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 984/1954] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:09.564137 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e98caf-d40c-47d5-b34a-121d91424677 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.564550 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e98caf-d40c-47d5-b34a-121d91424677 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.565519 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e98caf-d40c-47d5-b34a-121d91424677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.618417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d3e98caf-d40c-47d5-b34a-121d91424677 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:09.623897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d3e98caf-d40c-47d5-b34a-121d91424677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:09.655904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:09.676977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd0c95-30ed-4955-8d55-c82b458bf0cb admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.684834 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7af65-9c3b-4fa6-80be-e237712a6c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.685936 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7af65-9c3b-4fa6-80be-e237712a6c99 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.686449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7af65-9c3b-4fa6-80be-e237712a6c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.687057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7af65-9c3b-4fa6-80be-e237712a6c99 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.688385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7af65-9c3b-4fa6-80be-e237712a6c99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.692085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7af65-9c3b-4fa6-80be-e237712a6c99 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.745320 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 971/1955] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:09 2022] POST /identity/v3/users => generated 285 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:09.747470 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae1bd8-a635-4bac-955a-f1f669f86640 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.748202 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae1bd8-a635-4bac-955a-f1f669f86640 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.748642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae1bd8-a635-4bac-955a-f1f669f86640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.768013 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 985/1956] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:09.781794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e98caf-d40c-47d5-b34a-121d91424677 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.795472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e98caf-d40c-47d5-b34a-121d91424677 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.806638 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-64ae1bd8-a635-4bac-955a-f1f669f86640 None None] MFA Rules not processed for user `df89a5fa3ae448f8b23d80f29dd31b39`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:09.808137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-64ae1bd8-a635-4bac-955a-f1f669f86640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:09.836567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915dca9-3d8a-4bde-880b-b4b32b8f3a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.837777 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915dca9-3d8a-4bde-880b-b4b32b8f3a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.838883 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915dca9-3d8a-4bde-880b-b4b32b8f3a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.840267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915dca9-3d8a-4bde-880b-b4b32b8f3a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.843409 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915dca9-3d8a-4bde-880b-b4b32b8f3a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.846794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915dca9-3d8a-4bde-880b-b4b32b8f3a24 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.891526 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 986/1957] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:09.905565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39a86c-9e27-49d3-b463-12b66720d242 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.905565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39a86c-9e27-49d3-b463-12b66720d242 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.905565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39a86c-9e27-49d3-b463-12b66720d242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.990318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1c39a86c-9e27-49d3-b463-12b66720d242 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:10.000147 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1c39a86c-9e27-49d3-b463-12b66720d242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:10.017140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 972/1958] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:10.018389 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae1bd8-a635-4bac-955a-f1f669f86640 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.023465 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-64ae1bd8-a635-4bac-955a-f1f669f86640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:10.047629 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 987/1959] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:10.049832 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39a86c-9e27-49d3-b463-12b66720d242 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.073149 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39a86c-9e27-49d3-b463-12b66720d242 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.093235 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3226c-224e-4fe6-838d-05528e4baa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.094204 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3226c-224e-4fe6-838d-05528e4baa54 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.094634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3226c-224e-4fe6-838d-05528e4baa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.095049 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3226c-224e-4fe6-838d-05528e4baa54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.096089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3226c-224e-4fe6-838d-05528e4baa54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.101490 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3226c-224e-4fe6-838d-05528e4baa54 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.122176 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:10.125732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 988/1960] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:10.127133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3226c-224e-4fe6-838d-05528e4baa54 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.138260 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e1c3226c-224e-4fe6-838d-05528e4baa54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:10.180905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae1bd8-a635-4bac-955a-f1f669f86640 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.189916 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47ec1d-71f7-4997-9aaa-aed4b54d26b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.190533 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47ec1d-71f7-4997-9aaa-aed4b54d26b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.190812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47ec1d-71f7-4997-9aaa-aed4b54d26b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.191086 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47ec1d-71f7-4997-9aaa-aed4b54d26b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.193059 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0b47ec1d-71f7-4997-9aaa-aed4b54d26b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:10.269990 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b47ec1d-71f7-4997-9aaa-aed4b54d26b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.271564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b47ec1d-71f7-4997-9aaa-aed4b54d26b4 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.282531 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 973/1961] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:10.283430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47ec1d-71f7-4997-9aaa-aed4b54d26b4 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.287253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3226c-224e-4fe6-838d-05528e4baa54 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.293311 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeaec7-c8c8-44b8-8e92-1fa07bb59405 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.295257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeaec7-c8c8-44b8-8e92-1fa07bb59405 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.295736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeaec7-c8c8-44b8-8e92-1fa07bb59405 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.296199 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeaec7-c8c8-44b8-8e92-1fa07bb59405 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.307167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47ec1d-71f7-4997-9aaa-aed4b54d26b4 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.317268 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aeaec7-c8c8-44b8-8e92-1fa07bb59405 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.321017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbd082-130b-45a4-a6f3-6a3059c0e8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.321672 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aeaec7-c8c8-44b8-8e92-1fa07bb59405 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.322111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbd082-130b-45a4-a6f3-6a3059c0e8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.322838 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbd082-130b-45a4-a6f3-6a3059c0e8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.325438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbd082-130b-45a4-a6f3-6a3059c0e8e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.326630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbd082-130b-45a4-a6f3-6a3059c0e8e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:10.327157 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbd082-130b-45a4-a6f3-6a3059c0e8e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.330170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbd082-130b-45a4-a6f3-6a3059c0e8e1 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.380415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 989/1962] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:10.382201 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeaec7-c8c8-44b8-8e92-1fa07bb59405 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.399199 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 974/1963] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:10.405628 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbd082-130b-45a4-a6f3-6a3059c0e8e1 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.410133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeaec7-c8c8-44b8-8e92-1fa07bb59405 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.417631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae903c-50e2-4af2-a6a8-b67025a9de4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.418758 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae903c-50e2-4af2-a6a8-b67025a9de4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.419499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae903c-50e2-4af2-a6a8-b67025a9de4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.420347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae903c-50e2-4af2-a6a8-b67025a9de4b admin admin] PATH_INFO: `/v3/projects/3e515f74eb1d4ec9a70e3cffe2b08d85/users/b28d47e1156c47aca276dfe782c35622/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.420666 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbd082-130b-45a4-a6f3-6a3059c0e8e1 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.429803 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa812d42-d331-4c2d-b29f-8c3dc0a55771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.431517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa812d42-d331-4c2d-b29f-8c3dc0a55771 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.432198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa812d42-d331-4c2d-b29f-8c3dc0a55771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.432867 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa812d42-d331-4c2d-b29f-8c3dc0a55771 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.433939 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa812d42-d331-4c2d-b29f-8c3dc0a55771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.436783 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa812d42-d331-4c2d-b29f-8c3dc0a55771 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.464018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae903c-50e2-4af2-a6a8-b67025a9de4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e515f74eb1d4ec9a70e3cffe2b08d85, user_id=b28d47e1156c47aca276dfe782c35622, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.479165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae903c-50e2-4af2-a6a8-b67025a9de4b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.509858 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 975/1964] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:10 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:10.510635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa812d42-d331-4c2d-b29f-8c3dc0a55771 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.525460 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 990/1965] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:10 2022] PUT /identity/v3/projects/3e515f74eb1d4ec9a70e3cffe2b08d85/users/b28d47e1156c47aca276dfe782c35622/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:10.533855 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8083f4-d2f1-408f-acb3-1b50b561347f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.534380 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8083f4-d2f1-408f-acb3-1b50b561347f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.534864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8083f4-d2f1-408f-acb3-1b50b561347f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.574715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-0f8083f4-d2f1-408f-acb3-1b50b561347f None None] MFA Rules not processed for user `b28d47e1156c47aca276dfe782c35622`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:10.577400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0f8083f4-d2f1-408f-acb3-1b50b561347f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:10.636155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa812d42-d331-4c2d-b29f-8c3dc0a55771 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.642758 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7c007-ff47-4841-9d00-7f4cdcd8d142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.643553 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7c007-ff47-4841-9d00-7f4cdcd8d142 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.643841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7c007-ff47-4841-9d00-7f4cdcd8d142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.644106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7c007-ff47-4841-9d00-7f4cdcd8d142 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.645126 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7c007-ff47-4841-9d00-7f4cdcd8d142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.647958 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7c007-ff47-4841-9d00-7f4cdcd8d142 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.667225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:10.680966 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 976/1966] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:10 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:10.688180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7c007-ff47-4841-9d00-7f4cdcd8d142 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.689480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 991/1967] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:10.691281 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8083f4-d2f1-408f-acb3-1b50b561347f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.704255 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7c007-ff47-4841-9d00-7f4cdcd8d142 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.711521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04816d3-3521-468b-b5b0-84424859766d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.712456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04816d3-3521-468b-b5b0-84424859766d admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.712745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04816d3-3521-468b-b5b0-84424859766d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.713017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04816d3-3521-468b-b5b0-84424859766d admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.713634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8083f4-d2f1-408f-acb3-1b50b561347f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.713780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04816d3-3521-468b-b5b0-84424859766d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.716531 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04816d3-3521-468b-b5b0-84424859766d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.723248 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a625df0-1910-4332-885b-305cd00c3029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.724443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a625df0-1910-4332-885b-305cd00c3029 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.724956 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a625df0-1910-4332-885b-305cd00c3029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.725611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a625df0-1910-4332-885b-305cd00c3029 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.727187 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a625df0-1910-4332-885b-305cd00c3029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.731037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a625df0-1910-4332-885b-305cd00c3029 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.731682 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 977/1968] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:32:10.736196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04816d3-3521-468b-b5b0-84424859766d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.752442 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04816d3-3521-468b-b5b0-84424859766d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.761115 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432befc-4335-4730-a9b0-35c3df6ebd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.761841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432befc-4335-4730-a9b0-35c3df6ebd34 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.762278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432befc-4335-4730-a9b0-35c3df6ebd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.762406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432befc-4335-4730-a9b0-35c3df6ebd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.763196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432befc-4335-4730-a9b0-35c3df6ebd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.765621 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432befc-4335-4730-a9b0-35c3df6ebd34 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.780401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 978/1969] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:32:10.784931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432befc-4335-4730-a9b0-35c3df6ebd34 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.803349 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432befc-4335-4730-a9b0-35c3df6ebd34 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:10.809453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 992/1970] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:10 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:10.815827 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae311408-0d5b-4e7f-8fa7-452e91c1d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:10.816844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a625df0-1910-4332-885b-305cd00c3029 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:10.817805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae311408-0d5b-4e7f-8fa7-452e91c1d6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.818564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae311408-0d5b-4e7f-8fa7-452e91c1d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.819313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae311408-0d5b-4e7f-8fa7-452e91c1d6aa admin admin] PATH_INFO: `/v3/projects/14a49e84d0e4454481ebc1ce5bffcbda/users/0b5c373ef377450799e34efbc87cae3b/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.861172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae311408-0d5b-4e7f-8fa7-452e91c1d6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a49e84d0e4454481ebc1ce5bffcbda, user_id=0b5c373ef377450799e34efbc87cae3b, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:10.867337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae311408-0d5b-4e7f-8fa7-452e91c1d6aa admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:10.872601 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:10.911451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 979/1971] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:10 2022] PUT /identity/v3/projects/14a49e84d0e4454481ebc1ce5bffcbda/users/0b5c373ef377450799e34efbc87cae3b/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:10.934989 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8f6a4-f407-4e20-be91-42808001a4f8 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.935507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8f6a4-f407-4e20-be91-42808001a4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.936015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8f6a4-f407-4e20-be91-42808001a4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.005934 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a625df0-1910-4332-885b-305cd00c3029 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:11.025563 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b6b8f6a4-f407-4e20-be91-42808001a4f8 None None] MFA Rules not processed for user `0b5c373ef377450799e34efbc87cae3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:11.031372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b6b8f6a4-f407-4e20-be91-42808001a4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:11.169318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db7f7a-720d-4546-9dde-dafe1ef20d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:11.170510 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db7f7a-720d-4546-9dde-dafe1ef20d59 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:11.171962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db7f7a-720d-4546-9dde-dafe1ef20d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:11.179351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db7f7a-720d-4546-9dde-dafe1ef20d59 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.181256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db7f7a-720d-4546-9dde-dafe1ef20d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:11.187359 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db7f7a-720d-4546-9dde-dafe1ef20d59 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:11.244987 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 993/1972] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:10 2022] POST /identity/v3/users => generated 291 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:11.247123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db7f7a-720d-4546-9dde-dafe1ef20d59 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:11.272035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db7f7a-720d-4546-9dde-dafe1ef20d59 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:11.289009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 980/1973] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:11.295572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28295f27-9d34-4b08-ad1c-c0c84d299d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:11.295868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8f6a4-f407-4e20-be91-42808001a4f8 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:11.297753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28295f27-9d34-4b08-ad1c-c0c84d299d57 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:11.300809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28295f27-9d34-4b08-ad1c-c0c84d299d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:11.301636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28295f27-9d34-4b08-ad1c-c0c84d299d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.307573 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28295f27-9d34-4b08-ad1c-c0c84d299d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:11.311386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8f6a4-f407-4e20-be91-42808001a4f8 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:11.318346 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28295f27-9d34-4b08-ad1c-c0c84d299d57 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:11.358183 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 994/1974] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:11.370249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28295f27-9d34-4b08-ad1c-c0c84d299d57 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:11.372672 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa777b-77b6-40a6-a4b3-1a4fca68e669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:11.373700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa777b-77b6-40a6-a4b3-1a4fca68e669 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:11.374183 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa777b-77b6-40a6-a4b3-1a4fca68e669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:11.374656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa777b-77b6-40a6-a4b3-1a4fca68e669 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.375709 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa777b-77b6-40a6-a4b3-1a4fca68e669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:11.381230 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa777b-77b6-40a6-a4b3-1a4fca68e669 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:11.427305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28295f27-9d34-4b08-ad1c-c0c84d299d57 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:11.448156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa78314-53f2-4649-b85e-dec49b2ccdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:11.449870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa78314-53f2-4649-b85e-dec49b2ccdb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:11.450359 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa78314-53f2-4649-b85e-dec49b2ccdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:11.450838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa78314-53f2-4649-b85e-dec49b2ccdb0 admin admin] PATH_INFO: `/v3/projects/ebe4b20c07874e0ba266cfcc208231a7/users/39d5583911834498a86984d75724ee70/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.501462 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 981/1975] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:11 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:11.508474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa777b-77b6-40a6-a4b3-1a4fca68e669 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:11.509302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa78314-53f2-4649-b85e-dec49b2ccdb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe4b20c07874e0ba266cfcc208231a7, user_id=39d5583911834498a86984d75724ee70, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:11.518424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa78314-53f2-4649-b85e-dec49b2ccdb0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:11.547753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 995/1976] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:11 2022] PUT /identity/v3/projects/ebe4b20c07874e0ba266cfcc208231a7/users/39d5583911834498a86984d75724ee70/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:11.548883 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa78314-53f2-4649-b85e-dec49b2ccdb0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:11.557442 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5aa78314-53f2-4649-b85e-dec49b2ccdb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:11.666434 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:11.683748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa777b-77b6-40a6-a4b3-1a4fca68e669 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:11.705055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa78314-53f2-4649-b85e-dec49b2ccdb0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:11.710869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfec82-edb0-47b4-8317-9a7e054a6ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:11.712389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfec82-edb0-47b4-8317-9a7e054a6ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:11.712389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfec82-edb0-47b4-8317-9a7e054a6ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:11.712389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfec82-edb0-47b4-8317-9a7e054a6ca6 admin admin] PATH_INFO: `/v3/users/02e9460b6c6b4c4aae21aa7ec1372ef9` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.713771 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfec82-edb0-47b4-8317-9a7e054a6ca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02e9460b6c6b4c4aae21aa7ec1372ef9)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:11.716201 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfec82-edb0-47b4-8317-9a7e054a6ca6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:11.801903 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e8fd2-b3ff-4db9-9fb0-bb4f5c2cb39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:11.802836 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e8fd2-b3ff-4db9-9fb0-bb4f5c2cb39d admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:11.803305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e8fd2-b3ff-4db9-9fb0-bb4f5c2cb39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:11.803930 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e8fd2-b3ff-4db9-9fb0-bb4f5c2cb39d admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.805493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e8fd2-b3ff-4db9-9fb0-bb4f5c2cb39d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:11.809695 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e8fd2-b3ff-4db9-9fb0-bb4f5c2cb39d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:11.811162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e5dfec82-edb0-47b4-8317-9a7e054a6ca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02e9460b6c6b4c4aae21aa7ec1372ef9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:11.833653 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e5dfec82-edb0-47b4-8317-9a7e054a6ca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02e9460b6c6b4c4aae21aa7ec1372ef9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:11.847434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:11.867640 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e5dfec82-edb0-47b4-8317-9a7e054a6ca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02e9460b6c6b4c4aae21aa7ec1372ef9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:11.867640 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e5dfec82-edb0-47b4-8317-9a7e054a6ca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02e9460b6c6b4c4aae21aa7ec1372ef9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:11.868269 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e5dfec82-edb0-47b4-8317-9a7e054a6ca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02e9460b6c6b4c4aae21aa7ec1372ef9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:11.869212 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 982/1977] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:11 2022] POST /identity/v3/users => generated 296 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:11.871497 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e8fd2-b3ff-4db9-9fb0-bb4f5c2cb39d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:11.875171 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-205e8fd2-b3ff-4db9-9fb0-bb4f5c2cb39d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:11.907198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 996/1978] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:11 2022] DELETE /identity/v3/users/02e9460b6c6b4c4aae21aa7ec1372ef9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:11.909234 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfec82-edb0-47b4-8317-9a7e054a6ca6 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:11.912917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e8fd2-b3ff-4db9-9fb0-bb4f5c2cb39d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:11.913873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e5dfec82-edb0-47b4-8317-9a7e054a6ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:12.045021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfec82-edb0-47b4-8317-9a7e054a6ca6 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:12.056986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e81598-0592-4a82-8eed-8b71038245f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:12.058146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e81598-0592-4a82-8eed-8b71038245f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:12.059299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e81598-0592-4a82-8eed-8b71038245f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:12.060085 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e81598-0592-4a82-8eed-8b71038245f8 admin admin] PATH_INFO: `/v3/users/9cb88e1f559a4d1ead587025295644cb` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:12.062672 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e81598-0592-4a82-8eed-8b71038245f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb88e1f559a4d1ead587025295644cb)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:12.067067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e81598-0592-4a82-8eed-8b71038245f8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:12.070677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c35d2-2a5c-474c-a030-b507c043367d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:12.071730 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c35d2-2a5c-474c-a030-b507c043367d admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:12.072178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c35d2-2a5c-474c-a030-b507c043367d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:12.073521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c35d2-2a5c-474c-a030-b507c043367d admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:12.075336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c35d2-2a5c-474c-a030-b507c043367d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:12.079057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c35d2-2a5c-474c-a030-b507c043367d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:12.107852 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 983/1979] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:12.109849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c35d2-2a5c-474c-a030-b507c043367d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:12.114486 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1c2c35d2-2a5c-474c-a030-b507c043367d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:12.143002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c35d2-2a5c-474c-a030-b507c043367d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:12.154857 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6aa12-e4d3-49ac-927a-23936dd7057a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:12.156023 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6aa12-e4d3-49ac-927a-23936dd7057a admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:12.156584 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6aa12-e4d3-49ac-927a-23936dd7057a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:12.157177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6aa12-e4d3-49ac-927a-23936dd7057a admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:12.158513 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6aa12-e4d3-49ac-927a-23936dd7057a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:12.163776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6aa12-e4d3-49ac-927a-23936dd7057a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:12.185514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-73e81598-0592-4a82-8eed-8b71038245f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb88e1f559a4d1ead587025295644cb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.199096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-73e81598-0592-4a82-8eed-8b71038245f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb88e1f559a4d1ead587025295644cb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.206926 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 984/1980] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:12.206926 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb946b4c-4ae8-4b52-b767-882fd7580c3a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:12.206926 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb946b4c-4ae8-4b52-b767-882fd7580c3a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:12.206926 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb946b4c-4ae8-4b52-b767-882fd7580c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:12.215089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:12.238241 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-73e81598-0592-4a82-8eed-8b71038245f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb88e1f559a4d1ead587025295644cb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.240549 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-73e81598-0592-4a82-8eed-8b71038245f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb88e1f559a4d1ead587025295644cb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.242087 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-73e81598-0592-4a82-8eed-8b71038245f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb88e1f559a4d1ead587025295644cb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.263666 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-eb946b4c-4ae8-4b52-b767-882fd7580c3a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:12.266092 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-eb946b4c-4ae8-4b52-b767-882fd7580c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:12.280979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 985/1982] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:12.282517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb946b4c-4ae8-4b52-b767-882fd7580c3a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:12.283858 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 997/1982] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:11 2022] DELETE /identity/v3/users/9cb88e1f559a4d1ead587025295644cb => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:12.285540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e81598-0592-4a82-8eed-8b71038245f8 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:12.286270 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-eb946b4c-4ae8-4b52-b767-882fd7580c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:12.291164 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-73e81598-0592-4a82-8eed-8b71038245f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:12.321243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb946b4c-4ae8-4b52-b767-882fd7580c3a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:12.436499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed1f5f-f146-44b9-a18f-135900785235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:12.437445 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed1f5f-f146-44b9-a18f-135900785235 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:12.437928 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed1f5f-f146-44b9-a18f-135900785235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:12.438555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed1f5f-f146-44b9-a18f-135900785235 admin admin] PATH_INFO: `/v3/projects/ebe4b20c07874e0ba266cfcc208231a7/users/39d5583911834498a86984d75724ee70/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:12.441032 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed1f5f-f146-44b9-a18f-135900785235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe4b20c07874e0ba266cfcc208231a7, user_id=39d5583911834498a86984d75724ee70, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:12.444655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed1f5f-f146-44b9-a18f-135900785235 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:12.460171 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e81598-0592-4a82-8eed-8b71038245f8 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:12.462988 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 986/1983] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:12 2022] PUT /identity/v3/projects/ebe4b20c07874e0ba266cfcc208231a7/users/39d5583911834498a86984d75724ee70/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:12.464640 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6844ac-d0ca-45b9-b056-f33841bf234f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:12.465152 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6844ac-d0ca-45b9-b056-f33841bf234f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:12.465813 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6844ac-d0ca-45b9-b056-f33841bf234f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:12.536474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-db6844ac-d0ca-45b9-b056-f33841bf234f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:12.539042 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-db6844ac-d0ca-45b9-b056-f33841bf234f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:12.619997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dbad8-5685-4eb6-a50c-330171acd263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:12.621582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dbad8-5685-4eb6-a50c-330171acd263 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:12.622297 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dbad8-5685-4eb6-a50c-330171acd263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:12.623878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dbad8-5685-4eb6-a50c-330171acd263 admin admin] PATH_INFO: `/v3/projects/458eceb840ef45efbc4491265ed55da5/users/904351f5f5d14f0ca887c46e0142161f/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:12.659032 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dbad8-5685-4eb6-a50c-330171acd263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=458eceb840ef45efbc4491265ed55da5, user_id=904351f5f5d14f0ca887c46e0142161f, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:12.662712 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dbad8-5685-4eb6-a50c-330171acd263 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:12.675402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 987/1984] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:12.676137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6844ac-d0ca-45b9-b056-f33841bf234f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:12.681165 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-db6844ac-d0ca-45b9-b056-f33841bf234f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:12.700307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 998/1985] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:12 2022] PUT /identity/v3/projects/458eceb840ef45efbc4491265ed55da5/users/904351f5f5d14f0ca887c46e0142161f/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:12.701972 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a1a51-feab-4bc0-a2a5-79673295d286 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:12.703399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a1a51-feab-4bc0-a2a5-79673295d286 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:12.704356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a1a51-feab-4bc0-a2a5-79673295d286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:12.711785 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:12.780124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-8e0a1a51-feab-4bc0-a2a5-79673295d286 None None] MFA Rules not processed for user `39d5583911834498a86984d75724ee70`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:12.786110 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8e0a1a51-feab-4bc0-a2a5-79673295d286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:12.832062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6844ac-d0ca-45b9-b056-f33841bf234f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:12.876079 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:12.908510 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 999/1986] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:12.909515 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a1a51-feab-4bc0-a2a5-79673295d286 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:12.925135 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff10e0-715c-40ab-9ea5-b8696f5009e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:12.926169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff10e0-715c-40ab-9ea5-b8696f5009e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:12.926597 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff10e0-715c-40ab-9ea5-b8696f5009e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:12.926960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff10e0-715c-40ab-9ea5-b8696f5009e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.018846 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a1a51-feab-4bc0-a2a5-79673295d286 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:13.025954 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e43c0-8634-4cb5-9ec2-3dcd81861f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:13.027087 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e43c0-8634-4cb5-9ec2-3dcd81861f95 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.027653 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e43c0-8634-4cb5-9ec2-3dcd81861f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.028464 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e43c0-8634-4cb5-9ec2-3dcd81861f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.056967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff10e0-715c-40ab-9ea5-b8696f5009e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:13.058806 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff10e0-715c-40ab-9ea5-b8696f5009e1 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:13.078318 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 988/1987] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:13.079266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff10e0-715c-40ab-9ea5-b8696f5009e1 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:13.098140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff10e0-715c-40ab-9ea5-b8696f5009e1 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:13.107581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ff21c-bf19-4aed-8f00-336daa043ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:13.110252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff21c-bf19-4aed-8f00-336daa043ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.111009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff21c-bf19-4aed-8f00-336daa043ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.111009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff21c-bf19-4aed-8f00-336daa043ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.114804 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ff21c-bf19-4aed-8f00-336daa043ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:13.120766 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ff21c-bf19-4aed-8f00-336daa043ae0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:13.145746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 989/1988] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:13.146769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ff21c-bf19-4aed-8f00-336daa043ae0 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:13.149053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4b0ff21c-bf19-4aed-8f00-336daa043ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:13.193388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e43c0-8634-4cb5-9ec2-3dcd81861f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:13.196187 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e43c0-8634-4cb5-9ec2-3dcd81861f95 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:13.217771 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1000/1989] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:13.219395 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e43c0-8634-4cb5-9ec2-3dcd81861f95 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:13.241196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e43c0-8634-4cb5-9ec2-3dcd81861f95 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:13.251283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2a229-3288-44c6-bdb3-1c4b414b447a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:13.252888 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2a229-3288-44c6-bdb3-1c4b414b447a admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.253506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2a229-3288-44c6-bdb3-1c4b414b447a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.254071 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2a229-3288-44c6-bdb3-1c4b414b447a admin admin] PATH_INFO: `/v3/projects/458eceb840ef45efbc4491265ed55da5/users/904351f5f5d14f0ca887c46e0142161f/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.257752 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2a229-3288-44c6-bdb3-1c4b414b447a admin admin] RBAC: Authorizing `identity:create_grant(project_id=458eceb840ef45efbc4491265ed55da5, user_id=904351f5f5d14f0ca887c46e0142161f, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:13.264958 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2a229-3288-44c6-bdb3-1c4b414b447a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:13.287307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1001/1990] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:13 2022] PUT /identity/v3/projects/458eceb840ef45efbc4491265ed55da5/users/904351f5f5d14f0ca887c46e0142161f/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:13.300968 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bff4ab-d002-4e79-b421-860110f23f46 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.301444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bff4ab-d002-4e79-b421-860110f23f46 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.301872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bff4ab-d002-4e79-b421-860110f23f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.306256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ff21c-bf19-4aed-8f00-336daa043ae0 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:13.386940 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:13.415713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f4bff4ab-d002-4e79-b421-860110f23f46 None None] MFA Rules not processed for user `904351f5f5d14f0ca887c46e0142161f`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:13.418654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f4bff4ab-d002-4e79-b421-860110f23f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:13.444618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc147d-a23f-429f-aa93-aea40b3a2d9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:13.445377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc147d-a23f-429f-aa93-aea40b3a2d9e service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.445760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc147d-a23f-429f-aa93-aea40b3a2d9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.446200 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc147d-a23f-429f-aa93-aea40b3a2d9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.543736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc147d-a23f-429f-aa93-aea40b3a2d9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:13.547362 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc147d-a23f-429f-aa93-aea40b3a2d9e service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:13.586486 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 990/1991] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:13.667814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc147d-a23f-429f-aa93-aea40b3a2d9e service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:13.669810 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-46bc147d-a23f-429f-aa93-aea40b3a2d9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:13.673878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1002/1992] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:13.701142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc147d-a23f-429f-aa93-aea40b3a2d9e service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:13.717203 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff65e17-47b1-40cd-a33a-ce14c00452b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:13.719227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff65e17-47b1-40cd-a33a-ce14c00452b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.720036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff65e17-47b1-40cd-a33a-ce14c00452b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.720768 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff65e17-47b1-40cd-a33a-ce14c00452b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.758258 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff65e17-47b1-40cd-a33a-ce14c00452b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:13.761735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff65e17-47b1-40cd-a33a-ce14c00452b0 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:13.835814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 991/1993] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:14.499362 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bff4ab-d002-4e79-b421-860110f23f46 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:14.509900 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f4bff4ab-d002-4e79-b421-860110f23f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:14.536173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:14.570074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff65e17-47b1-40cd-a33a-ce14c00452b0 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:14.572023 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8ff65e17-47b1-40cd-a33a-ce14c00452b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:14.698682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bff4ab-d002-4e79-b421-860110f23f46 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:14.707043 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de5ebf-988c-4772-925e-80a523d093a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:14.708073 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de5ebf-988c-4772-925e-80a523d093a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:14.708238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de5ebf-988c-4772-925e-80a523d093a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:14.708457 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de5ebf-988c-4772-925e-80a523d093a1 admin admin] PATH_INFO: `/v3/projects/e6601b8b298e4b32ba4c6113872f8939` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:14.710499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de5ebf-988c-4772-925e-80a523d093a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6601b8b298e4b32ba4c6113872f8939)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:14.712991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de5ebf-988c-4772-925e-80a523d093a1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:14.793009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff65e17-47b1-40cd-a33a-ce14c00452b0 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:14.817683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c9de5ebf-988c-4772-925e-80a523d093a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6601b8b298e4b32ba4c6113872f8939', 'request_id': 'req-c9de5ebf-988c-4772-925e-80a523d093a1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:14.863859 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c9de5ebf-988c-4772-925e-80a523d093a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6601b8b298e4b32ba4c6113872f8939', 'request_id': 'req-c9de5ebf-988c-4772-925e-80a523d093a1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:14.886414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c9de5ebf-988c-4772-925e-80a523d093a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6601b8b298e4b32ba4c6113872f8939', 'request_id': 'req-c9de5ebf-988c-4772-925e-80a523d093a1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:14.935052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c9de5ebf-988c-4772-925e-80a523d093a1 admin admin] The token cache is being invalidate because project e6601b8b298e4b32ba4c6113872f8939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:14.935052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c9de5ebf-988c-4772-925e-80a523d093a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:14.936831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c9de5ebf-988c-4772-925e-80a523d093a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:14.940683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1003/1994] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:14 2022] DELETE /identity/v3/projects/e6601b8b298e4b32ba4c6113872f8939 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:14.948696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de5ebf-988c-4772-925e-80a523d093a1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:14.952187 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c9de5ebf-988c-4772-925e-80a523d093a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:15.066503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56b30e-1588-4911-9d13-0c7d1679320c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:15.067331 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56b30e-1588-4911-9d13-0c7d1679320c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:15.067642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56b30e-1588-4911-9d13-0c7d1679320c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:15.067893 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56b30e-1588-4911-9d13-0c7d1679320c admin admin] PATH_INFO: `/v3/projects/176a2baacc4840d8af766e44427d7b51` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:15.069748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56b30e-1588-4911-9d13-0c7d1679320c admin admin] RBAC: Authorizing `identity:delete_project(project_id=176a2baacc4840d8af766e44427d7b51)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:15.072011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56b30e-1588-4911-9d13-0c7d1679320c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:15.123342 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de5ebf-988c-4772-925e-80a523d093a1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:15.123657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:15.143843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5742ac-ee64-40ef-86bf-65c5c6eb494e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:15.155930 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5742ac-ee64-40ef-86bf-65c5c6eb494e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:15.155930 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5742ac-ee64-40ef-86bf-65c5c6eb494e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:15.155930 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5742ac-ee64-40ef-86bf-65c5c6eb494e admin admin] PATH_INFO: `/v3/users/0e83a1564ca94ca6b12bc1b37d9431aa` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:15.159065 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5742ac-ee64-40ef-86bf-65c5c6eb494e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e83a1564ca94ca6b12bc1b37d9431aa)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:15.169741 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5742ac-ee64-40ef-86bf-65c5c6eb494e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:15.321519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7f56b30e-1588-4911-9d13-0c7d1679320c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176a2baacc4840d8af766e44427d7b51', 'request_id': 'req-7f56b30e-1588-4911-9d13-0c7d1679320c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:15.337988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:15.342498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6a5742ac-ee64-40ef-86bf-65c5c6eb494e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e83a1564ca94ca6b12bc1b37d9431aa'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:15.354345 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7f56b30e-1588-4911-9d13-0c7d1679320c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176a2baacc4840d8af766e44427d7b51', 'request_id': 'req-7f56b30e-1588-4911-9d13-0c7d1679320c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:15.382915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6a5742ac-ee64-40ef-86bf-65c5c6eb494e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e83a1564ca94ca6b12bc1b37d9431aa'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:15.404366 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7f56b30e-1588-4911-9d13-0c7d1679320c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176a2baacc4840d8af766e44427d7b51', 'request_id': 'req-7f56b30e-1588-4911-9d13-0c7d1679320c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:15.454167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7f56b30e-1588-4911-9d13-0c7d1679320c admin admin] The token cache is being invalidate because project 176a2baacc4840d8af766e44427d7b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:15.454588 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7f56b30e-1588-4911-9d13-0c7d1679320c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:15.455298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7f56b30e-1588-4911-9d13-0c7d1679320c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:15.457308 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 992/1995] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:14 2022] DELETE /identity/v3/projects/176a2baacc4840d8af766e44427d7b51 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:15.471643 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6a5742ac-ee64-40ef-86bf-65c5c6eb494e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e83a1564ca94ca6b12bc1b37d9431aa'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:15.472861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56b30e-1588-4911-9d13-0c7d1679320c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:15.475088 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6a5742ac-ee64-40ef-86bf-65c5c6eb494e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e83a1564ca94ca6b12bc1b37d9431aa'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:15.478812 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6a5742ac-ee64-40ef-86bf-65c5c6eb494e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e83a1564ca94ca6b12bc1b37d9431aa'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:15.483630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7f56b30e-1588-4911-9d13-0c7d1679320c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:15.525061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1004/1996] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:14 2022] DELETE /identity/v3/users/0e83a1564ca94ca6b12bc1b37d9431aa => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:15.713092 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56b30e-1588-4911-9d13-0c7d1679320c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:15.737193 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5742ac-ee64-40ef-86bf-65c5c6eb494e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:15.739485 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6a5742ac-ee64-40ef-86bf-65c5c6eb494e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:15.793574 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c99cc-2a79-4bb4-87db-dd1754d14fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:15.794793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c99cc-2a79-4bb4-87db-dd1754d14fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:15.801242 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c99cc-2a79-4bb4-87db-dd1754d14fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:15.802089 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c99cc-2a79-4bb4-87db-dd1754d14fb3 admin admin] PATH_INFO: `/v3/users/a1dfdb48dc204325a82bd24d4437cf7d` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:15.811424 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c99cc-2a79-4bb4-87db-dd1754d14fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1dfdb48dc204325a82bd24d4437cf7d)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:15.814431 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c99cc-2a79-4bb4-87db-dd1754d14fb3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:15.938140 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5742ac-ee64-40ef-86bf-65c5c6eb494e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:15.939729 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:15.945862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-584c99cc-2a79-4bb4-87db-dd1754d14fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1dfdb48dc204325a82bd24d4437cf7d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:15.956289 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1731fe-a5b8-4c01-8526-75adb759ef68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:15.957059 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1731fe-a5b8-4c01-8526-75adb759ef68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:15.957217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1731fe-a5b8-4c01-8526-75adb759ef68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:15.957537 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1731fe-a5b8-4c01-8526-75adb759ef68 admin admin] PATH_INFO: `/v3/users/0b5c373ef377450799e34efbc87cae3b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:15.960902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1731fe-a5b8-4c01-8526-75adb759ef68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5c373ef377450799e34efbc87cae3b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:15.963752 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1731fe-a5b8-4c01-8526-75adb759ef68 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:15.982577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-584c99cc-2a79-4bb4-87db-dd1754d14fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1dfdb48dc204325a82bd24d4437cf7d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:16.002464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-584c99cc-2a79-4bb4-87db-dd1754d14fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1dfdb48dc204325a82bd24d4437cf7d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:16.004067 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-584c99cc-2a79-4bb4-87db-dd1754d14fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1dfdb48dc204325a82bd24d4437cf7d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:16.021944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-584c99cc-2a79-4bb4-87db-dd1754d14fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1dfdb48dc204325a82bd24d4437cf7d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:16.033535 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 993/1997] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:15 2022] DELETE /identity/v3/users/a1dfdb48dc204325a82bd24d4437cf7d => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:16.077834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fa1731fe-a5b8-4c01-8526-75adb759ef68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5c373ef377450799e34efbc87cae3b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:16.092981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fa1731fe-a5b8-4c01-8526-75adb759ef68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5c373ef377450799e34efbc87cae3b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:16.110851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fa1731fe-a5b8-4c01-8526-75adb759ef68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5c373ef377450799e34efbc87cae3b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:16.111668 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fa1731fe-a5b8-4c01-8526-75adb759ef68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5c373ef377450799e34efbc87cae3b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:16.112296 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fa1731fe-a5b8-4c01-8526-75adb759ef68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5c373ef377450799e34efbc87cae3b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:16.134970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1005/1998] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:15 2022] DELETE /identity/v3/users/0b5c373ef377450799e34efbc87cae3b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:16.140907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875983a-e83a-40ee-9212-0d1db17f043d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:16.141201 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875983a-e83a-40ee-9212-0d1db17f043d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:16.141592 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875983a-e83a-40ee-9212-0d1db17f043d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:16.166754 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-8875983a-e83a-40ee-9212-0d1db17f043d None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:16.168072 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8875983a-e83a-40ee-9212-0d1db17f043d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:16.362648 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 994/1999] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:16.375324 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1731fe-a5b8-4c01-8526-75adb759ef68 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:16.376915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fa1731fe-a5b8-4c01-8526-75adb759ef68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:16.530627 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:16.568477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1731fe-a5b8-4c01-8526-75adb759ef68 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:16.578383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ef33f-01ad-4c8b-8b4e-c9a867f6a1d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:16.579747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ef33f-01ad-4c8b-8b4e-c9a867f6a1d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:16.580440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ef33f-01ad-4c8b-8b4e-c9a867f6a1d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:16.580913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ef33f-01ad-4c8b-8b4e-c9a867f6a1d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:16.605033 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ef33f-01ad-4c8b-8b4e-c9a867f6a1d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:16.606556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875983a-e83a-40ee-9212-0d1db17f043d None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:16.608557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ef33f-01ad-4c8b-8b4e-c9a867f6a1d3 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:16.608967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8875983a-e83a-40ee-9212-0d1db17f043d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:16.633445 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1006/2000] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:16.661754 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875983a-e83a-40ee-9212-0d1db17f043d None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:16.680246 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e456d21-ba4f-492e-882a-ba8c7097e615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:16.681589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e456d21-ba4f-492e-882a-ba8c7097e615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:16.682074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e456d21-ba4f-492e-882a-ba8c7097e615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:16.682533 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e456d21-ba4f-492e-882a-ba8c7097e615 admin admin] PATH_INFO: `/v3/projects/ec41f37cb11c4784a2c6edaeb522ffaa` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:16.685351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e456d21-ba4f-492e-882a-ba8c7097e615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec41f37cb11c4784a2c6edaeb522ffaa)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:16.689996 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e456d21-ba4f-492e-882a-ba8c7097e615 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:16.806528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6e456d21-ba4f-492e-882a-ba8c7097e615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec41f37cb11c4784a2c6edaeb522ffaa', 'request_id': 'req-6e456d21-ba4f-492e-882a-ba8c7097e615'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:16.819244 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6e456d21-ba4f-492e-882a-ba8c7097e615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec41f37cb11c4784a2c6edaeb522ffaa', 'request_id': 'req-6e456d21-ba4f-492e-882a-ba8c7097e615'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:16.840395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6e456d21-ba4f-492e-882a-ba8c7097e615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec41f37cb11c4784a2c6edaeb522ffaa', 'request_id': 'req-6e456d21-ba4f-492e-882a-ba8c7097e615'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:16.881259 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6e456d21-ba4f-492e-882a-ba8c7097e615 admin admin] The token cache is being invalidate because project ec41f37cb11c4784a2c6edaeb522ffaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:16.881577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6e456d21-ba4f-492e-882a-ba8c7097e615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:16.883111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6e456d21-ba4f-492e-882a-ba8c7097e615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:16.889291 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 995/2001] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:16 2022] DELETE /identity/v3/projects/ec41f37cb11c4784a2c6edaeb522ffaa => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:16.890276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ef33f-01ad-4c8b-8b4e-c9a867f6a1d3 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:16.904266 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ef33f-01ad-4c8b-8b4e-c9a867f6a1d3 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:17.013194 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381df832-fb06-4284-b2e5-289c413d2e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:17.014498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381df832-fb06-4284-b2e5-289c413d2e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:17.015252 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381df832-fb06-4284-b2e5-289c413d2e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:17.015991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381df832-fb06-4284-b2e5-289c413d2e15 admin admin] PATH_INFO: `/v3/users/5221b25ea86c4b66a5d7357ee9ed8c93` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:17.016941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381df832-fb06-4284-b2e5-289c413d2e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5221b25ea86c4b66a5d7357ee9ed8c93)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:17.020338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381df832-fb06-4284-b2e5-289c413d2e15 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:17.128868 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-381df832-fb06-4284-b2e5-289c413d2e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5221b25ea86c4b66a5d7357ee9ed8c93'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:17.148439 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-381df832-fb06-4284-b2e5-289c413d2e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5221b25ea86c4b66a5d7357ee9ed8c93'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:17.204005 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-381df832-fb06-4284-b2e5-289c413d2e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5221b25ea86c4b66a5d7357ee9ed8c93'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:17.205477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-381df832-fb06-4284-b2e5-289c413d2e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5221b25ea86c4b66a5d7357ee9ed8c93'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:17.205912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-381df832-fb06-4284-b2e5-289c413d2e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5221b25ea86c4b66a5d7357ee9ed8c93'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:17.240235 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1007/2002] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:16 2022] DELETE /identity/v3/users/5221b25ea86c4b66a5d7357ee9ed8c93 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:17.563645 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e456d21-ba4f-492e-882a-ba8c7097e615 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:17.567294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6e456d21-ba4f-492e-882a-ba8c7097e615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:17.584198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e456d21-ba4f-492e-882a-ba8c7097e615 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:17.686191 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:17.708108 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da140b-debb-47a1-8d36-756fa9da1e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:17.709843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da140b-debb-47a1-8d36-756fa9da1e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:17.710368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da140b-debb-47a1-8d36-756fa9da1e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:17.710816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da140b-debb-47a1-8d36-756fa9da1e05 admin admin] PATH_INFO: `/v3/users/b28d47e1156c47aca276dfe782c35622` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:17.714691 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da140b-debb-47a1-8d36-756fa9da1e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b28d47e1156c47aca276dfe782c35622)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:17.718129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da140b-debb-47a1-8d36-756fa9da1e05 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:17.768793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381df832-fb06-4284-b2e5-289c413d2e15 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:17.771070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-381df832-fb06-4284-b2e5-289c413d2e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:17.806529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-88da140b-debb-47a1-8d36-756fa9da1e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b28d47e1156c47aca276dfe782c35622'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:17.823092 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381df832-fb06-4284-b2e5-289c413d2e15 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:17.841347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:17.846990 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:17.851470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:17.852047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc admin admin] PATH_INFO: `/v3/projects/eff4aa92477043bfbb016852c58d206c` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:17.856974 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=eff4aa92477043bfbb016852c58d206c)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:17.870869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:17.878785 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-88da140b-debb-47a1-8d36-756fa9da1e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b28d47e1156c47aca276dfe782c35622'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:17.909150 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-88da140b-debb-47a1-8d36-756fa9da1e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b28d47e1156c47aca276dfe782c35622'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:17.911686 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-88da140b-debb-47a1-8d36-756fa9da1e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b28d47e1156c47aca276dfe782c35622'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:17.941247 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-88da140b-debb-47a1-8d36-756fa9da1e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b28d47e1156c47aca276dfe782c35622'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:17.960359 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 996/2003] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:17 2022] DELETE /identity/v3/users/b28d47e1156c47aca276dfe782c35622 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:17.977316 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925aadbb-95ce-4c1d-a987-8a872410c185 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:17.978692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925aadbb-95ce-4c1d-a987-8a872410c185 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:17.980368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925aadbb-95ce-4c1d-a987-8a872410c185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:17.990465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eff4aa92477043bfbb016852c58d206c', 'request_id': 'req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.011254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eff4aa92477043bfbb016852c58d206c', 'request_id': 'req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.021499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-925aadbb-95ce-4c1d-a987-8a872410c185 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:18.023110 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-925aadbb-95ce-4c1d-a987-8a872410c185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:18.028481 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:18.034300 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eff4aa92477043bfbb016852c58d206c', 'request_id': 'req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.072744 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc admin admin] The token cache is being invalidate because project eff4aa92477043bfbb016852c58d206c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:18.073157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.073960 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.082053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1008/2004] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:17 2022] DELETE /identity/v3/projects/eff4aa92477043bfbb016852c58d206c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:18.084281 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:18.087681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:18.171074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 997/2005] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:18.176755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a00c1b-d2e8-464e-96a4-27530c360add None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:18.177707 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a00c1b-d2e8-464e-96a4-27530c360add None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:18.178447 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a00c1b-d2e8-464e-96a4-27530c360add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:18.237803 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d1a00c1b-d2e8-464e-96a4-27530c360add None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:18.239743 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d1a00c1b-d2e8-464e-96a4-27530c360add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:18.251531 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 998/2006] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:18.261990 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a00c1b-d2e8-464e-96a4-27530c360add None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:18.263908 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d1a00c1b-d2e8-464e-96a4-27530c360add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:18.274543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6684299-e4d4-4499-88bb-09ba6eb8cdcc admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:18.281313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a00c1b-d2e8-464e-96a4-27530c360add None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:18.289719 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797464c6-34f3-4507-8a55-97ddd5f69c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:18.290822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797464c6-34f3-4507-8a55-97ddd5f69c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:18.291332 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797464c6-34f3-4507-8a55-97ddd5f69c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:18.291971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797464c6-34f3-4507-8a55-97ddd5f69c38 admin admin] PATH_INFO: `/v3/projects/0e35db9f98774b40b4f09467c6879589` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:18.293949 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797464c6-34f3-4507-8a55-97ddd5f69c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e35db9f98774b40b4f09467c6879589)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:18.296769 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797464c6-34f3-4507-8a55-97ddd5f69c38 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:18.301453 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955d184-6ceb-43ba-92e2-b4a651229b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:18.302260 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955d184-6ceb-43ba-92e2-b4a651229b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:18.302856 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955d184-6ceb-43ba-92e2-b4a651229b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:18.303251 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955d184-6ceb-43ba-92e2-b4a651229b93 admin admin] PATH_INFO: `/v3/projects/14a49e84d0e4454481ebc1ce5bffcbda` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:18.304625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955d184-6ceb-43ba-92e2-b4a651229b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14a49e84d0e4454481ebc1ce5bffcbda)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:18.307100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955d184-6ceb-43ba-92e2-b4a651229b93 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:18.394164 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-797464c6-34f3-4507-8a55-97ddd5f69c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e35db9f98774b40b4f09467c6879589', 'request_id': 'req-797464c6-34f3-4507-8a55-97ddd5f69c38'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.414590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-797464c6-34f3-4507-8a55-97ddd5f69c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e35db9f98774b40b4f09467c6879589', 'request_id': 'req-797464c6-34f3-4507-8a55-97ddd5f69c38'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.421353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c955d184-6ceb-43ba-92e2-b4a651229b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a49e84d0e4454481ebc1ce5bffcbda', 'request_id': 'req-c955d184-6ceb-43ba-92e2-b4a651229b93'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.434212 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-797464c6-34f3-4507-8a55-97ddd5f69c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e35db9f98774b40b4f09467c6879589', 'request_id': 'req-797464c6-34f3-4507-8a55-97ddd5f69c38'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.439651 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:18.450083 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c955d184-6ceb-43ba-92e2-b4a651229b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a49e84d0e4454481ebc1ce5bffcbda', 'request_id': 'req-c955d184-6ceb-43ba-92e2-b4a651229b93'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.466604 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c955d184-6ceb-43ba-92e2-b4a651229b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a49e84d0e4454481ebc1ce5bffcbda', 'request_id': 'req-c955d184-6ceb-43ba-92e2-b4a651229b93'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.471236 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-797464c6-34f3-4507-8a55-97ddd5f69c38 admin admin] The token cache is being invalidate because project 0e35db9f98774b40b4f09467c6879589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:18.471990 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-797464c6-34f3-4507-8a55-97ddd5f69c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.474214 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-797464c6-34f3-4507-8a55-97ddd5f69c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.481520 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1009/2007] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:18 2022] DELETE /identity/v3/projects/0e35db9f98774b40b4f09467c6879589 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:18.483137 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797464c6-34f3-4507-8a55-97ddd5f69c38 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:18.486430 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-797464c6-34f3-4507-8a55-97ddd5f69c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:18.505451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c955d184-6ceb-43ba-92e2-b4a651229b93 admin admin] The token cache is being invalidate because project 14a49e84d0e4454481ebc1ce5bffcbda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:18.505863 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c955d184-6ceb-43ba-92e2-b4a651229b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.506930 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c955d184-6ceb-43ba-92e2-b4a651229b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.512475 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 999/2008] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:18 2022] DELETE /identity/v3/projects/14a49e84d0e4454481ebc1ce5bffcbda => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:18.514282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ea979-00b9-4e8d-aa97-1b80dac099c2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:18.515276 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ea979-00b9-4e8d-aa97-1b80dac099c2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:18.515680 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ea979-00b9-4e8d-aa97-1b80dac099c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:18.557444 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-2c6ea979-00b9-4e8d-aa97-1b80dac099c2 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:18.559209 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2c6ea979-00b9-4e8d-aa97-1b80dac099c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:18.676390 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797464c6-34f3-4507-8a55-97ddd5f69c38 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:18.708128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1000/2009] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:18.710192 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ea979-00b9-4e8d-aa97-1b80dac099c2 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:18.712892 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2c6ea979-00b9-4e8d-aa97-1b80dac099c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:18.733106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ea979-00b9-4e8d-aa97-1b80dac099c2 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:18.737584 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:18.746438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c3ec8-1056-4a49-8b40-3b96da02b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:18.753907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c3ec8-1056-4a49-8b40-3b96da02b30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:18.754641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c3ec8-1056-4a49-8b40-3b96da02b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:18.756094 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c3ec8-1056-4a49-8b40-3b96da02b30b admin admin] PATH_INFO: `/v3/users/df89a5fa3ae448f8b23d80f29dd31b39` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:18.758127 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c3ec8-1056-4a49-8b40-3b96da02b30b admin admin] RBAC: Authorizing `identity:delete_user(user_id=df89a5fa3ae448f8b23d80f29dd31b39)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:18.762572 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c3ec8-1056-4a49-8b40-3b96da02b30b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:18.781914 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e3678-9c8c-471c-8536-1e2209b8c38f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:18.782646 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e3678-9c8c-471c-8536-1e2209b8c38f service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:18.782925 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e3678-9c8c-471c-8536-1e2209b8c38f service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:18.783202 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e3678-9c8c-471c-8536-1e2209b8c38f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:18.785861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-413e3678-9c8c-471c-8536-1e2209b8c38f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:18.816398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e3678-9c8c-471c-8536-1e2209b8c38f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:18.823116 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e3678-9c8c-471c-8536-1e2209b8c38f service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:18.859853 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b97c3ec8-1056-4a49-8b40-3b96da02b30b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df89a5fa3ae448f8b23d80f29dd31b39'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.879783 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1010/2010] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:18.886223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cd7b6-4ebc-4ee4-af80-9d24809d59c9 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:18.892397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cd7b6-4ebc-4ee4-af80-9d24809d59c9 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:18.893294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cd7b6-4ebc-4ee4-af80-9d24809d59c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:18.908598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b97c3ec8-1056-4a49-8b40-3b96da02b30b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df89a5fa3ae448f8b23d80f29dd31b39'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.934390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b97c3ec8-1056-4a49-8b40-3b96da02b30b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df89a5fa3ae448f8b23d80f29dd31b39'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.936738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b97c3ec8-1056-4a49-8b40-3b96da02b30b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df89a5fa3ae448f8b23d80f29dd31b39'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.955749 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5f4cd7b6-4ebc-4ee4-af80-9d24809d59c9 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:18.957402 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5f4cd7b6-4ebc-4ee4-af80-9d24809d59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:18.963960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b97c3ec8-1056-4a49-8b40-3b96da02b30b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df89a5fa3ae448f8b23d80f29dd31b39'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.983895 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1001/2011] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:18 2022] DELETE /identity/v3/users/df89a5fa3ae448f8b23d80f29dd31b39 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:18.991459 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c3ec8-1056-4a49-8b40-3b96da02b30b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:18.994394 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b97c3ec8-1056-4a49-8b40-3b96da02b30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:18.999321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1011/2012] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:19.011160 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cd7b6-4ebc-4ee4-af80-9d24809d59c9 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:19.015910 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5f4cd7b6-4ebc-4ee4-af80-9d24809d59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:19.060251 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cd7b6-4ebc-4ee4-af80-9d24809d59c9 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:19.179061 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:19.189761 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c3ec8-1056-4a49-8b40-3b96da02b30b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:19.202606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd724410-da7d-4894-b828-6d0301f552a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:19.202833 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd724410-da7d-4894-b828-6d0301f552a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:19.203110 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd724410-da7d-4894-b828-6d0301f552a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:19.203386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd724410-da7d-4894-b828-6d0301f552a1 admin admin] PATH_INFO: `/v3/users/904351f5f5d14f0ca887c46e0142161f` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:19.205139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd724410-da7d-4894-b828-6d0301f552a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=904351f5f5d14f0ca887c46e0142161f)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:19.207511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd724410-da7d-4894-b828-6d0301f552a1 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:19.235086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb5769-1bd3-4eaf-8d1e-286807a23745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:19.236287 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb5769-1bd3-4eaf-8d1e-286807a23745 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:19.236693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb5769-1bd3-4eaf-8d1e-286807a23745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:19.237920 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb5769-1bd3-4eaf-8d1e-286807a23745 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:19.238291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb5769-1bd3-4eaf-8d1e-286807a23745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:19.238860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb5769-1bd3-4eaf-8d1e-286807a23745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:19.241687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb5769-1bd3-4eaf-8d1e-286807a23745 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:19.269653 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1012/2013] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:19.272224 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad2ff4-fa52-4a4e-a1f9-364911f243c6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:19.272756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad2ff4-fa52-4a4e-a1f9-364911f243c6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:19.274089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad2ff4-fa52-4a4e-a1f9-364911f243c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:19.331480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ddad2ff4-fa52-4a4e-a1f9-364911f243c6 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:19.337515 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ddad2ff4-fa52-4a4e-a1f9-364911f243c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:19.372966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1013/2014] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:19.372966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b843c-6b9f-45fa-a3b3-e90e167c339e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:19.374272 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b843c-6b9f-45fa-a3b3-e90e167c339e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:19.374272 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b843c-6b9f-45fa-a3b3-e90e167c339e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:19.380056 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-dd724410-da7d-4894-b828-6d0301f552a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '904351f5f5d14f0ca887c46e0142161f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.425072 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-dd724410-da7d-4894-b828-6d0301f552a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '904351f5f5d14f0ca887c46e0142161f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.434267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-931b843c-6b9f-45fa-a3b3-e90e167c339e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:19.437426 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-931b843c-6b9f-45fa-a3b3-e90e167c339e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:19.441482 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-dd724410-da7d-4894-b828-6d0301f552a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '904351f5f5d14f0ca887c46e0142161f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.443843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-dd724410-da7d-4894-b828-6d0301f552a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '904351f5f5d14f0ca887c46e0142161f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.459591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-dd724410-da7d-4894-b828-6d0301f552a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '904351f5f5d14f0ca887c46e0142161f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.467850 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1014/2015] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:19.473026 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b843c-6b9f-45fa-a3b3-e90e167c339e None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:19.479071 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1002/2016] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:18 2022] DELETE /identity/v3/users/904351f5f5d14f0ca887c46e0142161f => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:19.486796 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd724410-da7d-4894-b828-6d0301f552a1 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:19.492896 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-dd724410-da7d-4894-b828-6d0301f552a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:19.504473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b843c-6b9f-45fa-a3b3-e90e167c339e None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:19.741933 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a328d-54b2-44b8-a98b-8579bb60707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:19.743079 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a328d-54b2-44b8-a98b-8579bb60707d admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:19.743578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a328d-54b2-44b8-a98b-8579bb60707d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:19.744132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a328d-54b2-44b8-a98b-8579bb60707d admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:19.749552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a328d-54b2-44b8-a98b-8579bb60707d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:19.756340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd724410-da7d-4894-b828-6d0301f552a1 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:19.762745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a328d-54b2-44b8-a98b-8579bb60707d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:19.779467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc46c4-4d34-4749-a9d5-c6b1fcfe305f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:19.794397 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc46c4-4d34-4749-a9d5-c6b1fcfe305f service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:19.795443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc46c4-4d34-4749-a9d5-c6b1fcfe305f service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:19.796140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc46c4-4d34-4749-a9d5-c6b1fcfe305f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:19.801964 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1fbc46c4-4d34-4749-a9d5-c6b1fcfe305f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:19.829028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc46c4-4d34-4749-a9d5-c6b1fcfe305f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:19.831697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc46c4-4d34-4749-a9d5-c6b1fcfe305f service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:19.863425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1015/2017] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:19 2022] POST /identity/v3/projects => generated 361 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:19.864137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1003/2018] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:19.864674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a328d-54b2-44b8-a98b-8579bb60707d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:19.864804 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc46c4-4d34-4749-a9d5-c6b1fcfe305f service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:19.866983 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1fbc46c4-4d34-4749-a9d5-c6b1fcfe305f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:19.869380 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-024a328d-54b2-44b8-a98b-8579bb60707d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:19.896567 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc46c4-4d34-4749-a9d5-c6b1fcfe305f service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:19.982574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:20.041294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a328d-54b2-44b8-a98b-8579bb60707d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:20.044725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:20.048006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:20.048761 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:20.049020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e admin admin] PATH_INFO: `/v3/projects/3e515f74eb1d4ec9a70e3cffe2b08d85` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:20.051281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e515f74eb1d4ec9a70e3cffe2b08d85)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:20.055922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:20.068359 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56830be8-bb53-4ce5-a2c0-59557fa52c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:20.069055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56830be8-bb53-4ce5-a2c0-59557fa52c21 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:20.071693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56830be8-bb53-4ce5-a2c0-59557fa52c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:20.072167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56830be8-bb53-4ce5-a2c0-59557fa52c21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:20.072975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56830be8-bb53-4ce5-a2c0-59557fa52c21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:20.073315 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56830be8-bb53-4ce5-a2c0-59557fa52c21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:20.078554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56830be8-bb53-4ce5-a2c0-59557fa52c21 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:20.109335 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1016/2019] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:20.114497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56830be8-bb53-4ce5-a2c0-59557fa52c21 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:20.117503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-56830be8-bb53-4ce5-a2c0-59557fa52c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:20.121260 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:20.150245 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56830be8-bb53-4ce5-a2c0-59557fa52c21 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:20.168083 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373261c1-f7a4-4fd5-977c-44bd0bdd3cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:20.168999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373261c1-f7a4-4fd5-977c-44bd0bdd3cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:20.169272 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373261c1-f7a4-4fd5-977c-44bd0bdd3cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:20.169635 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373261c1-f7a4-4fd5-977c-44bd0bdd3cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:20.176093 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373261c1-f7a4-4fd5-977c-44bd0bdd3cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:20.178954 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373261c1-f7a4-4fd5-977c-44bd0bdd3cb1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:20.188874 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e515f74eb1d4ec9a70e3cffe2b08d85', 'request_id': 'req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.201963 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e515f74eb1d4ec9a70e3cffe2b08d85', 'request_id': 'req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.217684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e515f74eb1d4ec9a70e3cffe2b08d85', 'request_id': 'req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.243866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e admin admin] The token cache is being invalidate because project 3e515f74eb1d4ec9a70e3cffe2b08d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:20.244562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.245810 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.247673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1017/2020] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:20 2022] POST /identity/v3/users => generated 281 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:20.249682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373261c1-f7a4-4fd5-977c-44bd0bdd3cb1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:20.252548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1004/2021] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:19 2022] DELETE /identity/v3/projects/3e515f74eb1d4ec9a70e3cffe2b08d85 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:20.254278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:20.255989 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-373261c1-f7a4-4fd5-977c-44bd0bdd3cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:20.257455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:20.381532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373261c1-f7a4-4fd5-977c-44bd0bdd3cb1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:20.509740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa86b3-91b0-4099-ae33-b7afc67ee93e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:20.530455 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2b992-fe06-4af2-88db-fe81a53e2c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:20.531932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2b992-fe06-4af2-88db-fe81a53e2c9a admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:20.532591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2b992-fe06-4af2-88db-fe81a53e2c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:20.533237 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2b992-fe06-4af2-88db-fe81a53e2c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:20.534941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2b992-fe06-4af2-88db-fe81a53e2c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:20.539184 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2b992-fe06-4af2-88db-fe81a53e2c9a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:20.544010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a758e2f-f103-4fcd-9b8b-795423bc7972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:20.544706 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758e2f-f103-4fcd-9b8b-795423bc7972 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:20.544983 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758e2f-f103-4fcd-9b8b-795423bc7972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:20.548847 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758e2f-f103-4fcd-9b8b-795423bc7972 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:20.550194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a758e2f-f103-4fcd-9b8b-795423bc7972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:20.563294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a758e2f-f103-4fcd-9b8b-795423bc7972 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:20.604777 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1018/2022] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:20 2022] POST /identity/v3/projects => generated 387 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:20.604777 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2b992-fe06-4af2-88db-fe81a53e2c9a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:20.604777 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-95c2b992-fe06-4af2-88db-fe81a53e2c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:20.611781 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1005/2023] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:20.617348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a758e2f-f103-4fcd-9b8b-795423bc7972 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:20.670953 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a758e2f-f103-4fcd-9b8b-795423bc7972 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:20.770317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2b992-fe06-4af2-88db-fe81a53e2c9a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:20.783501 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd379cc-b59c-41c4-b4aa-f54621e667f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:20.784725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd379cc-b59c-41c4-b4aa-f54621e667f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:20.786051 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd379cc-b59c-41c4-b4aa-f54621e667f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:20.786781 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd379cc-b59c-41c4-b4aa-f54621e667f9 admin admin] PATH_INFO: `/v3/users/39d5583911834498a86984d75724ee70` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:20.789060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd379cc-b59c-41c4-b4aa-f54621e667f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d5583911834498a86984d75724ee70)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:20.799817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd379cc-b59c-41c4-b4aa-f54621e667f9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:20.894616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b137e-d47d-42a4-ba75-8d56798e60b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:20.895570 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b137e-d47d-42a4-ba75-8d56798e60b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:20.896320 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b137e-d47d-42a4-ba75-8d56798e60b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:20.896814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b137e-d47d-42a4-ba75-8d56798e60b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:20.898892 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b137e-d47d-42a4-ba75-8d56798e60b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:20.903137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b137e-d47d-42a4-ba75-8d56798e60b8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:20.952196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1006/2024] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:20 2022] POST /identity/v3/users => generated 294 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:20.954576 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b137e-d47d-42a4-ba75-8d56798e60b8 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:20.960576 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:20.971831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7fd379cc-b59c-41c4-b4aa-f54621e667f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d5583911834498a86984d75724ee70'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.980521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b137e-d47d-42a4-ba75-8d56798e60b8 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:20.988918 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24232b-9fbd-4814-8bb3-1ef7751d0ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:20.989829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7fd379cc-b59c-41c4-b4aa-f54621e667f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d5583911834498a86984d75724ee70'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.990022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24232b-9fbd-4814-8bb3-1ef7751d0ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:20.990452 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24232b-9fbd-4814-8bb3-1ef7751d0ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:20.990913 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24232b-9fbd-4814-8bb3-1ef7751d0ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:20.992054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24232b-9fbd-4814-8bb3-1ef7751d0ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:20.995097 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24232b-9fbd-4814-8bb3-1ef7751d0ae7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:21.013814 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7fd379cc-b59c-41c4-b4aa-f54621e667f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d5583911834498a86984d75724ee70'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.015453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7fd379cc-b59c-41c4-b4aa-f54621e667f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d5583911834498a86984d75724ee70'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.016676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7fd379cc-b59c-41c4-b4aa-f54621e667f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d5583911834498a86984d75724ee70'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.021680 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1007/2025] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:21.021680 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24232b-9fbd-4814-8bb3-1ef7751d0ae7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:21.024932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fa24232b-9fbd-4814-8bb3-1ef7751d0ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:21.050215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1019/2026] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:20 2022] DELETE /identity/v3/users/39d5583911834498a86984d75724ee70 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:21.055135 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd379cc-b59c-41c4-b4aa-f54621e667f9 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:21.060399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7fd379cc-b59c-41c4-b4aa-f54621e667f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:21.064004 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24232b-9fbd-4814-8bb3-1ef7751d0ae7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:21.110801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:21.177597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd379cc-b59c-41c4-b4aa-f54621e667f9 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:21.185251 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00290f-af1a-440b-bf14-8d19a4d764c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:21.186742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00290f-af1a-440b-bf14-8d19a4d764c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.187149 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00290f-af1a-440b-bf14-8d19a4d764c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.187569 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00290f-af1a-440b-bf14-8d19a4d764c3 admin admin] PATH_INFO: `/v3/projects/c8ec2474ea464a1a9e73619ca271bccd` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.189895 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00290f-af1a-440b-bf14-8d19a4d764c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8ec2474ea464a1a9e73619ca271bccd)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:21.194704 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00290f-af1a-440b-bf14-8d19a4d764c3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:21.206678 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f5be0-897c-4084-9474-40697782ee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:21.207911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f5be0-897c-4084-9474-40697782ee29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.208270 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f5be0-897c-4084-9474-40697782ee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.208693 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f5be0-897c-4084-9474-40697782ee29 admin admin] PATH_INFO: `/v3/projects/458eceb840ef45efbc4491265ed55da5` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.210880 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f5be0-897c-4084-9474-40697782ee29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=458eceb840ef45efbc4491265ed55da5)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:21.213726 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f5be0-897c-4084-9474-40697782ee29 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:21.299558 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6f00290f-af1a-440b-bf14-8d19a4d764c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8ec2474ea464a1a9e73619ca271bccd', 'request_id': 'req-6f00290f-af1a-440b-bf14-8d19a4d764c3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.315440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6f00290f-af1a-440b-bf14-8d19a4d764c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8ec2474ea464a1a9e73619ca271bccd', 'request_id': 'req-6f00290f-af1a-440b-bf14-8d19a4d764c3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.330365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6f00290f-af1a-440b-bf14-8d19a4d764c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8ec2474ea464a1a9e73619ca271bccd', 'request_id': 'req-6f00290f-af1a-440b-bf14-8d19a4d764c3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.345227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1a5f5be0-897c-4084-9474-40697782ee29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '458eceb840ef45efbc4491265ed55da5', 'request_id': 'req-1a5f5be0-897c-4084-9474-40697782ee29'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.358772 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6f00290f-af1a-440b-bf14-8d19a4d764c3 admin admin] The token cache is being invalidate because project c8ec2474ea464a1a9e73619ca271bccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:21.359503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6f00290f-af1a-440b-bf14-8d19a4d764c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.360564 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6f00290f-af1a-440b-bf14-8d19a4d764c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.362828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1a5f5be0-897c-4084-9474-40697782ee29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '458eceb840ef45efbc4491265ed55da5', 'request_id': 'req-1a5f5be0-897c-4084-9474-40697782ee29'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.365977 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1020/2027] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:21 2022] DELETE /identity/v3/projects/c8ec2474ea464a1a9e73619ca271bccd => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:21.366994 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00290f-af1a-440b-bf14-8d19a4d764c3 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:21.370013 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6f00290f-af1a-440b-bf14-8d19a4d764c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:21.379666 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1a5f5be0-897c-4084-9474-40697782ee29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '458eceb840ef45efbc4491265ed55da5', 'request_id': 'req-1a5f5be0-897c-4084-9474-40697782ee29'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.401554 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1a5f5be0-897c-4084-9474-40697782ee29 admin admin] The token cache is being invalidate because project 458eceb840ef45efbc4491265ed55da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:21.402443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1a5f5be0-897c-4084-9474-40697782ee29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.403696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1a5f5be0-897c-4084-9474-40697782ee29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.406544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1008/2028] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:21 2022] DELETE /identity/v3/projects/458eceb840ef45efbc4491265ed55da5 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:21.408383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f5be0-897c-4084-9474-40697782ee29 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:21.411128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1a5f5be0-897c-4084-9474-40697782ee29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:21.461144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:21.505033 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00290f-af1a-440b-bf14-8d19a4d764c3 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:21.582271 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f5be0-897c-4084-9474-40697782ee29 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:21.591935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59daed5d-cc3f-44ba-8f26-803773ff0b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:21.593182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daed5d-cc3f-44ba-8f26-803773ff0b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.593852 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daed5d-cc3f-44ba-8f26-803773ff0b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.594301 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daed5d-cc3f-44ba-8f26-803773ff0b76 admin admin] PATH_INFO: `/v3/projects/a74e17623c8242cf8009ff11f85cade8/users/e174e0dbbf914c8b82cefaaa9076a876/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.627950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59daed5d-cc3f-44ba-8f26-803773ff0b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74e17623c8242cf8009ff11f85cade8, user_id=e174e0dbbf914c8b82cefaaa9076a876, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:21.631577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59daed5d-cc3f-44ba-8f26-803773ff0b76 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:21.650578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1009/2029] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:21 2022] PUT /identity/v3/projects/a74e17623c8242cf8009ff11f85cade8/users/e174e0dbbf914c8b82cefaaa9076a876/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:21.662193 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d55956-f88e-47d8-8f37-d8e230e54b47 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.662527 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d55956-f88e-47d8-8f37-d8e230e54b47 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.662873 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d55956-f88e-47d8-8f37-d8e230e54b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.679202 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4323f-59c2-4733-bf4c-bba18bf11f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:21.680223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4323f-59c2-4733-bf4c-bba18bf11f50 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.680699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4323f-59c2-4733-bf4c-bba18bf11f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.681170 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4323f-59c2-4733-bf4c-bba18bf11f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.682413 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4323f-59c2-4733-bf4c-bba18bf11f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:21.685428 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4323f-59c2-4733-bf4c-bba18bf11f50 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:21.687484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-22d55956-f88e-47d8-8f37-d8e230e54b47 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:21.688742 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-22d55956-f88e-47d8-8f37-d8e230e54b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:21.709488 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1021/2030] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:21.709488 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749331fa-d4af-43b3-acc4-b287fa3a5b54 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.709488 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749331fa-d4af-43b3-acc4-b287fa3a5b54 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.709488 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749331fa-d4af-43b3-acc4-b287fa3a5b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.739330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-749331fa-d4af-43b3-acc4-b287fa3a5b54 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:21.742680 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:21.743025 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-749331fa-d4af-43b3-acc4-b287fa3a5b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:21.793609 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1010/2031] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:21.796697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d55956-f88e-47d8-8f37-d8e230e54b47 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:21.798839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-22d55956-f88e-47d8-8f37-d8e230e54b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:21.815199 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d55956-f88e-47d8-8f37-d8e230e54b47 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:21.820871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:21.821673 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.821999 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.822416 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a admin admin] PATH_INFO: `/v3/projects/ebe4b20c07874e0ba266cfcc208231a7` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.823762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe4b20c07874e0ba266cfcc208231a7)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:21.826082 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:21.853967 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1022/2032] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:21.853967 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242461a-89ff-4af2-b91b-17102f5af54e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.853967 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242461a-89ff-4af2-b91b-17102f5af54e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.853967 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242461a-89ff-4af2-b91b-17102f5af54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.888353 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e242461a-89ff-4af2-b91b-17102f5af54e None None] MFA Rules not processed for user `e174e0dbbf914c8b82cefaaa9076a876`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:21.890538 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e242461a-89ff-4af2-b91b-17102f5af54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:21.946167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe4b20c07874e0ba266cfcc208231a7', 'request_id': 'req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.962853 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe4b20c07874e0ba266cfcc208231a7', 'request_id': 'req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.973240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe4b20c07874e0ba266cfcc208231a7', 'request_id': 'req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.990220 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a admin admin] The token cache is being invalidate because project ebe4b20c07874e0ba266cfcc208231a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:21.990931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.991680 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:21.993630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1011/2033] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:21 2022] DELETE /identity/v3/projects/ebe4b20c07874e0ba266cfcc208231a7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:21.998837 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.000589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:22.026286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1023/2034] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:22.027075 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591f015-94cd-448f-b86f-3d8558d1a3ac None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.027075 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591f015-94cd-448f-b86f-3d8558d1a3ac None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.027574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591f015-94cd-448f-b86f-3d8558d1a3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.084472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7591f015-94cd-448f-b86f-3d8558d1a3ac None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:22.086597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7591f015-94cd-448f-b86f-3d8558d1a3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:22.103307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:22.127122 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2664f1-9958-40c1-a287-c5ffb3e8af9a admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.135970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aecea57-4f7d-423b-b5ae-f2cf9441edf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.137333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecea57-4f7d-423b-b5ae-f2cf9441edf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.138137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecea57-4f7d-423b-b5ae-f2cf9441edf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.138827 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecea57-4f7d-423b-b5ae-f2cf9441edf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.139505 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aecea57-4f7d-423b-b5ae-f2cf9441edf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.143714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aecea57-4f7d-423b-b5ae-f2cf9441edf9 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.164014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1012/2035] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:22.165938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a544b7-6973-4399-929a-837d7e6ae099 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.166206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a544b7-6973-4399-929a-837d7e6ae099 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.166585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a544b7-6973-4399-929a-837d7e6ae099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.189571 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1024/2036] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:22.191053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33bcfd-bcd9-431d-9f1e-5d7fd312ca0d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.191438 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33bcfd-bcd9-431d-9f1e-5d7fd312ca0d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.191780 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33bcfd-bcd9-431d-9f1e-5d7fd312ca0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.195956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f3a544b7-6973-4399-929a-837d7e6ae099 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:22.197641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f3a544b7-6973-4399-929a-837d7e6ae099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:22.209769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1013/2037] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:22.210891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a544b7-6973-4399-929a-837d7e6ae099 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.212732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f3a544b7-6973-4399-929a-837d7e6ae099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:22.222818 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7f33bcfd-bcd9-431d-9f1e-5d7fd312ca0d None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:22.224053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7f33bcfd-bcd9-431d-9f1e-5d7fd312ca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:22.233483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1025/2038] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:22.234347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33bcfd-bcd9-431d-9f1e-5d7fd312ca0d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.249400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33bcfd-bcd9-431d-9f1e-5d7fd312ca0d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.250245 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4243606-72a8-4f12-b76c-bced9de712c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.250975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4243606-72a8-4f12-b76c-bced9de712c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.251257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4243606-72a8-4f12-b76c-bced9de712c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.251523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4243606-72a8-4f12-b76c-bced9de712c6 admin admin] PATH_INFO: `/v3/projects/82b798a177464d1d835af06da27f4948/users/7785019bd41c45d2b34f0e4768f69d6f/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.271008 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4243606-72a8-4f12-b76c-bced9de712c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b798a177464d1d835af06da27f4948, user_id=7785019bd41c45d2b34f0e4768f69d6f, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.274077 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4243606-72a8-4f12-b76c-bced9de712c6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.292976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1026/2039] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:22 2022] PUT /identity/v3/projects/82b798a177464d1d835af06da27f4948/users/7785019bd41c45d2b34f0e4768f69d6f/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:22.294658 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4243606-72a8-4f12-b76c-bced9de712c6 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.314405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:22.322098 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a544b7-6973-4399-929a-837d7e6ae099 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.400118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e027b0c-388f-4471-a85b-fb260b4c2391 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.400825 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e027b0c-388f-4471-a85b-fb260b4c2391 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.401102 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e027b0c-388f-4471-a85b-fb260b4c2391 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.401432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e027b0c-388f-4471-a85b-fb260b4c2391 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.418459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4243606-72a8-4f12-b76c-bced9de712c6 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.428453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b86c5e-8852-40a3-97b3-0130830ed1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.429182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b86c5e-8852-40a3-97b3-0130830ed1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.429494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b86c5e-8852-40a3-97b3-0130830ed1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.429760 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b86c5e-8852-40a3-97b3-0130830ed1c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.430415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b86c5e-8852-40a3-97b3-0130830ed1c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:22.430726 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b86c5e-8852-40a3-97b3-0130830ed1c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.432487 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b86c5e-8852-40a3-97b3-0130830ed1c9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.445799 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1027/2040] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:22.446840 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b86c5e-8852-40a3-97b3-0130830ed1c9 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.460765 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b86c5e-8852-40a3-97b3-0130830ed1c9 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.468310 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c252c7c-369e-4893-b9eb-cb58f1496f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.469221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252c7c-369e-4893-b9eb-cb58f1496f53 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.469702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252c7c-369e-4893-b9eb-cb58f1496f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.470152 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252c7c-369e-4893-b9eb-cb58f1496f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.471253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c252c7c-369e-4893-b9eb-cb58f1496f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:22.471742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c252c7c-369e-4893-b9eb-cb58f1496f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.474626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c252c7c-369e-4893-b9eb-cb58f1496f53 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.495333 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1028/2041] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:22.497178 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d2df5-cd5c-45b4-9f21-ee652903e1a4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.497552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d2df5-cd5c-45b4-9f21-ee652903e1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.497882 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d2df5-cd5c-45b4-9f21-ee652903e1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.505562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e027b0c-388f-4471-a85b-fb260b4c2391 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.508507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e027b0c-388f-4471-a85b-fb260b4c2391 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.522738 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c73d2df5-cd5c-45b4-9f21-ee652903e1a4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:22.525321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c73d2df5-cd5c-45b4-9f21-ee652903e1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:22.527804 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1014/2042] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:22.529520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04d3a5-0021-44e6-91ef-7c07733b9420 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.530076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04d3a5-0021-44e6-91ef-7c07733b9420 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.530560 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04d3a5-0021-44e6-91ef-7c07733b9420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.535639 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1029/2043] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:22.536440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d2df5-cd5c-45b4-9f21-ee652903e1a4 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.547884 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d2df5-cd5c-45b4-9f21-ee652903e1a4 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.564926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201ee61-1b4b-4e79-9212-fddd1f09b141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.565380 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201ee61-1b4b-4e79-9212-fddd1f09b141 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.565842 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201ee61-1b4b-4e79-9212-fddd1f09b141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.566268 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201ee61-1b4b-4e79-9212-fddd1f09b141 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.567201 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201ee61-1b4b-4e79-9212-fddd1f09b141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.569579 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201ee61-1b4b-4e79-9212-fddd1f09b141 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.585198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-db04d3a5-0021-44e6-91ef-7c07733b9420 None None] MFA Rules not processed for user `7785019bd41c45d2b34f0e4768f69d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:22.586739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-db04d3a5-0021-44e6-91ef-7c07733b9420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:22.621766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1030/2044] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:22 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:22.623014 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201ee61-1b4b-4e79-9212-fddd1f09b141 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.695743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:22.716290 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1015/2045] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:22.717306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04d3a5-0021-44e6-91ef-7c07733b9420 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.728070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201ee61-1b4b-4e79-9212-fddd1f09b141 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.730573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04d3a5-0021-44e6-91ef-7c07733b9420 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.735943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3db6c-3aac-4a3f-912e-3f40fac36a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.736913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3db6c-3aac-4a3f-912e-3f40fac36a2b admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.737384 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3db6c-3aac-4a3f-912e-3f40fac36a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.737636 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86105c-50ab-4814-ab98-0e60a757b17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.737850 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3db6c-3aac-4a3f-912e-3f40fac36a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.738926 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86105c-50ab-4814-ab98-0e60a757b17e admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.739079 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3db6c-3aac-4a3f-912e-3f40fac36a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.739560 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86105c-50ab-4814-ab98-0e60a757b17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.740016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86105c-50ab-4814-ab98-0e60a757b17e admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.741289 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86105c-50ab-4814-ab98-0e60a757b17e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:22.742381 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3db6c-3aac-4a3f-912e-3f40fac36a2b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.745564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86105c-50ab-4814-ab98-0e60a757b17e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.749577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86105c-50ab-4814-ab98-0e60a757b17e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.776646 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1016/2046] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:22.778446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86105c-50ab-4814-ab98-0e60a757b17e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.787815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6f86105c-50ab-4814-ab98-0e60a757b17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:22.801489 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86105c-50ab-4814-ab98-0e60a757b17e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.802090 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1031/2047] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:22 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:22.803792 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3db6c-3aac-4a3f-912e-3f40fac36a2b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.878190 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:22.928194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2d392-89f6-41c4-b975-c087cee149cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.929134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2d392-89f6-41c4-b975-c087cee149cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.929647 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2d392-89f6-41c4-b975-c087cee149cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.930004 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2d392-89f6-41c4-b975-c087cee149cd admin admin] PATH_INFO: `/v3/users/e174e0dbbf914c8b82cefaaa9076a876` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.932011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2d392-89f6-41c4-b975-c087cee149cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e174e0dbbf914c8b82cefaaa9076a876)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.933629 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3db6c-3aac-4a3f-912e-3f40fac36a2b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.935780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2d392-89f6-41c4-b975-c087cee149cd admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.940399 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb16119-7dad-433e-a2e3-4c6f7d0acc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.941126 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb16119-7dad-433e-a2e3-4c6f7d0acc2c admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.941573 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb16119-7dad-433e-a2e3-4c6f7d0acc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.942028 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb16119-7dad-433e-a2e3-4c6f7d0acc2c admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.943138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb16119-7dad-433e-a2e3-4c6f7d0acc2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.946323 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb16119-7dad-433e-a2e3-4c6f7d0acc2c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.978758 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1032/2048] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:22 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:22.979615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb16119-7dad-433e-a2e3-4c6f7d0acc2c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.994956 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb16119-7dad-433e-a2e3-4c6f7d0acc2c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.002836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7cd65-ae96-4d78-af5a-6c70dbd1607c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.003590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7cd65-ae96-4d78-af5a-6c70dbd1607c admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.003901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7cd65-ae96-4d78-af5a-6c70dbd1607c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.004172 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7cd65-ae96-4d78-af5a-6c70dbd1607c admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.005196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7cd65-ae96-4d78-af5a-6c70dbd1607c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:23.009074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7cd65-ae96-4d78-af5a-6c70dbd1607c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:23.025018 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8ba2d392-89f6-41c4-b975-c087cee149cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e174e0dbbf914c8b82cefaaa9076a876'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:23.058944 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1033/2049] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:22 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:23.058944 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7cd65-ae96-4d78-af5a-6c70dbd1607c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:23.059857 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8ba2d392-89f6-41c4-b975-c087cee149cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e174e0dbbf914c8b82cefaaa9076a876'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:23.074360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8ba2d392-89f6-41c4-b975-c087cee149cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e174e0dbbf914c8b82cefaaa9076a876'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:23.075523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8ba2d392-89f6-41c4-b975-c087cee149cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e174e0dbbf914c8b82cefaaa9076a876'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:23.091384 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8ba2d392-89f6-41c4-b975-c087cee149cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e174e0dbbf914c8b82cefaaa9076a876'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:23.103429 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1017/2050] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:22 2022] DELETE /identity/v3/users/e174e0dbbf914c8b82cefaaa9076a876 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:23.105737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2d392-89f6-41c4-b975-c087cee149cd admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:23.108839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8ba2d392-89f6-41c4-b975-c087cee149cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:23.206753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7cd65-ae96-4d78-af5a-6c70dbd1607c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.247891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2d392-89f6-41c4-b975-c087cee149cd admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.253528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e2d4c-83a5-4aa6-9859-986d429b3246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.254409 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e2d4c-83a5-4aa6-9859-986d429b3246 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.254840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e2d4c-83a5-4aa6-9859-986d429b3246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.255190 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e2d4c-83a5-4aa6-9859-986d429b3246 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.256069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e2d4c-83a5-4aa6-9859-986d429b3246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:23.258754 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e2d4c-83a5-4aa6-9859-986d429b3246 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:23.283709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:23.298805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1018/2051] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:23 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:23.298805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e2d4c-83a5-4aa6-9859-986d429b3246 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:23.299620 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-617e2d4c-83a5-4aa6-9859-986d429b3246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:23.323379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e2d4c-83a5-4aa6-9859-986d429b3246 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.324656 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fb253-97a1-4b92-baf6-10773f1458ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.326814 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fb253-97a1-4b92-baf6-10773f1458ea admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.326814 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fb253-97a1-4b92-baf6-10773f1458ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.326814 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fb253-97a1-4b92-baf6-10773f1458ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.326814 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85fb253-97a1-4b92-baf6-10773f1458ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:23.329410 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85fb253-97a1-4b92-baf6-10773f1458ea admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:23.338452 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a78e2-5d5a-424e-bbfa-435ec29e5999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.339510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a78e2-5d5a-424e-bbfa-435ec29e5999 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.340005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a78e2-5d5a-424e-bbfa-435ec29e5999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.340511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a78e2-5d5a-424e-bbfa-435ec29e5999 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.341698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a78e2-5d5a-424e-bbfa-435ec29e5999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:23.344875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a78e2-5d5a-424e-bbfa-435ec29e5999 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:23.366534 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1019/2052] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:23.368580 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a78e2-5d5a-424e-bbfa-435ec29e5999 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:23.374226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8b1a78e2-5d5a-424e-bbfa-435ec29e5999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:23.395009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1034/2053] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:23 2022] POST /identity/v3/projects => generated 379 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:23.395009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257847-2613-41d8-a621-0ee611f25312 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.395009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257847-2613-41d8-a621-0ee611f25312 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.395589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257847-2613-41d8-a621-0ee611f25312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.399019 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a78e2-5d5a-424e-bbfa-435ec29e5999 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.438077 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-61257847-2613-41d8-a621-0ee611f25312 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:23.440360 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-61257847-2613-41d8-a621-0ee611f25312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:23.467320 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:23.516533 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c540827-b2bf-4e7a-bdee-961e4f4d8ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.517349 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c540827-b2bf-4e7a-bdee-961e4f4d8ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.517782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c540827-b2bf-4e7a-bdee-961e4f4d8ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.518181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c540827-b2bf-4e7a-bdee-961e4f4d8ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.518968 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c540827-b2bf-4e7a-bdee-961e4f4d8ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:23.521051 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c540827-b2bf-4e7a-bdee-961e4f4d8ca1 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:23.541574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1035/2054] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:23.543978 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61257847-2613-41d8-a621-0ee611f25312 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:23.564889 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61257847-2613-41d8-a621-0ee611f25312 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.568566 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1020/2055] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:23 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:23.569875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c540827-b2bf-4e7a-bdee-961e4f4d8ca1 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:23.585421 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea986397-e704-4ec4-8389-f3aa5e6c47e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.588116 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea986397-e704-4ec4-8389-f3aa5e6c47e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.589152 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea986397-e704-4ec4-8389-f3aa5e6c47e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.589561 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea986397-e704-4ec4-8389-f3aa5e6c47e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.591146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea986397-e704-4ec4-8389-f3aa5e6c47e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:23.594180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea986397-e704-4ec4-8389-f3aa5e6c47e0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:23.594329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c540827-b2bf-4e7a-bdee-961e4f4d8ca1 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.603372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d24335-6c86-461f-b1fb-8dc61d13ecbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.604362 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d24335-6c86-461f-b1fb-8dc61d13ecbf admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.604867 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d24335-6c86-461f-b1fb-8dc61d13ecbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.605283 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d24335-6c86-461f-b1fb-8dc61d13ecbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.606267 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d24335-6c86-461f-b1fb-8dc61d13ecbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:23.609181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d24335-6c86-461f-b1fb-8dc61d13ecbf admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:23.615157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1036/2056] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:23.616896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea986397-e704-4ec4-8389-f3aa5e6c47e0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:23.621859 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ea986397-e704-4ec4-8389-f3aa5e6c47e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:23.633648 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1021/2057] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:23.635602 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d24335-6c86-461f-b1fb-8dc61d13ecbf admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:23.638984 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-49d24335-6c86-461f-b1fb-8dc61d13ecbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:23.644731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea986397-e704-4ec4-8389-f3aa5e6c47e0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.667615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625a537-064f-494c-96c6-65e218610df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.667615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625a537-064f-494c-96c6-65e218610df8 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.667615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625a537-064f-494c-96c6-65e218610df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.667615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625a537-064f-494c-96c6-65e218610df8 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.668182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625a537-064f-494c-96c6-65e218610df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:23.668182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625a537-064f-494c-96c6-65e218610df8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:23.692386 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1037/2058] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:23 2022] POST /identity/v3/users => generated 290 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:23.693451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625a537-064f-494c-96c6-65e218610df8 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:23.708156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625a537-064f-494c-96c6-65e218610df8 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.714665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee218d82-f9fc-450c-8800-86074b742efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.715723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee218d82-f9fc-450c-8800-86074b742efd admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.716196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee218d82-f9fc-450c-8800-86074b742efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.716656 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee218d82-f9fc-450c-8800-86074b742efd admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.717866 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee218d82-f9fc-450c-8800-86074b742efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:23.720856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee218d82-f9fc-450c-8800-86074b742efd admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:23.746056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1038/2059] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:23.746311 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d24335-6c86-461f-b1fb-8dc61d13ecbf admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.746459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee218d82-f9fc-450c-8800-86074b742efd admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:23.749381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ab825-98b1-4132-94d6-f2efec356b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.750656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ab825-98b1-4132-94d6-f2efec356b68 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.751386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ab825-98b1-4132-94d6-f2efec356b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.752604 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ab825-98b1-4132-94d6-f2efec356b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.761592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee218d82-f9fc-450c-8800-86074b742efd admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.767653 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ab825-98b1-4132-94d6-f2efec356b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:23.768266 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e13602-40bf-42d3-b45e-6551a8a71db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.768935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e13602-40bf-42d3-b45e-6551a8a71db0 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.769516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e13602-40bf-42d3-b45e-6551a8a71db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.769871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ab825-98b1-4132-94d6-f2efec356b68 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:23.770037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e13602-40bf-42d3-b45e-6551a8a71db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.771175 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e13602-40bf-42d3-b45e-6551a8a71db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:23.774247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e13602-40bf-42d3-b45e-6551a8a71db0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:23.783124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1022/2060] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:23.784438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ab825-98b1-4132-94d6-f2efec356b68 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:23.798244 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1039/2061] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:23.799069 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e13602-40bf-42d3-b45e-6551a8a71db0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:23.799958 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ab825-98b1-4132-94d6-f2efec356b68 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.806691 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352a14a-3124-495b-806a-fe2aae5cf44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.807623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352a14a-3124-495b-806a-fe2aae5cf44e admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.808165 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352a14a-3124-495b-806a-fe2aae5cf44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.808624 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352a14a-3124-495b-806a-fe2aae5cf44e admin admin] PATH_INFO: `/v3/projects/fac25f79d04040149978b30ddbf5df7e/users/f2d1c2e456ed40d184609ee3ffc48d18/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.810901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e13602-40bf-42d3-b45e-6551a8a71db0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.818895 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11d3c3-7afe-4245-a801-787bf23bdcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.820003 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11d3c3-7afe-4245-a801-787bf23bdcb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.820595 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11d3c3-7afe-4245-a801-787bf23bdcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.821078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11d3c3-7afe-4245-a801-787bf23bdcb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.822425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11d3c3-7afe-4245-a801-787bf23bdcb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:23.825859 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11d3c3-7afe-4245-a801-787bf23bdcb5 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:23.833994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352a14a-3124-495b-806a-fe2aae5cf44e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac25f79d04040149978b30ddbf5df7e, user_id=f2d1c2e456ed40d184609ee3ffc48d18, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:23.840617 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352a14a-3124-495b-806a-fe2aae5cf44e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:23.844890 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1040/2062] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:23.846660 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11d3c3-7afe-4245-a801-787bf23bdcb5 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:23.863899 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1023/2063] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:23 2022] PUT /identity/v3/projects/fac25f79d04040149978b30ddbf5df7e/users/f2d1c2e456ed40d184609ee3ffc48d18/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:23.865210 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352a14a-3124-495b-806a-fe2aae5cf44e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:23.870919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11d3c3-7afe-4245-a801-787bf23bdcb5 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.985106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3571ac8-dde8-4202-9e66-403a88e78167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.986798 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3571ac8-dde8-4202-9e66-403a88e78167 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.987473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3571ac8-dde8-4202-9e66-403a88e78167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.987923 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3571ac8-dde8-4202-9e66-403a88e78167 admin admin] PATH_INFO: `/v3/projects/e7cfa66817104c3b942a9c202ea9a79d/users/e57ae0d95b594d8c8dd77d1e380a6825/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.989141 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352a14a-3124-495b-806a-fe2aae5cf44e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:23.996278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1564d2-e037-4902-8de5-198495ecad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:23.997411 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1564d2-e037-4902-8de5-198495ecad8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:23.997622 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1564d2-e037-4902-8de5-198495ecad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:23.998252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1564d2-e037-4902-8de5-198495ecad8b admin admin] PATH_INFO: `/v3/projects/38ce4256ccb44f86b432c78a609e9520/users/2a8508adb21740728dc16781f5cb6f9b/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:24.009895 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:24.018708 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3571ac8-dde8-4202-9e66-403a88e78167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7cfa66817104c3b942a9c202ea9a79d, user_id=e57ae0d95b594d8c8dd77d1e380a6825, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:24.022818 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3571ac8-dde8-4202-9e66-403a88e78167 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:24.035731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1564d2-e037-4902-8de5-198495ecad8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ce4256ccb44f86b432c78a609e9520, user_id=2a8508adb21740728dc16781f5cb6f9b, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:24.038823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1564d2-e037-4902-8de5-198495ecad8b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:24.048315 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1041/2064] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:23 2022] PUT /identity/v3/projects/e7cfa66817104c3b942a9c202ea9a79d/users/e57ae0d95b594d8c8dd77d1e380a6825/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:24.049100 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3571ac8-dde8-4202-9e66-403a88e78167 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:24.061216 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1024/2065] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:23 2022] PUT /identity/v3/projects/38ce4256ccb44f86b432c78a609e9520/users/2a8508adb21740728dc16781f5cb6f9b/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:24.062349 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401081c-8e97-45a0-975c-b7f455ea4de2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:24.062605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401081c-8e97-45a0-975c-b7f455ea4de2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:24.062875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401081c-8e97-45a0-975c-b7f455ea4de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:24.101544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:24.108701 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c401081c-8e97-45a0-975c-b7f455ea4de2 None None] MFA Rules not processed for user `f2d1c2e456ed40d184609ee3ffc48d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:24.111663 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c401081c-8e97-45a0-975c-b7f455ea4de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:24.189539 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3571ac8-dde8-4202-9e66-403a88e78167 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:24.238663 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1025/2066] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:24.239791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401081c-8e97-45a0-975c-b7f455ea4de2 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:24.313874 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026b000-bbb2-49c6-aa6d-ee4299fca6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:24.315671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b000-bbb2-49c6-aa6d-ee4299fca6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:24.316000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b000-bbb2-49c6-aa6d-ee4299fca6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:24.316304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b000-bbb2-49c6-aa6d-ee4299fca6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:24.317328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026b000-bbb2-49c6-aa6d-ee4299fca6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:24.319619 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026b000-bbb2-49c6-aa6d-ee4299fca6e0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:24.341571 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1042/2067] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:24.341571 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280abc74-3b45-4a4d-87be-f0e4055c67b1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:24.341571 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280abc74-3b45-4a4d-87be-f0e4055c67b1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:24.341571 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280abc74-3b45-4a4d-87be-f0e4055c67b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:24.379149 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401081c-8e97-45a0-975c-b7f455ea4de2 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:24.380421 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-280abc74-3b45-4a4d-87be-f0e4055c67b1 None None] MFA Rules not processed for user `2a8508adb21740728dc16781f5cb6f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:24.382551 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-280abc74-3b45-4a4d-87be-f0e4055c67b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:24.385100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e762c04-a28c-4664-9538-033fe4cbd61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:24.386150 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e762c04-a28c-4664-9538-033fe4cbd61f admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:24.387041 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e762c04-a28c-4664-9538-033fe4cbd61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:24.387640 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e762c04-a28c-4664-9538-033fe4cbd61f admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:24.388996 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e762c04-a28c-4664-9538-033fe4cbd61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:24.392621 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e762c04-a28c-4664-9538-033fe4cbd61f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:24.414734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1026/2068] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:24.416492 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e762c04-a28c-4664-9538-033fe4cbd61f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:24.421599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2e762c04-a28c-4664-9538-033fe4cbd61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:24.495809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1043/2069] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:24.497155 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280abc74-3b45-4a4d-87be-f0e4055c67b1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:24.517890 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280abc74-3b45-4a4d-87be-f0e4055c67b1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:24.524612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e163c5-2cae-4a66-a12b-1cecc4e19cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:24.525316 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e163c5-2cae-4a66-a12b-1cecc4e19cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:24.525643 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e163c5-2cae-4a66-a12b-1cecc4e19cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:24.525936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e163c5-2cae-4a66-a12b-1cecc4e19cc2 admin admin] PATH_INFO: `/v3/projects/842cf9fa3f8149188a99abde64d43a0f/users/89e467e19a2845078516cc4b58211b7f/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:24.528011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e762c04-a28c-4664-9538-033fe4cbd61f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:24.536646 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7da3d7-7751-46f4-b56c-8f9b1de551b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:24.537995 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7da3d7-7751-46f4-b56c-8f9b1de551b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:24.539377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7da3d7-7751-46f4-b56c-8f9b1de551b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:24.539377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7da3d7-7751-46f4-b56c-8f9b1de551b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:24.551511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e163c5-2cae-4a66-a12b-1cecc4e19cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=842cf9fa3f8149188a99abde64d43a0f, user_id=89e467e19a2845078516cc4b58211b7f, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:24.554713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e163c5-2cae-4a66-a12b-1cecc4e19cc2 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:24.557020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7da3d7-7751-46f4-b56c-8f9b1de551b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:24.560145 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7da3d7-7751-46f4-b56c-8f9b1de551b2 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:24.567440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:24.579112 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1027/2070] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:24.580173 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7da3d7-7751-46f4-b56c-8f9b1de551b2 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:24.582104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1044/2071] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:24 2022] PUT /identity/v3/projects/842cf9fa3f8149188a99abde64d43a0f/users/89e467e19a2845078516cc4b58211b7f/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:24.582350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5d7da3d7-7751-46f4-b56c-8f9b1de551b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:24.583971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e163c5-2cae-4a66-a12b-1cecc4e19cc2 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:24.612855 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7da3d7-7751-46f4-b56c-8f9b1de551b2 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:24.668454 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:24.699266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd4312-b2aa-40b1-a475-45708197a14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:24.700427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd4312-b2aa-40b1-a475-45708197a14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:24.700872 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd4312-b2aa-40b1-a475-45708197a14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:24.701447 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd4312-b2aa-40b1-a475-45708197a14b admin admin] PATH_INFO: `/v3/projects/a74e17623c8242cf8009ff11f85cade8` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:24.703414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd4312-b2aa-40b1-a475-45708197a14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74e17623c8242cf8009ff11f85cade8)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:24.706991 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd4312-b2aa-40b1-a475-45708197a14b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:24.718356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e163c5-2cae-4a66-a12b-1cecc4e19cc2 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:24.728881 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9b2a8-d5ae-4458-bd0c-f1b126d2cf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:24.730326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9b2a8-d5ae-4458-bd0c-f1b126d2cf26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:24.730886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9b2a8-d5ae-4458-bd0c-f1b126d2cf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:24.731503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9b2a8-d5ae-4458-bd0c-f1b126d2cf26 admin admin] PATH_INFO: `/v3/projects/e7cfa66817104c3b942a9c202ea9a79d/users/e57ae0d95b594d8c8dd77d1e380a6825/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:24.735088 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9b2a8-d5ae-4458-bd0c-f1b126d2cf26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7cfa66817104c3b942a9c202ea9a79d, user_id=e57ae0d95b594d8c8dd77d1e380a6825, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:24.740430 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9b2a8-d5ae-4458-bd0c-f1b126d2cf26 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:24.764268 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1045/2072] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:24 2022] PUT /identity/v3/projects/e7cfa66817104c3b942a9c202ea9a79d/users/e57ae0d95b594d8c8dd77d1e380a6825/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:24.771530 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9b2a8-d5ae-4458-bd0c-f1b126d2cf26 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:24.775896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-eeb9b2a8-d5ae-4458-bd0c-f1b126d2cf26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:24.794635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-38dd4312-b2aa-40b1-a475-45708197a14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74e17623c8242cf8009ff11f85cade8', 'request_id': 'req-38dd4312-b2aa-40b1-a475-45708197a14b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:24.804942 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-38dd4312-b2aa-40b1-a475-45708197a14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74e17623c8242cf8009ff11f85cade8', 'request_id': 'req-38dd4312-b2aa-40b1-a475-45708197a14b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:24.814859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-38dd4312-b2aa-40b1-a475-45708197a14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74e17623c8242cf8009ff11f85cade8', 'request_id': 'req-38dd4312-b2aa-40b1-a475-45708197a14b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:24.830432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-38dd4312-b2aa-40b1-a475-45708197a14b admin admin] The token cache is being invalidate because project a74e17623c8242cf8009ff11f85cade8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:24.830784 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-38dd4312-b2aa-40b1-a475-45708197a14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:24.831411 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-38dd4312-b2aa-40b1-a475-45708197a14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:24.836484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1028/2073] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:24 2022] DELETE /identity/v3/projects/a74e17623c8242cf8009ff11f85cade8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:24.836484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ba099-14d4-4eec-a329-1fb4dec018c2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:24.836484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ba099-14d4-4eec-a329-1fb4dec018c2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:24.836484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ba099-14d4-4eec-a329-1fb4dec018c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:24.876125 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7f8ba099-14d4-4eec-a329-1fb4dec018c2 None None] MFA Rules not processed for user `89e467e19a2845078516cc4b58211b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:24.877076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9b2a8-d5ae-4458-bd0c-f1b126d2cf26 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:24.877243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7f8ba099-14d4-4eec-a329-1fb4dec018c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:24.975503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2da52-38ea-4eda-8527-e9daddcdacbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:24.976940 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2da52-38ea-4eda-8527-e9daddcdacbd service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:24.977631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2da52-38ea-4eda-8527-e9daddcdacbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:24.978249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2da52-38ea-4eda-8527-e9daddcdacbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:24.982239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0ed2da52-38ea-4eda-8527-e9daddcdacbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:24.994166 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1029/2074] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:24.996169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb686d-f8a4-45fc-a5d5-364e24c7ce91 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:24.996673 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb686d-f8a4-45fc-a5d5-364e24c7ce91 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:24.997167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb686d-f8a4-45fc-a5d5-364e24c7ce91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:25.063374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e3fb686d-f8a4-45fc-a5d5-364e24c7ce91 None None] MFA Rules not processed for user `e57ae0d95b594d8c8dd77d1e380a6825`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:25.065876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e3fb686d-f8a4-45fc-a5d5-364e24c7ce91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:25.170807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2da52-38ea-4eda-8527-e9daddcdacbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:25.173161 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:25.175149 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2da52-38ea-4eda-8527-e9daddcdacbd service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:25.204753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1046/2075] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:25.212303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1030/2076] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:25.213836 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb686d-f8a4-45fc-a5d5-364e24c7ce91 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:25.222766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfedf7-873d-4d95-a635-f98de4a36439 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:25.223379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfedf7-873d-4d95-a635-f98de4a36439 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:25.224004 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfedf7-873d-4d95-a635-f98de4a36439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:25.228836 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e3fb686d-f8a4-45fc-a5d5-364e24c7ce91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:25.269003 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:25.289061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-66bfedf7-873d-4d95-a635-f98de4a36439 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:25.291261 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-66bfedf7-873d-4d95-a635-f98de4a36439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:25.377402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb686d-f8a4-45fc-a5d5-364e24c7ce91 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:25.385494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682b74a-33d7-479d-9163-923b36fda4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:25.387233 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682b74a-33d7-479d-9163-923b36fda4fc admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:25.387233 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682b74a-33d7-479d-9163-923b36fda4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:25.387586 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682b74a-33d7-479d-9163-923b36fda4fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:25.388537 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682b74a-33d7-479d-9163-923b36fda4fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:25.392385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682b74a-33d7-479d-9163-923b36fda4fc admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:25.427593 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1047/2077] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:25.430256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfedf7-873d-4d95-a635-f98de4a36439 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:25.433965 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-66bfedf7-873d-4d95-a635-f98de4a36439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:25.461667 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfedf7-873d-4d95-a635-f98de4a36439 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:25.468543 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1031/2078] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:25 2022] POST /identity/v3/projects => generated 381 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:25.470465 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682b74a-33d7-479d-9163-923b36fda4fc admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:25.473728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520616e6-efe7-418f-80b8-54f71df2c27c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:25.473940 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c682b74a-33d7-479d-9163-923b36fda4fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:25.475275 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520616e6-efe7-418f-80b8-54f71df2c27c service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:25.475765 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520616e6-efe7-418f-80b8-54f71df2c27c service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:25.476223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520616e6-efe7-418f-80b8-54f71df2c27c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:25.494099 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520616e6-efe7-418f-80b8-54f71df2c27c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:25.497306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520616e6-efe7-418f-80b8-54f71df2c27c service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:25.517670 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1048/2079] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:25.521277 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e637e-d2e6-420f-afee-8de4f6bc63d5 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:25.521775 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e637e-d2e6-420f-afee-8de4f6bc63d5 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:25.522222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e637e-d2e6-420f-afee-8de4f6bc63d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:25.573276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ba1e637e-d2e6-420f-afee-8de4f6bc63d5 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:25.573276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ba1e637e-d2e6-420f-afee-8de4f6bc63d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:25.687589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682b74a-33d7-479d-9163-923b36fda4fc admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:25.705650 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15341c-f35d-4db5-a877-c0adf4c2c8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:25.707084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15341c-f35d-4db5-a877-c0adf4c2c8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:25.707553 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15341c-f35d-4db5-a877-c0adf4c2c8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:25.708144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15341c-f35d-4db5-a877-c0adf4c2c8f0 admin admin] PATH_INFO: `/v3/users/2a8508adb21740728dc16781f5cb6f9b` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:25.711339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15341c-f35d-4db5-a877-c0adf4c2c8f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a8508adb21740728dc16781f5cb6f9b)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:25.714557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15341c-f35d-4db5-a877-c0adf4c2c8f0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:25.734987 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1049/2080] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:25.734987 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e637e-d2e6-420f-afee-8de4f6bc63d5 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:25.754021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e637e-d2e6-420f-afee-8de4f6bc63d5 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:25.765337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b24256-4c88-4192-9a81-8ca0c9043392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:25.766737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b24256-4c88-4192-9a81-8ca0c9043392 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:25.767598 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b24256-4c88-4192-9a81-8ca0c9043392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:25.768612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b24256-4c88-4192-9a81-8ca0c9043392 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:25.770038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b24256-4c88-4192-9a81-8ca0c9043392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:25.772894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b24256-4c88-4192-9a81-8ca0c9043392 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:25.808014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ef15341c-f35d-4db5-a877-c0adf4c2c8f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a8508adb21740728dc16781f5cb6f9b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:25.811764 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1050/2081] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:25 2022] POST /identity/v3/users => generated 297 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:25.813224 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b24256-4c88-4192-9a81-8ca0c9043392 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:25.827687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b24256-4c88-4192-9a81-8ca0c9043392 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:25.830315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ef15341c-f35d-4db5-a877-c0adf4c2c8f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a8508adb21740728dc16781f5cb6f9b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:25.836195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1803c37-c4bc-4ae1-b4d7-ec48d8d740e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:25.838878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1803c37-c4bc-4ae1-b4d7-ec48d8d740e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:25.839456 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1803c37-c4bc-4ae1-b4d7-ec48d8d740e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:25.839934 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1803c37-c4bc-4ae1-b4d7-ec48d8d740e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:25.841167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1803c37-c4bc-4ae1-b4d7-ec48d8d740e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:25.841968 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1803c37-c4bc-4ae1-b4d7-ec48d8d740e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:25.844392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ef15341c-f35d-4db5-a877-c0adf4c2c8f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a8508adb21740728dc16781f5cb6f9b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:25.844867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1803c37-c4bc-4ae1-b4d7-ec48d8d740e4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:25.845685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ef15341c-f35d-4db5-a877-c0adf4c2c8f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a8508adb21740728dc16781f5cb6f9b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:25.850456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:25.864846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ef15341c-f35d-4db5-a877-c0adf4c2c8f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a8508adb21740728dc16781f5cb6f9b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:25.871143 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1051/2082] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:25.872536 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1803c37-c4bc-4ae1-b4d7-ec48d8d740e4 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:25.876317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d1803c37-c4bc-4ae1-b4d7-ec48d8d740e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:25.879617 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1032/2083] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:25 2022] DELETE /identity/v3/users/2a8508adb21740728dc16781f5cb6f9b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:25.881769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15341c-f35d-4db5-a877-c0adf4c2c8f0 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:25.884468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ef15341c-f35d-4db5-a877-c0adf4c2c8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:25.900202 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1803c37-c4bc-4ae1-b4d7-ec48d8d740e4 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:25.987025 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15341c-f35d-4db5-a877-c0adf4c2c8f0 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:25.991591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5d5e6-8c5b-4bdf-b0d0-9a80917d575c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:25.992283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5d5e6-8c5b-4bdf-b0d0-9a80917d575c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:25.992695 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5d5e6-8c5b-4bdf-b0d0-9a80917d575c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:25.992898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5d5e6-8c5b-4bdf-b0d0-9a80917d575c admin admin] PATH_INFO: `/v3/users/7785019bd41c45d2b34f0e4768f69d6f` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:25.993760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5869dd-fd12-466b-ad45-7955d15117c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:25.994207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5d5e6-8c5b-4bdf-b0d0-9a80917d575c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7785019bd41c45d2b34f0e4768f69d6f)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:25.994434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5869dd-fd12-466b-ad45-7955d15117c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:25.994807 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5869dd-fd12-466b-ad45-7955d15117c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:25.995088 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5869dd-fd12-466b-ad45-7955d15117c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:25.996010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5869dd-fd12-466b-ad45-7955d15117c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:25.996572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5d5e6-8c5b-4bdf-b0d0-9a80917d575c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:25.997524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5869dd-fd12-466b-ad45-7955d15117c8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:25.999044 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:26.015761 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1033/2084] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:26.016870 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5869dd-fd12-466b-ad45-7955d15117c8 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:26.020738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-de5869dd-fd12-466b-ad45-7955d15117c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:26.040837 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5869dd-fd12-466b-ad45-7955d15117c8 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:26.050024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1b063-9fb9-41aa-b4b3-6c621ba96d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:26.050558 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1b063-9fb9-41aa-b4b3-6c621ba96d03 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.051020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1b063-9fb9-41aa-b4b3-6c621ba96d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.051691 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1b063-9fb9-41aa-b4b3-6c621ba96d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.052701 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1b063-9fb9-41aa-b4b3-6c621ba96d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:26.056840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1b063-9fb9-41aa-b4b3-6c621ba96d03 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:26.084101 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f7b5d5e6-8c5b-4bdf-b0d0-9a80917d575c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7785019bd41c45d2b34f0e4768f69d6f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:26.099534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f7b5d5e6-8c5b-4bdf-b0d0-9a80917d575c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7785019bd41c45d2b34f0e4768f69d6f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:26.109566 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1034/2085] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:26 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:26.112565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744b0c0-00b5-47bb-86f8-a72e339840b0 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.112565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744b0c0-00b5-47bb-86f8-a72e339840b0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.112937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744b0c0-00b5-47bb-86f8-a72e339840b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.130636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f7b5d5e6-8c5b-4bdf-b0d0-9a80917d575c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7785019bd41c45d2b34f0e4768f69d6f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:26.131804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f7b5d5e6-8c5b-4bdf-b0d0-9a80917d575c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7785019bd41c45d2b34f0e4768f69d6f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:26.132781 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f7b5d5e6-8c5b-4bdf-b0d0-9a80917d575c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7785019bd41c45d2b34f0e4768f69d6f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:26.141094 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b744b0c0-00b5-47bb-86f8-a72e339840b0 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:26.143249 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b744b0c0-00b5-47bb-86f8-a72e339840b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:26.162135 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1052/2086] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:25 2022] DELETE /identity/v3/users/7785019bd41c45d2b34f0e4768f69d6f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:26.163843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5d5e6-8c5b-4bdf-b0d0-9a80917d575c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:26.169178 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f7b5d5e6-8c5b-4bdf-b0d0-9a80917d575c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:26.274818 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1035/2087] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:26.276463 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744b0c0-00b5-47bb-86f8-a72e339840b0 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:26.280109 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b744b0c0-00b5-47bb-86f8-a72e339840b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:26.301416 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744b0c0-00b5-47bb-86f8-a72e339840b0 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:26.322287 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5d5e6-8c5b-4bdf-b0d0-9a80917d575c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:26.330373 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423a9b3-6950-4dbc-8100-0356fbf22316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:26.331691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423a9b3-6950-4dbc-8100-0356fbf22316 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.333561 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423a9b3-6950-4dbc-8100-0356fbf22316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.333561 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423a9b3-6950-4dbc-8100-0356fbf22316 admin admin] PATH_INFO: `/v3/projects/8bf9e6053a194af8a1f0593c5372d72c/users/6210e1fa640847cf9ab72f67ffd0346f/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.376416 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423a9b3-6950-4dbc-8100-0356fbf22316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf9e6053a194af8a1f0593c5372d72c, user_id=6210e1fa640847cf9ab72f67ffd0346f, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:26.380902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423a9b3-6950-4dbc-8100-0356fbf22316 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:26.395082 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2942b-8ef4-4d72-9c90-b1efb42cf6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:26.397549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2942b-8ef4-4d72-9c90-b1efb42cf6ac admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.398321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2942b-8ef4-4d72-9c90-b1efb42cf6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.399080 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2942b-8ef4-4d72-9c90-b1efb42cf6ac admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.400339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2942b-8ef4-4d72-9c90-b1efb42cf6ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:26.404103 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2942b-8ef4-4d72-9c90-b1efb42cf6ac admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:26.410264 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1053/2088] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:26 2022] PUT /identity/v3/projects/8bf9e6053a194af8a1f0593c5372d72c/users/6210e1fa640847cf9ab72f67ffd0346f/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:26.413784 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162a4ed-c22e-411e-af88-578bbbd2ff53 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.414290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162a4ed-c22e-411e-af88-578bbbd2ff53 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.414692 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162a4ed-c22e-411e-af88-578bbbd2ff53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.426303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:26.459823 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-9162a4ed-c22e-411e-af88-578bbbd2ff53 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:26.462422 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9162a4ed-c22e-411e-af88-578bbbd2ff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:26.464157 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1036/2089] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:26 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:26.466794 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2942b-8ef4-4d72-9c90-b1efb42cf6ac admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:26.470263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-aec2942b-8ef4-4d72-9c90-b1efb42cf6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:26.579599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1054/2090] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:26.580863 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162a4ed-c22e-411e-af88-578bbbd2ff53 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:26.591139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:26.606693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162a4ed-c22e-411e-af88-578bbbd2ff53 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:26.622214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2942b-8ef4-4d72-9c90-b1efb42cf6ac admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:26.626058 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f1ae4-045b-4ec9-999c-e0eca7f6a989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:26.627317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f1ae4-045b-4ec9-999c-e0eca7f6a989 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.627838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f1ae4-045b-4ec9-999c-e0eca7f6a989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.628286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f1ae4-045b-4ec9-999c-e0eca7f6a989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.629492 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f1ae4-045b-4ec9-999c-e0eca7f6a989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:26.633049 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f1ae4-045b-4ec9-999c-e0eca7f6a989 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:26.657576 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1055/2091] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:26.658619 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f1ae4-045b-4ec9-999c-e0eca7f6a989 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:26.673611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f1ae4-045b-4ec9-999c-e0eca7f6a989 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:26.680884 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872868e-752a-444b-ab65-ebe5a192e233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:26.681814 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872868e-752a-444b-ab65-ebe5a192e233 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.682227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872868e-752a-444b-ab65-ebe5a192e233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.683126 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872868e-752a-444b-ab65-ebe5a192e233 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.684285 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872868e-752a-444b-ab65-ebe5a192e233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:26.687337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872868e-752a-444b-ab65-ebe5a192e233 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:26.704923 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1056/2092] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:26.706441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872868e-752a-444b-ab65-ebe5a192e233 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:26.723025 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665ca04-3fa1-4bbb-bc79-8820ee07fd16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:26.723926 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665ca04-3fa1-4bbb-bc79-8820ee07fd16 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.724346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665ca04-3fa1-4bbb-bc79-8820ee07fd16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.724696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665ca04-3fa1-4bbb-bc79-8820ee07fd16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.737191 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665ca04-3fa1-4bbb-bc79-8820ee07fd16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:26.738894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665ca04-3fa1-4bbb-bc79-8820ee07fd16 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:26.762271 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1037/2093] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:26.763551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665ca04-3fa1-4bbb-bc79-8820ee07fd16 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:26.781283 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665ca04-3fa1-4bbb-bc79-8820ee07fd16 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:26.789901 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162c193-3358-4a92-91a1-40acf6cfdf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:26.791075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162c193-3358-4a92-91a1-40acf6cfdf4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.791629 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162c193-3358-4a92-91a1-40acf6cfdf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.792182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162c193-3358-4a92-91a1-40acf6cfdf4e admin admin] PATH_INFO: `/v3/projects/8bf9e6053a194af8a1f0593c5372d72c/users/6210e1fa640847cf9ab72f67ffd0346f/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.797388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162c193-3358-4a92-91a1-40acf6cfdf4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf9e6053a194af8a1f0593c5372d72c, user_id=6210e1fa640847cf9ab72f67ffd0346f, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:26.804886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162c193-3358-4a92-91a1-40acf6cfdf4e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:26.811566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872868e-752a-444b-ab65-ebe5a192e233 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:26.816991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8c0dc-b1d9-4d73-89a1-6ce9436dacc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:26.817874 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c0dc-b1d9-4d73-89a1-6ce9436dacc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.818157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c0dc-b1d9-4d73-89a1-6ce9436dacc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.818433 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c0dc-b1d9-4d73-89a1-6ce9436dacc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.832610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1038/2094] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:26 2022] PUT /identity/v3/projects/8bf9e6053a194af8a1f0593c5372d72c/users/6210e1fa640847cf9ab72f67ffd0346f/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:26.833174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162c193-3358-4a92-91a1-40acf6cfdf4e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:26.849593 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8c0dc-b1d9-4d73-89a1-6ce9436dacc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:26.851657 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8c0dc-b1d9-4d73-89a1-6ce9436dacc7 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:26.870140 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1057/2095] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:26.873060 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d7a03-1653-4ecb-b756-cdb2afd23d4c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.873487 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d7a03-1653-4ecb-b756-cdb2afd23d4c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.873806 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d7a03-1653-4ecb-b756-cdb2afd23d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.948506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-601d7a03-1653-4ecb-b756-cdb2afd23d4c None None] MFA Rules not processed for user `6210e1fa640847cf9ab72f67ffd0346f`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:26.950829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-601d7a03-1653-4ecb-b756-cdb2afd23d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:27.029967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162c193-3358-4a92-91a1-40acf6cfdf4e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:27.055295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7db8c-b855-4e4c-b3ef-0e4eaa8def93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:27.056004 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7db8c-b855-4e4c-b3ef-0e4eaa8def93 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:27.056274 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7db8c-b855-4e4c-b3ef-0e4eaa8def93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:27.056538 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7db8c-b855-4e4c-b3ef-0e4eaa8def93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:27.057623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7db8c-b855-4e4c-b3ef-0e4eaa8def93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:27.060564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7db8c-b855-4e4c-b3ef-0e4eaa8def93 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:27.080385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1039/2096] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:27.086535 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7db8c-b855-4e4c-b3ef-0e4eaa8def93 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:27.125291 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7db8c-b855-4e4c-b3ef-0e4eaa8def93 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:27.144932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b5306-41d0-48e7-818f-ec3bb5436f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:27.151697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b5306-41d0-48e7-818f-ec3bb5436f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:27.151697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b5306-41d0-48e7-818f-ec3bb5436f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:27.151697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b5306-41d0-48e7-818f-ec3bb5436f55 admin admin] PATH_INFO: `/v3/projects/e2b438c2ee784906bc9539b3682c40bf/users/0403aec8d6e94946b9b6ee6c9682d93e/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:27.154525 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1058/2097] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:27.164590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d7a03-1653-4ecb-b756-cdb2afd23d4c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:27.167532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-601d7a03-1653-4ecb-b756-cdb2afd23d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:27.185790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b5306-41d0-48e7-818f-ec3bb5436f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b438c2ee784906bc9539b3682c40bf, user_id=0403aec8d6e94946b9b6ee6c9682d93e, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:27.193105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b5306-41d0-48e7-818f-ec3bb5436f55 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:27.225647 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1040/2098] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:27 2022] PUT /identity/v3/projects/e2b438c2ee784906bc9539b3682c40bf/users/0403aec8d6e94946b9b6ee6c9682d93e/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:27.246359 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2014e7-e162-49cb-9fe2-6f5cca7e1c9d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:27.247146 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2014e7-e162-49cb-9fe2-6f5cca7e1c9d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:27.247822 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2014e7-e162-49cb-9fe2-6f5cca7e1c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:27.324290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d7a03-1653-4ecb-b756-cdb2afd23d4c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:27.334349 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:27.338632 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-fc2014e7-e162-49cb-9fe2-6f5cca7e1c9d None None] MFA Rules not processed for user `0403aec8d6e94946b9b6ee6c9682d93e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:27.345072 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fc2014e7-e162-49cb-9fe2-6f5cca7e1c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:27.386503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:27.453709 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1041/2099] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:27.466247 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2014e7-e162-49cb-9fe2-6f5cca7e1c9d None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:27.467885 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fc2014e7-e162-49cb-9fe2-6f5cca7e1c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:27.473342 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e3cd5-6ed3-4cd4-b086-b2e0c22cf82c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:27.474225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e3cd5-6ed3-4cd4-b086-b2e0c22cf82c service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:27.474636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e3cd5-6ed3-4cd4-b086-b2e0c22cf82c service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:27.477074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e3cd5-6ed3-4cd4-b086-b2e0c22cf82c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:27.483507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2014e7-e162-49cb-9fe2-6f5cca7e1c9d None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:27.488869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac50e3c-dc39-429c-9ab5-bcd09c0d552e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:27.489916 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac50e3c-dc39-429c-9ab5-bcd09c0d552e service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:27.490333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac50e3c-dc39-429c-9ab5-bcd09c0d552e service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:27.490717 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac50e3c-dc39-429c-9ab5-bcd09c0d552e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:27.506911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac50e3c-dc39-429c-9ab5-bcd09c0d552e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:27.509247 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac50e3c-dc39-429c-9ab5-bcd09c0d552e service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:27.534826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1042/2100] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:32:27.587811 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e3cd5-6ed3-4cd4-b086-b2e0c22cf82c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:27.589472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e3cd5-6ed3-4cd4-b086-b2e0c22cf82c service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:27.602136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1059/2101] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:27.807193 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac50e3c-dc39-429c-9ab5-bcd09c0d552e service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:27.809719 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-aac50e3c-dc39-429c-9ab5-bcd09c0d552e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:27.828637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e3cd5-6ed3-4cd4-b086-b2e0c22cf82c service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:27.832303 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6d2e3cd5-6ed3-4cd4-b086-b2e0c22cf82c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:28.054655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac50e3c-dc39-429c-9ab5-bcd09c0d552e service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:28.078572 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:28.079547 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:28.080108 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:28.083892 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee admin admin] PATH_INFO: `/v3/projects/82b798a177464d1d835af06da27f4948` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:28.087944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b798a177464d1d835af06da27f4948)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:28.098516 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:28.113257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e3cd5-6ed3-4cd4-b086-b2e0c22cf82c service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:28.122400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d3e2e-35d6-4502-8494-8af634f289ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:28.123180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3e2e-35d6-4502-8494-8af634f289ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:28.125503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3e2e-35d6-4502-8494-8af634f289ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:28.125951 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3e2e-35d6-4502-8494-8af634f289ec admin admin] PATH_INFO: `/v3/projects/38ce4256ccb44f86b432c78a609e9520` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:28.127529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d3e2e-35d6-4502-8494-8af634f289ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=38ce4256ccb44f86b432c78a609e9520)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:28.133267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d3e2e-35d6-4502-8494-8af634f289ec admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:28.248316 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b798a177464d1d835af06da27f4948', 'request_id': 'req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.254532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d45d3e2e-35d6-4502-8494-8af634f289ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38ce4256ccb44f86b432c78a609e9520', 'request_id': 'req-d45d3e2e-35d6-4502-8494-8af634f289ec'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.259436 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b798a177464d1d835af06da27f4948', 'request_id': 'req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.268353 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d45d3e2e-35d6-4502-8494-8af634f289ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38ce4256ccb44f86b432c78a609e9520', 'request_id': 'req-d45d3e2e-35d6-4502-8494-8af634f289ec'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.270033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b798a177464d1d835af06da27f4948', 'request_id': 'req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.292546 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d45d3e2e-35d6-4502-8494-8af634f289ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38ce4256ccb44f86b432c78a609e9520', 'request_id': 'req-d45d3e2e-35d6-4502-8494-8af634f289ec'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.294184 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee admin admin] The token cache is being invalidate because project 82b798a177464d1d835af06da27f4948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:28.294996 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.296490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.299387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1043/2102] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:27 2022] DELETE /identity/v3/projects/82b798a177464d1d835af06da27f4948 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:28.300881 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:28.303418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:28.313852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d45d3e2e-35d6-4502-8494-8af634f289ec admin admin] The token cache is being invalidate because project 38ce4256ccb44f86b432c78a609e9520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:28.314257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d45d3e2e-35d6-4502-8494-8af634f289ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.315256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d45d3e2e-35d6-4502-8494-8af634f289ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.319080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1060/2103] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:27 2022] DELETE /identity/v3/projects/38ce4256ccb44f86b432c78a609e9520 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:28.320047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d3e2e-35d6-4502-8494-8af634f289ec admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:28.323392 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d45d3e2e-35d6-4502-8494-8af634f289ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:28.351735 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:28.371614 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:28.437856 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f138fcd-abdb-46e5-b5f8-7ec6fe4fabee admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:28.445464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44aebb8-9d78-4747-b44d-043a3448aa80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:28.447281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aebb8-9d78-4747-b44d-043a3448aa80 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:28.448227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aebb8-9d78-4747-b44d-043a3448aa80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:28.449060 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aebb8-9d78-4747-b44d-043a3448aa80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:28.454215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d44aebb8-9d78-4747-b44d-043a3448aa80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:28.537336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44aebb8-9d78-4747-b44d-043a3448aa80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:28.540175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44aebb8-9d78-4747-b44d-043a3448aa80 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:28.549990 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d3e2e-35d6-4502-8494-8af634f289ec admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:28.551526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1044/2104] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:28.564843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ea6b9-bdd7-4289-bf92-39db02ae718f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:28.567118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ea6b9-bdd7-4289-bf92-39db02ae718f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:28.567615 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ea6b9-bdd7-4289-bf92-39db02ae718f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:28.607172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ec8ea6b9-bdd7-4289-bf92-39db02ae718f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:28.608753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ec8ea6b9-bdd7-4289-bf92-39db02ae718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:28.693883 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711d959-c812-4a9d-9355-8f8a98bf74f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:28.696240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711d959-c812-4a9d-9355-8f8a98bf74f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:28.697209 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711d959-c812-4a9d-9355-8f8a98bf74f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:28.698168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711d959-c812-4a9d-9355-8f8a98bf74f4 admin admin] PATH_INFO: `/v3/users/e57ae0d95b594d8c8dd77d1e380a6825` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:28.701516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711d959-c812-4a9d-9355-8f8a98bf74f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e57ae0d95b594d8c8dd77d1e380a6825)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:28.707283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711d959-c812-4a9d-9355-8f8a98bf74f4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:28.747668 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1045/2105] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:28.750875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215ffdc-ee7f-42d6-8eb2-0a97d479f2cf None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:28.753641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215ffdc-ee7f-42d6-8eb2-0a97d479f2cf None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:28.755132 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215ffdc-ee7f-42d6-8eb2-0a97d479f2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:28.790521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b215ffdc-ee7f-42d6-8eb2-0a97d479f2cf None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:28.792386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b215ffdc-ee7f-42d6-8eb2-0a97d479f2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:28.805550 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1046/2106] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:28.811334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215ffdc-ee7f-42d6-8eb2-0a97d479f2cf None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:28.837989 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215ffdc-ee7f-42d6-8eb2-0a97d479f2cf None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:28.844320 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6711d959-c812-4a9d-9355-8f8a98bf74f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e57ae0d95b594d8c8dd77d1e380a6825'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.853014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b6a88-b3e9-4573-8a73-31d456a4e98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:28.854142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b6a88-b3e9-4573-8a73-31d456a4e98d admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:28.854862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b6a88-b3e9-4573-8a73-31d456a4e98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:28.855377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b6a88-b3e9-4573-8a73-31d456a4e98d admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:28.856263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b6a88-b3e9-4573-8a73-31d456a4e98d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:28.857762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b6a88-b3e9-4573-8a73-31d456a4e98d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:28.858368 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6711d959-c812-4a9d-9355-8f8a98bf74f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e57ae0d95b594d8c8dd77d1e380a6825'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.862424 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b6a88-b3e9-4573-8a73-31d456a4e98d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:28.894093 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6711d959-c812-4a9d-9355-8f8a98bf74f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e57ae0d95b594d8c8dd77d1e380a6825'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.894695 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1047/2107] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:28.896117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b6a88-b3e9-4573-8a73-31d456a4e98d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:28.898506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6711d959-c812-4a9d-9355-8f8a98bf74f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e57ae0d95b594d8c8dd77d1e380a6825'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.900807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6711d959-c812-4a9d-9355-8f8a98bf74f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e57ae0d95b594d8c8dd77d1e380a6825'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.912992 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b6a88-b3e9-4573-8a73-31d456a4e98d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:28.923303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8acc23-3f29-4668-96b8-a1ca19e66a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:28.925823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8acc23-3f29-4668-96b8-a1ca19e66a53 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:28.926439 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8acc23-3f29-4668-96b8-a1ca19e66a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:28.927016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8acc23-3f29-4668-96b8-a1ca19e66a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:28.930946 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8acc23-3f29-4668-96b8-a1ca19e66a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:28.935270 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8acc23-3f29-4668-96b8-a1ca19e66a53 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:28.937110 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1061/2108] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:28 2022] DELETE /identity/v3/users/e57ae0d95b594d8c8dd77d1e380a6825 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:29.002665 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1048/2109] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:28 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:29.004534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711d959-c812-4a9d-9355-8f8a98bf74f4 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:29.007522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6711d959-c812-4a9d-9355-8f8a98bf74f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:29.127387 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:29.240584 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711d959-c812-4a9d-9355-8f8a98bf74f4 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:29.473390 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe5231-4992-4302-af0f-1e07334374d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:29.475688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe5231-4992-4302-af0f-1e07334374d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:29.476185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe5231-4992-4302-af0f-1e07334374d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:29.479019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe5231-4992-4302-af0f-1e07334374d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:29.481898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe5231-4992-4302-af0f-1e07334374d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:29.487952 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe5231-4992-4302-af0f-1e07334374d8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:29.530760 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1062/2110] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:29 2022] POST /identity/v3/users => generated 293 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:29.534461 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8acc23-3f29-4668-96b8-a1ca19e66a53 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:29.556338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8acc23-3f29-4668-96b8-a1ca19e66a53 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:29.573898 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7e390-64bc-42c4-bb50-2114b453c212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:29.581954 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7e390-64bc-42c4-bb50-2114b453c212 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:29.581954 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7e390-64bc-42c4-bb50-2114b453c212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:29.581954 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7e390-64bc-42c4-bb50-2114b453c212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:29.581954 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7e390-64bc-42c4-bb50-2114b453c212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:29.584179 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7e390-64bc-42c4-bb50-2114b453c212 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:29.606586 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe5231-4992-4302-af0f-1e07334374d8 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:29.607368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1049/2111] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:32:29.619277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7e390-64bc-42c4-bb50-2114b453c212 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:29.624340 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe5231-4992-4302-af0f-1e07334374d8 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:29.626274 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e7c7e390-64bc-42c4-bb50-2114b453c212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:29.659174 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8643d82-db91-4717-a78c-8b2cfc3a588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:29.667736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8643d82-db91-4717-a78c-8b2cfc3a588f admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:29.667736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8643d82-db91-4717-a78c-8b2cfc3a588f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:29.667736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8643d82-db91-4717-a78c-8b2cfc3a588f admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:29.667736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8643d82-db91-4717-a78c-8b2cfc3a588f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:29.673284 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8643d82-db91-4717-a78c-8b2cfc3a588f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:29.690368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7e390-64bc-42c4-bb50-2114b453c212 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:29.704467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80798d35-e61d-40b2-a171-f72b721675fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:29.705226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80798d35-e61d-40b2-a171-f72b721675fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:29.705657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80798d35-e61d-40b2-a171-f72b721675fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:29.706812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80798d35-e61d-40b2-a171-f72b721675fb admin admin] PATH_INFO: `/v3/projects/e7cfa66817104c3b942a9c202ea9a79d` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:29.710143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80798d35-e61d-40b2-a171-f72b721675fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7cfa66817104c3b942a9c202ea9a79d)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:29.717772 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1063/2112] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:29.718803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8643d82-db91-4717-a78c-8b2cfc3a588f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:29.719960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80798d35-e61d-40b2-a171-f72b721675fb admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:29.742494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8643d82-db91-4717-a78c-8b2cfc3a588f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:29.761237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:29.765070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f36b2-56fc-48a4-b3cc-9c4fd78c5377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:29.769136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f36b2-56fc-48a4-b3cc-9c4fd78c5377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:29.772031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f36b2-56fc-48a4-b3cc-9c4fd78c5377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:29.774255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f36b2-56fc-48a4-b3cc-9c4fd78c5377 admin admin] PATH_INFO: `/v3/projects/092a8ec21546435b81bb1be36658a337/users/7e00c9346e054aa093ac25f6a896cd63/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:29.801517 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f36b2-56fc-48a4-b3cc-9c4fd78c5377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=092a8ec21546435b81bb1be36658a337, user_id=7e00c9346e054aa093ac25f6a896cd63, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:29.803722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-80798d35-e61d-40b2-a171-f72b721675fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7cfa66817104c3b942a9c202ea9a79d', 'request_id': 'req-80798d35-e61d-40b2-a171-f72b721675fb'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:29.805030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f36b2-56fc-48a4-b3cc-9c4fd78c5377 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:29.814634 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-80798d35-e61d-40b2-a171-f72b721675fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7cfa66817104c3b942a9c202ea9a79d', 'request_id': 'req-80798d35-e61d-40b2-a171-f72b721675fb'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:29.826508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-80798d35-e61d-40b2-a171-f72b721675fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7cfa66817104c3b942a9c202ea9a79d', 'request_id': 'req-80798d35-e61d-40b2-a171-f72b721675fb'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:29.863466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-80798d35-e61d-40b2-a171-f72b721675fb admin admin] The token cache is being invalidate because project e7cfa66817104c3b942a9c202ea9a79d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:29.864136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-80798d35-e61d-40b2-a171-f72b721675fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:29.865511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-80798d35-e61d-40b2-a171-f72b721675fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:29.875255 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1050/2114] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:29 2022] DELETE /identity/v3/projects/e7cfa66817104c3b942a9c202ea9a79d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:29.875459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1064/2114] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:29 2022] PUT /identity/v3/projects/092a8ec21546435b81bb1be36658a337/users/7e00c9346e054aa093ac25f6a896cd63/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:29.889336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1499af3-5230-41fc-afb2-71e1aaa9b121 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:29.889600 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a1115-7b4b-4142-8efd-5c14cf09aae7 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:29.890000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a1115-7b4b-4142-8efd-5c14cf09aae7 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:29.890180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a1115-7b4b-4142-8efd-5c14cf09aae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:29.893295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1499af3-5230-41fc-afb2-71e1aaa9b121 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:29.893609 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1499af3-5230-41fc-afb2-71e1aaa9b121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:29.930609 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d1499af3-5230-41fc-afb2-71e1aaa9b121 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:29.933248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d1499af3-5230-41fc-afb2-71e1aaa9b121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:29.955202 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-722a1115-7b4b-4142-8efd-5c14cf09aae7 None None] MFA Rules not processed for user `7e00c9346e054aa093ac25f6a896cd63`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:29.955202 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-722a1115-7b4b-4142-8efd-5c14cf09aae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:30.176488 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1051/2115] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:30.184297 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a3a72-c3ee-405f-8a64-66df66191bd6 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:30.184960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a3a72-c3ee-405f-8a64-66df66191bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:30.185971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a3a72-c3ee-405f-8a64-66df66191bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:30.224819 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ff0a3a72-c3ee-405f-8a64-66df66191bd6 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:30.228649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ff0a3a72-c3ee-405f-8a64-66df66191bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:30.244950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1052/2116] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:30.251208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a3a72-c3ee-405f-8a64-66df66191bd6 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:30.255243 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1065/2117] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:30.266633 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a1115-7b4b-4142-8efd-5c14cf09aae7 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:30.272790 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-722a1115-7b4b-4142-8efd-5c14cf09aae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:30.283543 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a3a72-c3ee-405f-8a64-66df66191bd6 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:30.304260 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc72116-184b-4f6a-a578-2684cbcf66d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:30.305421 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc72116-184b-4f6a-a578-2684cbcf66d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:30.306053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc72116-184b-4f6a-a578-2684cbcf66d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:30.306613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc72116-184b-4f6a-a578-2684cbcf66d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:30.307873 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc72116-184b-4f6a-a578-2684cbcf66d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:30.308344 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc72116-184b-4f6a-a578-2684cbcf66d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:30.310944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc72116-184b-4f6a-a578-2684cbcf66d0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:30.338512 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1053/2118] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:30.338512 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc72116-184b-4f6a-a578-2684cbcf66d0 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:30.357608 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a1115-7b4b-4142-8efd-5c14cf09aae7 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:30.373961 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3afd89-007b-4e3c-898b-3ec25b37ee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:30.375091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3afd89-007b-4e3c-898b-3ec25b37ee52 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:30.375477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3afd89-007b-4e3c-898b-3ec25b37ee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:30.375850 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3afd89-007b-4e3c-898b-3ec25b37ee52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:30.376878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3afd89-007b-4e3c-898b-3ec25b37ee52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:30.380723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3afd89-007b-4e3c-898b-3ec25b37ee52 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:30.382092 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc72116-184b-4f6a-a578-2684cbcf66d0 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:30.395610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb18514-38a0-4ba2-ab3f-62770ffc26fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:30.397488 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb18514-38a0-4ba2-ab3f-62770ffc26fc admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:30.399632 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb18514-38a0-4ba2-ab3f-62770ffc26fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:30.402032 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb18514-38a0-4ba2-ab3f-62770ffc26fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:30.403964 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb18514-38a0-4ba2-ab3f-62770ffc26fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:30.409828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb18514-38a0-4ba2-ab3f-62770ffc26fc admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:30.434108 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:30.454096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1066/2119] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:30 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:30.455894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3afd89-007b-4e3c-898b-3ec25b37ee52 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:30.497482 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1054/2120] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:30 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:30.500310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb18514-38a0-4ba2-ab3f-62770ffc26fc admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:30.670358 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb18514-38a0-4ba2-ab3f-62770ffc26fc admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:30.687684 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3afd89-007b-4e3c-898b-3ec25b37ee52 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:30.700324 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca1e0b-b436-4db0-9c3d-cb3eb017ac88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:30.703030 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca1e0b-b436-4db0-9c3d-cb3eb017ac88 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:30.703395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca1e0b-b436-4db0-9c3d-cb3eb017ac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:30.704771 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca1e0b-b436-4db0-9c3d-cb3eb017ac88 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:30.711239 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca1e0b-b436-4db0-9c3d-cb3eb017ac88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:30.716100 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492571b-cde2-4c61-abc6-61e1f5f05845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:30.721135 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492571b-cde2-4c61-abc6-61e1f5f05845 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:30.724559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492571b-cde2-4c61-abc6-61e1f5f05845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:30.725255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492571b-cde2-4c61-abc6-61e1f5f05845 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:30.727395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca1e0b-b436-4db0-9c3d-cb3eb017ac88 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:30.731983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492571b-cde2-4c61-abc6-61e1f5f05845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:30.744637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492571b-cde2-4c61-abc6-61e1f5f05845 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:30.772813 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:30.808231 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1055/2121] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:30 2022] POST /identity/v3/users => generated 292 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:30.810007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca1e0b-b436-4db0-9c3d-cb3eb017ac88 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:30.848981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca1e0b-b436-4db0-9c3d-cb3eb017ac88 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:30.864419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1067/2122] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:30 2022] POST /identity/v3/users => generated 293 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:30.877611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492571b-cde2-4c61-abc6-61e1f5f05845 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:30.899266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9662e-e39e-49e9-8d82-225f37f82451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:30.900488 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9662e-e39e-49e9-8d82-225f37f82451 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:30.901181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9662e-e39e-49e9-8d82-225f37f82451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:30.902713 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9662e-e39e-49e9-8d82-225f37f82451 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:30.904079 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9662e-e39e-49e9-8d82-225f37f82451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:30.910587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9662e-e39e-49e9-8d82-225f37f82451 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:30.922341 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492571b-cde2-4c61-abc6-61e1f5f05845 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:30.934791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ece62-c03a-4e23-8cd2-facfdf057e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:30.936713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ece62-c03a-4e23-8cd2-facfdf057e34 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:30.937122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ece62-c03a-4e23-8cd2-facfdf057e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:30.938762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ece62-c03a-4e23-8cd2-facfdf057e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:30.941104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ece62-c03a-4e23-8cd2-facfdf057e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:30.943041 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ece62-c03a-4e23-8cd2-facfdf057e34 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:30.959596 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1056/2123] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:32:30.961446 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1068/2124] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:30.969028 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ece62-c03a-4e23-8cd2-facfdf057e34 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:30.969834 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9662e-e39e-49e9-8d82-225f37f82451 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:30.992775 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9662e-e39e-49e9-8d82-225f37f82451 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:30.995687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ece62-c03a-4e23-8cd2-facfdf057e34 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:31.011935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16d612-d1fd-433a-b1d6-1d08db7d9390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:31.012827 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6014ad-1d5d-43d5-9fb1-0efa6524dd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:31.013458 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16d612-d1fd-433a-b1d6-1d08db7d9390 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:31.014234 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6014ad-1d5d-43d5-9fb1-0efa6524dd4e admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:31.014648 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16d612-d1fd-433a-b1d6-1d08db7d9390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:31.014812 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6014ad-1d5d-43d5-9fb1-0efa6524dd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:31.015124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6014ad-1d5d-43d5-9fb1-0efa6524dd4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:31.015433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16d612-d1fd-433a-b1d6-1d08db7d9390 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:31.016665 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16d612-d1fd-433a-b1d6-1d08db7d9390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:31.017066 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6014ad-1d5d-43d5-9fb1-0efa6524dd4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:31.018930 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6014ad-1d5d-43d5-9fb1-0efa6524dd4e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:31.022571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16d612-d1fd-433a-b1d6-1d08db7d9390 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:31.075130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1069/2126] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:31.078710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6014ad-1d5d-43d5-9fb1-0efa6524dd4e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:31.089526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1057/2126] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:31.092360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16d612-d1fd-433a-b1d6-1d08db7d9390 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:31.104729 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6014ad-1d5d-43d5-9fb1-0efa6524dd4e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:31.125711 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782b4ec-b421-4c94-8c43-076d47098d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:31.127281 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782b4ec-b421-4c94-8c43-076d47098d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:31.127847 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782b4ec-b421-4c94-8c43-076d47098d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:31.128886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782b4ec-b421-4c94-8c43-076d47098d75 admin admin] PATH_INFO: `/v3/projects/ec597d1b43bf412f8de657e8748b869a/users/a384408f8bba4df9adfaf24e2a13757c/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:31.143993 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16d612-d1fd-433a-b1d6-1d08db7d9390 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:31.160479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995367c1-d1c9-4313-b681-11ef3c816e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:31.163058 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995367c1-d1c9-4313-b681-11ef3c816e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:31.163370 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995367c1-d1c9-4313-b681-11ef3c816e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:31.163660 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995367c1-d1c9-4313-b681-11ef3c816e03 admin admin] PATH_INFO: `/v3/projects/ff3eaa088ad44db68a15ec7bbcfce42a/users/9faa214c764f43f39f4abe791ecb71da/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:31.174330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782b4ec-b421-4c94-8c43-076d47098d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec597d1b43bf412f8de657e8748b869a, user_id=a384408f8bba4df9adfaf24e2a13757c, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:31.179490 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782b4ec-b421-4c94-8c43-076d47098d75 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:31.210928 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995367c1-d1c9-4313-b681-11ef3c816e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff3eaa088ad44db68a15ec7bbcfce42a, user_id=9faa214c764f43f39f4abe791ecb71da, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:31.216507 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1070/2127] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:31 2022] PUT /identity/v3/projects/ec597d1b43bf412f8de657e8748b869a/users/a384408f8bba4df9adfaf24e2a13757c/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:31.219530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995367c1-d1c9-4313-b681-11ef3c816e03 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:31.238415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c37e92-00ba-4a78-afaa-599c59768dd1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:31.240408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c37e92-00ba-4a78-afaa-599c59768dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:31.241147 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c37e92-00ba-4a78-afaa-599c59768dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:31.270253 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1058/2128] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:31 2022] PUT /identity/v3/projects/ff3eaa088ad44db68a15ec7bbcfce42a/users/9faa214c764f43f39f4abe791ecb71da/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:31.284652 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0255c-b158-40e6-b62c-6e74ecee088a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:31.284979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0255c-b158-40e6-b62c-6e74ecee088a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:31.285218 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0255c-b158-40e6-b62c-6e74ecee088a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:31.352804 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-9fb0255c-b158-40e6-b62c-6e74ecee088a None None] MFA Rules not processed for user `9faa214c764f43f39f4abe791ecb71da`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:31.354465 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9fb0255c-b158-40e6-b62c-6e74ecee088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:31.371329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-69c37e92-00ba-4a78-afaa-599c59768dd1 None None] MFA Rules not processed for user `a384408f8bba4df9adfaf24e2a13757c`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:31.374517 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-69c37e92-00ba-4a78-afaa-599c59768dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:31.533939 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1059/2129] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:31.540402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0255c-b158-40e6-b62c-6e74ecee088a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:31.570947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1071/2130] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:31.590637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c37e92-00ba-4a78-afaa-599c59768dd1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:31.592769 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-69c37e92-00ba-4a78-afaa-599c59768dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:31.654137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0255c-b158-40e6-b62c-6e74ecee088a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:31.660503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc012ba6-8f28-4839-af22-f1b83dc64425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:31.661546 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc012ba6-8f28-4839-af22-f1b83dc64425 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:31.661748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc012ba6-8f28-4839-af22-f1b83dc64425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:31.662334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc012ba6-8f28-4839-af22-f1b83dc64425 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:31.662905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc012ba6-8f28-4839-af22-f1b83dc64425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:31.663177 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:31.665049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc012ba6-8f28-4839-af22-f1b83dc64425 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:31.714976 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1060/2131] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:31 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:31.721845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc012ba6-8f28-4839-af22-f1b83dc64425 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:31.740373 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c37e92-00ba-4a78-afaa-599c59768dd1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:31.779843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:31.908685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc012ba6-8f28-4839-af22-f1b83dc64425 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:31.913119 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ed771-6f5e-4983-8594-9f7f5f9c19b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:31.914655 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed771-6f5e-4983-8594-9f7f5f9c19b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:31.915247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed771-6f5e-4983-8594-9f7f5f9c19b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:31.916022 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed771-6f5e-4983-8594-9f7f5f9c19b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:31.925556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2679be-15fa-4b30-b0cd-0b9bb3d5a93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:31.926794 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2679be-15fa-4b30-b0cd-0b9bb3d5a93e admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:31.927234 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2679be-15fa-4b30-b0cd-0b9bb3d5a93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:31.927702 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2679be-15fa-4b30-b0cd-0b9bb3d5a93e admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:31.928857 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2679be-15fa-4b30-b0cd-0b9bb3d5a93e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:31.932697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2679be-15fa-4b30-b0cd-0b9bb3d5a93e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:32.005442 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1061/2132] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:31 2022] POST /identity/v3/users => generated 298 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:32.015492 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2679be-15fa-4b30-b0cd-0b9bb3d5a93e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:32.043446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2679be-15fa-4b30-b0cd-0b9bb3d5a93e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:32.061991 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed8e57-9be0-4fac-a6c8-174fa6553444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:32.067342 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed8e57-9be0-4fac-a6c8-174fa6553444 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:32.067641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed8e57-9be0-4fac-a6c8-174fa6553444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:32.068024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed8e57-9be0-4fac-a6c8-174fa6553444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:32.068880 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed8e57-9be0-4fac-a6c8-174fa6553444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:32.078482 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed8e57-9be0-4fac-a6c8-174fa6553444 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:32.093747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1062/2133] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:32.094971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed8e57-9be0-4fac-a6c8-174fa6553444 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:32.097112 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-efed8e57-9be0-4fac-a6c8-174fa6553444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:32.106349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ed771-6f5e-4983-8594-9f7f5f9c19b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:32.109314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ed771-6f5e-4983-8594-9f7f5f9c19b4 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:32.117954 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed8e57-9be0-4fac-a6c8-174fa6553444 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:32.131711 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ecf1b-72dd-4390-bf6a-38784a07a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:32.132924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1072/2134] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:32:32.133773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ed771-6f5e-4983-8594-9f7f5f9c19b4 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:32.145429 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ecf1b-72dd-4390-bf6a-38784a07a170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:32.145742 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ecf1b-72dd-4390-bf6a-38784a07a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:32.146101 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ecf1b-72dd-4390-bf6a-38784a07a170 admin admin] PATH_INFO: `/v3/users/89e467e19a2845078516cc4b58211b7f` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:32.155703 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ed771-6f5e-4983-8594-9f7f5f9c19b4 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:32.158323 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ecf1b-72dd-4390-bf6a-38784a07a170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89e467e19a2845078516cc4b58211b7f)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:32.162909 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6e051-7a05-4207-bc96-04e521909ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:32.163779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6e051-7a05-4207-bc96-04e521909ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:32.164278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6e051-7a05-4207-bc96-04e521909ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:32.164836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6e051-7a05-4207-bc96-04e521909ab3 admin admin] PATH_INFO: `/v3/projects/0d991e7b9e394e9fa66618839c797f83/users/6c5fbd7bf17944c3850dfcef99c97f2c/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:32.167806 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ecf1b-72dd-4390-bf6a-38784a07a170 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:32.202241 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6e051-7a05-4207-bc96-04e521909ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d991e7b9e394e9fa66618839c797f83, user_id=6c5fbd7bf17944c3850dfcef99c97f2c, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:32.209195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6e051-7a05-4207-bc96-04e521909ab3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:32.250596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1073/2135] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:32 2022] PUT /identity/v3/projects/0d991e7b9e394e9fa66618839c797f83/users/6c5fbd7bf17944c3850dfcef99c97f2c/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:32.252065 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6e051-7a05-4207-bc96-04e521909ab3 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:32.344206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2c0ecf1b-72dd-4390-bf6a-38784a07a170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89e467e19a2845078516cc4b58211b7f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:32.393203 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2c0ecf1b-72dd-4390-bf6a-38784a07a170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89e467e19a2845078516cc4b58211b7f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:32.407599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2c0ecf1b-72dd-4390-bf6a-38784a07a170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89e467e19a2845078516cc4b58211b7f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:32.409033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2c0ecf1b-72dd-4390-bf6a-38784a07a170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89e467e19a2845078516cc4b58211b7f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:32.426527 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2c0ecf1b-72dd-4390-bf6a-38784a07a170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89e467e19a2845078516cc4b58211b7f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:32.453878 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1063/2136] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:32 2022] DELETE /identity/v3/users/89e467e19a2845078516cc4b58211b7f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:32.458700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ecf1b-72dd-4390-bf6a-38784a07a170 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:32.472944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2c0ecf1b-72dd-4390-bf6a-38784a07a170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:32.487910 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6e051-7a05-4207-bc96-04e521909ab3 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:32.535969 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:32.626395 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8509f-b49e-4c88-8968-c3f8e7903cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:32.627250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8509f-b49e-4c88-8968-c3f8e7903cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:32.627657 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8509f-b49e-4c88-8968-c3f8e7903cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:32.627999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8509f-b49e-4c88-8968-c3f8e7903cd8 admin admin] PATH_INFO: `/v3/users/a384408f8bba4df9adfaf24e2a13757c` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:32.629624 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8509f-b49e-4c88-8968-c3f8e7903cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a384408f8bba4df9adfaf24e2a13757c)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:32.636290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8509f-b49e-4c88-8968-c3f8e7903cd8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:32.636751 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ecf1b-72dd-4390-bf6a-38784a07a170 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:32.652530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526ee9f-3675-407d-8b37-65165052343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:32.652530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526ee9f-3675-407d-8b37-65165052343e admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:32.652928 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526ee9f-3675-407d-8b37-65165052343e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:32.653078 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526ee9f-3675-407d-8b37-65165052343e admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:32.660066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526ee9f-3675-407d-8b37-65165052343e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:32.666227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526ee9f-3675-407d-8b37-65165052343e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:32.709481 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1064/2137] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:32.713384 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526ee9f-3675-407d-8b37-65165052343e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:32.716913 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7526ee9f-3675-407d-8b37-65165052343e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:32.749601 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526ee9f-3675-407d-8b37-65165052343e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:32.762629 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b21a0e-6059-4784-a167-43ed0e4e59d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:32.764499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b21a0e-6059-4784-a167-43ed0e4e59d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:32.764887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b21a0e-6059-4784-a167-43ed0e4e59d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:32.766346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b21a0e-6059-4784-a167-43ed0e4e59d2 admin admin] PATH_INFO: `/v3/users/0403aec8d6e94946b9b6ee6c9682d93e` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:32.769011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b21a0e-6059-4784-a167-43ed0e4e59d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0403aec8d6e94946b9b6ee6c9682d93e)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:32.774141 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b21a0e-6059-4784-a167-43ed0e4e59d2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:32.779946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3bd8509f-b49e-4c88-8968-c3f8e7903cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a384408f8bba4df9adfaf24e2a13757c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:32.780743 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:32.795134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3bd8509f-b49e-4c88-8968-c3f8e7903cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a384408f8bba4df9adfaf24e2a13757c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:32.819348 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3bd8509f-b49e-4c88-8968-c3f8e7903cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a384408f8bba4df9adfaf24e2a13757c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:32.822193 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3bd8509f-b49e-4c88-8968-c3f8e7903cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a384408f8bba4df9adfaf24e2a13757c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:32.825264 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3bd8509f-b49e-4c88-8968-c3f8e7903cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a384408f8bba4df9adfaf24e2a13757c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:32.863020 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1074/2138] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:32 2022] DELETE /identity/v3/users/a384408f8bba4df9adfaf24e2a13757c => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:32.866826 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec3202-d5cf-409d-92b0-7f852bb65dc8 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:32.868736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec3202-d5cf-409d-92b0-7f852bb65dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:32.868736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec3202-d5cf-409d-92b0-7f852bb65dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:32.925652 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-0eec3202-d5cf-409d-92b0-7f852bb65dc8 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:32.928556 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0eec3202-d5cf-409d-92b0-7f852bb65dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:32.935967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-07b21a0e-6059-4784-a167-43ed0e4e59d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0403aec8d6e94946b9b6ee6c9682d93e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:32.962186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-07b21a0e-6059-4784-a167-43ed0e4e59d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0403aec8d6e94946b9b6ee6c9682d93e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:32.986744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-07b21a0e-6059-4784-a167-43ed0e4e59d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0403aec8d6e94946b9b6ee6c9682d93e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:32.988224 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-07b21a0e-6059-4784-a167-43ed0e4e59d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0403aec8d6e94946b9b6ee6c9682d93e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:33.000692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-07b21a0e-6059-4784-a167-43ed0e4e59d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0403aec8d6e94946b9b6ee6c9682d93e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:33.013503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1065/2139] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:32 2022] DELETE /identity/v3/users/0403aec8d6e94946b9b6ee6c9682d93e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:33.013503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b21a0e-6059-4784-a167-43ed0e4e59d2 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:33.013503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-07b21a0e-6059-4784-a167-43ed0e4e59d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:33.106753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1075/2140] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:33.108340 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63a8ad-288d-4120-a8d9-834cee58833b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:33.108655 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63a8ad-288d-4120-a8d9-834cee58833b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:33.109161 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63a8ad-288d-4120-a8d9-834cee58833b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:33.140418 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2b63a8ad-288d-4120-a8d9-834cee58833b None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:33.141764 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2b63a8ad-288d-4120-a8d9-834cee58833b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:33.220760 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:33.259664 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b21a0e-6059-4784-a167-43ed0e4e59d2 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:33.261004 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1076/2141] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:33.262154 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63a8ad-288d-4120-a8d9-834cee58833b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:33.264573 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2b63a8ad-288d-4120-a8d9-834cee58833b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:33.274263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b995572-b62f-4992-99d7-2462f025bfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:33.275581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b995572-b62f-4992-99d7-2462f025bfa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:33.276384 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b995572-b62f-4992-99d7-2462f025bfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:33.276737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b995572-b62f-4992-99d7-2462f025bfa5 admin admin] PATH_INFO: `/v3/projects/0d991e7b9e394e9fa66618839c797f83/users/6c5fbd7bf17944c3850dfcef99c97f2c/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:33.280398 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b995572-b62f-4992-99d7-2462f025bfa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d991e7b9e394e9fa66618839c797f83, user_id=6c5fbd7bf17944c3850dfcef99c97f2c, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:33.285959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b995572-b62f-4992-99d7-2462f025bfa5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:33.288192 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63a8ad-288d-4120-a8d9-834cee58833b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:33.296184 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415834c-b583-4e83-8411-1e49cb5616f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:33.297427 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415834c-b583-4e83-8411-1e49cb5616f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:33.297908 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415834c-b583-4e83-8411-1e49cb5616f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:33.298456 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415834c-b583-4e83-8411-1e49cb5616f4 admin admin] PATH_INFO: `/v3/users/2965ddfda61d4ba88eb46c48ab5b1f4e` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:33.300574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415834c-b583-4e83-8411-1e49cb5616f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2965ddfda61d4ba88eb46c48ab5b1f4e)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:33.304278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415834c-b583-4e83-8411-1e49cb5616f4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:33.304883 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1066/2142] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:33 2022] PUT /identity/v3/projects/0d991e7b9e394e9fa66618839c797f83/users/6c5fbd7bf17944c3850dfcef99c97f2c/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:33.307332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eada11-ff05-4134-bf31-646c5af87118 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:33.307861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eada11-ff05-4134-bf31-646c5af87118 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:33.308350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eada11-ff05-4134-bf31-646c5af87118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:33.342729 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-71eada11-ff05-4134-bf31-646c5af87118 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:33.344036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-71eada11-ff05-4134-bf31-646c5af87118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:33.388338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6415834c-b583-4e83-8411-1e49cb5616f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2965ddfda61d4ba88eb46c48ab5b1f4e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:33.400863 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6415834c-b583-4e83-8411-1e49cb5616f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2965ddfda61d4ba88eb46c48ab5b1f4e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:33.420506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6415834c-b583-4e83-8411-1e49cb5616f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2965ddfda61d4ba88eb46c48ab5b1f4e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:33.421471 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6415834c-b583-4e83-8411-1e49cb5616f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2965ddfda61d4ba88eb46c48ab5b1f4e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:33.422490 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6415834c-b583-4e83-8411-1e49cb5616f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2965ddfda61d4ba88eb46c48ab5b1f4e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:33.433869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1067/2143] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:33.434941 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eada11-ff05-4134-bf31-646c5af87118 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:33.436675 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-71eada11-ff05-4134-bf31-646c5af87118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:33.444838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1077/2144] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:33 2022] DELETE /identity/v3/users/2965ddfda61d4ba88eb46c48ab5b1f4e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:33.445615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415834c-b583-4e83-8411-1e49cb5616f4 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:33.447958 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6415834c-b583-4e83-8411-1e49cb5616f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:33.468231 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:33.543512 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eada11-ff05-4134-bf31-646c5af87118 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:33.563773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415834c-b583-4e83-8411-1e49cb5616f4 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:33.568960 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eabd32-f0ab-4788-afa1-8d0fac675a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:33.569632 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eabd32-f0ab-4788-afa1-8d0fac675a81 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:33.569963 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eabd32-f0ab-4788-afa1-8d0fac675a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:33.570231 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eabd32-f0ab-4788-afa1-8d0fac675a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:33.572586 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c8eabd32-f0ab-4788-afa1-8d0fac675a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:33.624789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914818c-562c-42bd-901c-1d89ba807ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:33.625860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914818c-562c-42bd-901c-1d89ba807ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:33.627146 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914818c-562c-42bd-901c-1d89ba807ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:33.627879 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914818c-562c-42bd-901c-1d89ba807ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:33.630920 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3914818c-562c-42bd-901c-1d89ba807ba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:33.655920 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eabd32-f0ab-4788-afa1-8d0fac675a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:33.657417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eabd32-f0ab-4788-afa1-8d0fac675a81 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:33.668191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1078/2145] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:33.669760 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e3dce-1261-4f70-a9e0-5658752f1af6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:33.670043 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e3dce-1261-4f70-a9e0-5658752f1af6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:33.670314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e3dce-1261-4f70-a9e0-5658752f1af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:33.694286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:33.706037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c24e3dce-1261-4f70-a9e0-5658752f1af6 None None] MFA Rules not processed for user `6c5fbd7bf17944c3850dfcef99c97f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:33.708752 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c24e3dce-1261-4f70-a9e0-5658752f1af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:33.724594 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914818c-562c-42bd-901c-1d89ba807ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:33.726290 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914818c-562c-42bd-901c-1d89ba807ba2 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:33.748814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1068/2146] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:33.750521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914818c-562c-42bd-901c-1d89ba807ba2 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:33.772239 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914818c-562c-42bd-901c-1d89ba807ba2 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:33.777941 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0426e-3b66-4735-ab67-9f1aa58f9fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:33.779059 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0426e-3b66-4735-ab67-9f1aa58f9fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:33.779435 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0426e-3b66-4735-ab67-9f1aa58f9fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:33.779893 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0426e-3b66-4735-ab67-9f1aa58f9fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:33.794700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0426e-3b66-4735-ab67-9f1aa58f9fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:33.800649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0426e-3b66-4735-ab67-9f1aa58f9fe3 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:33.809875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1069/2147] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:33.810252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0426e-3b66-4735-ab67-9f1aa58f9fe3 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:33.812538 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-efa0426e-3b66-4735-ab67-9f1aa58f9fe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:33.828032 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0426e-3b66-4735-ab67-9f1aa58f9fe3 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:33.834360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc25b2-d9d2-4259-851b-e4c1596d73fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:33.835545 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc25b2-d9d2-4259-851b-e4c1596d73fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:33.835979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc25b2-d9d2-4259-851b-e4c1596d73fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:33.836603 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc25b2-d9d2-4259-851b-e4c1596d73fa admin admin] PATH_INFO: `/v3/projects/70f25ea6efae49e3bcb70daf1a9baa4c` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:33.838120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1079/2148] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:33.838587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc25b2-d9d2-4259-851b-e4c1596d73fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f25ea6efae49e3bcb70daf1a9baa4c)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:33.840246 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc25b2-d9d2-4259-851b-e4c1596d73fa admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:33.863760 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e3dce-1261-4f70-a9e0-5658752f1af6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:33.866109 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c24e3dce-1261-4f70-a9e0-5658752f1af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:33.907199 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6bdc25b2-d9d2-4259-851b-e4c1596d73fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f25ea6efae49e3bcb70daf1a9baa4c', 'request_id': 'req-6bdc25b2-d9d2-4259-851b-e4c1596d73fa'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:33.918305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6bdc25b2-d9d2-4259-851b-e4c1596d73fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f25ea6efae49e3bcb70daf1a9baa4c', 'request_id': 'req-6bdc25b2-d9d2-4259-851b-e4c1596d73fa'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:33.937649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6bdc25b2-d9d2-4259-851b-e4c1596d73fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f25ea6efae49e3bcb70daf1a9baa4c', 'request_id': 'req-6bdc25b2-d9d2-4259-851b-e4c1596d73fa'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:33.954364 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:33.988613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6bdc25b2-d9d2-4259-851b-e4c1596d73fa admin admin] The token cache is being invalidate because project 70f25ea6efae49e3bcb70daf1a9baa4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:33.989935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6bdc25b2-d9d2-4259-851b-e4c1596d73fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:33.991351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6bdc25b2-d9d2-4259-851b-e4c1596d73fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:33.998313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1070/2149] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:33 2022] DELETE /identity/v3/projects/70f25ea6efae49e3bcb70daf1a9baa4c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:34.000619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61ea49-58d5-455f-8f0e-47fa80908a3c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.002721 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61ea49-58d5-455f-8f0e-47fa80908a3c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.003313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61ea49-58d5-455f-8f0e-47fa80908a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.013435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e3dce-1261-4f70-a9e0-5658752f1af6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:34.089413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ce61ea49-58d5-455f-8f0e-47fa80908a3c None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:34.091158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ce61ea49-58d5-455f-8f0e-47fa80908a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:34.122211 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351dd4f-caf3-488d-ba37-75a8e05975d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:34.123313 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351dd4f-caf3-488d-ba37-75a8e05975d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.123825 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351dd4f-caf3-488d-ba37-75a8e05975d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.124532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351dd4f-caf3-488d-ba37-75a8e05975d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.128067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4351dd4f-caf3-488d-ba37-75a8e05975d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:34.232946 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1071/2150] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:34.246284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ef770-ff7a-4bcb-aa2f-e5f74b8ece2f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.246678 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ef770-ff7a-4bcb-aa2f-e5f74b8ece2f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.247059 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ef770-ff7a-4bcb-aa2f-e5f74b8ece2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.276429 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b22ef770-ff7a-4bcb-aa2f-e5f74b8ece2f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:34.278185 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b22ef770-ff7a-4bcb-aa2f-e5f74b8ece2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:34.282492 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351dd4f-caf3-488d-ba37-75a8e05975d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:34.287000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351dd4f-caf3-488d-ba37-75a8e05975d1 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:34.288611 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1072/2151] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:34.296997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ef770-ff7a-4bcb-aa2f-e5f74b8ece2f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:34.313667 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1080/2152] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:32:34.315583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ef770-ff7a-4bcb-aa2f-e5f74b8ece2f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:34.328025 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4fcfa-bff9-46b2-b083-625cf0937dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:34.329146 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4fcfa-bff9-46b2-b083-625cf0937dae admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.330069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4fcfa-bff9-46b2-b083-625cf0937dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.330670 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4fcfa-bff9-46b2-b083-625cf0937dae admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.332752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4fcfa-bff9-46b2-b083-625cf0937dae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:34.333331 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4fcfa-bff9-46b2-b083-625cf0937dae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:34.339262 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4fcfa-bff9-46b2-b083-625cf0937dae admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:34.372488 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351dd4f-caf3-488d-ba37-75a8e05975d1 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:34.397192 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1073/2153] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:32:34.397610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:34.419538 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351dd4f-caf3-488d-ba37-75a8e05975d1 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:34.427810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cb4ee-0048-412b-a2ea-5d460d02d431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:34.428622 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cb4ee-0048-412b-a2ea-5d460d02d431 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.428902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cb4ee-0048-412b-a2ea-5d460d02d431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.429169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cb4ee-0048-412b-a2ea-5d460d02d431 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.429872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cb4ee-0048-412b-a2ea-5d460d02d431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:34.431987 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cb4ee-0048-412b-a2ea-5d460d02d431 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:34.465681 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4fcfa-bff9-46b2-b083-625cf0937dae admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:34.467875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7fb4fcfa-bff9-46b2-b083-625cf0937dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:34.492261 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1081/2154] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:34 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:34.494878 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4fcfa-bff9-46b2-b083-625cf0937dae admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:34.513129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cb4ee-0048-412b-a2ea-5d460d02d431 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:34.521977 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cb1cb4ee-0048-412b-a2ea-5d460d02d431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:34.648218 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe902d-2858-4aff-9d0d-126479a18206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:34.649904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe902d-2858-4aff-9d0d-126479a18206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.650290 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe902d-2858-4aff-9d0d-126479a18206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.651988 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe902d-2858-4aff-9d0d-126479a18206 admin admin] PATH_INFO: `/v3/projects/e2b438c2ee784906bc9539b3682c40bf` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.652440 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe902d-2858-4aff-9d0d-126479a18206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b438c2ee784906bc9539b3682c40bf)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:34.656114 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe902d-2858-4aff-9d0d-126479a18206 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:34.706907 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cb4ee-0048-412b-a2ea-5d460d02d431 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:34.712914 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7d606-72e3-40c1-9874-4a9bce616cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:34.713871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7d606-72e3-40c1-9874-4a9bce616cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.714051 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7d606-72e3-40c1-9874-4a9bce616cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.714338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7d606-72e3-40c1-9874-4a9bce616cbb admin admin] PATH_INFO: `/v3/projects/842cf9fa3f8149188a99abde64d43a0f` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.716454 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7d606-72e3-40c1-9874-4a9bce616cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=842cf9fa3f8149188a99abde64d43a0f)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:34.718970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7d606-72e3-40c1-9874-4a9bce616cbb admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:34.777474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-39fe902d-2858-4aff-9d0d-126479a18206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b438c2ee784906bc9539b3682c40bf', 'request_id': 'req-39fe902d-2858-4aff-9d0d-126479a18206'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:34.790086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ace7d606-72e3-40c1-9874-4a9bce616cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '842cf9fa3f8149188a99abde64d43a0f', 'request_id': 'req-ace7d606-72e3-40c1-9874-4a9bce616cbb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:34.790310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-39fe902d-2858-4aff-9d0d-126479a18206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b438c2ee784906bc9539b3682c40bf', 'request_id': 'req-39fe902d-2858-4aff-9d0d-126479a18206'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:34.802372 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ace7d606-72e3-40c1-9874-4a9bce616cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '842cf9fa3f8149188a99abde64d43a0f', 'request_id': 'req-ace7d606-72e3-40c1-9874-4a9bce616cbb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:34.803926 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-39fe902d-2858-4aff-9d0d-126479a18206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b438c2ee784906bc9539b3682c40bf', 'request_id': 'req-39fe902d-2858-4aff-9d0d-126479a18206'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:34.817897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ace7d606-72e3-40c1-9874-4a9bce616cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '842cf9fa3f8149188a99abde64d43a0f', 'request_id': 'req-ace7d606-72e3-40c1-9874-4a9bce616cbb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:34.828373 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-39fe902d-2858-4aff-9d0d-126479a18206 admin admin] The token cache is being invalidate because project e2b438c2ee784906bc9539b3682c40bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:34.828820 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-39fe902d-2858-4aff-9d0d-126479a18206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:34.830736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-39fe902d-2858-4aff-9d0d-126479a18206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:34.835151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ace7d606-72e3-40c1-9874-4a9bce616cbb admin admin] The token cache is being invalidate because project 842cf9fa3f8149188a99abde64d43a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:34.835700 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ace7d606-72e3-40c1-9874-4a9bce616cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:34.837979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1074/2155] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:34 2022] DELETE /identity/v3/projects/e2b438c2ee784906bc9539b3682c40bf => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:34.838461 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ace7d606-72e3-40c1-9874-4a9bce616cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:34.839239 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe902d-2858-4aff-9d0d-126479a18206 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:34.841425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1082/2156] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:34 2022] DELETE /identity/v3/projects/842cf9fa3f8149188a99abde64d43a0f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:34.842241 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7d606-72e3-40c1-9874-4a9bce616cbb admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:34.844386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-39fe902d-2858-4aff-9d0d-126479a18206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:34.845573 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ace7d606-72e3-40c1-9874-4a9bce616cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:34.850332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:34.938018 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe902d-2858-4aff-9d0d-126479a18206 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:34.981986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7d606-72e3-40c1-9874-4a9bce616cbb admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:34.991301 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd12cbf-fee8-439d-8754-f9a85daa47f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:34.991531 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd12cbf-fee8-439d-8754-f9a85daa47f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.991662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd12cbf-fee8-439d-8754-f9a85daa47f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.991889 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd12cbf-fee8-439d-8754-f9a85daa47f3 admin admin] PATH_INFO: `/v3/projects/ec597d1b43bf412f8de657e8748b869a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.993874 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd12cbf-fee8-439d-8754-f9a85daa47f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec597d1b43bf412f8de657e8748b869a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:34.996407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd12cbf-fee8-439d-8754-f9a85daa47f3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.017340 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:35.054821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6a159-8d0a-4956-b1a9-5e57856e376c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.055913 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6a159-8d0a-4956-b1a9-5e57856e376c admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.056226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6a159-8d0a-4956-b1a9-5e57856e376c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.056661 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6a159-8d0a-4956-b1a9-5e57856e376c admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.057753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6a159-8d0a-4956-b1a9-5e57856e376c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.061118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6a159-8d0a-4956-b1a9-5e57856e376c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.070185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-dcd12cbf-fee8-439d-8754-f9a85daa47f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec597d1b43bf412f8de657e8748b869a', 'request_id': 'req-dcd12cbf-fee8-439d-8754-f9a85daa47f3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.081188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-dcd12cbf-fee8-439d-8754-f9a85daa47f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec597d1b43bf412f8de657e8748b869a', 'request_id': 'req-dcd12cbf-fee8-439d-8754-f9a85daa47f3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.095046 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1075/2157] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:34 2022] POST /identity/v3/users => generated 295 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:35.097143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def0286-e175-4277-8f38-3274be8dc975 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.097562 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-dcd12cbf-fee8-439d-8754-f9a85daa47f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec597d1b43bf412f8de657e8748b869a', 'request_id': 'req-dcd12cbf-fee8-439d-8754-f9a85daa47f3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.097704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def0286-e175-4277-8f38-3274be8dc975 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.098111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def0286-e175-4277-8f38-3274be8dc975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.119412 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-dcd12cbf-fee8-439d-8754-f9a85daa47f3 admin admin] The token cache is being invalidate because project ec597d1b43bf412f8de657e8748b869a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:35.119865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-dcd12cbf-fee8-439d-8754-f9a85daa47f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.120890 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-dcd12cbf-fee8-439d-8754-f9a85daa47f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.123279 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1083/2158] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:34 2022] DELETE /identity/v3/projects/ec597d1b43bf412f8de657e8748b869a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:35.124541 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd12cbf-fee8-439d-8754-f9a85daa47f3 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.127053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-dcd12cbf-fee8-439d-8754-f9a85daa47f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:35.127254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6def0286-e175-4277-8f38-3274be8dc975 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:35.130156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6def0286-e175-4277-8f38-3274be8dc975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:35.224204 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd12cbf-fee8-439d-8754-f9a85daa47f3 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.233057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ed02b-98ab-45ca-8ece-014a9cbe6b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.234408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ed02b-98ab-45ca-8ece-014a9cbe6b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.234878 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1076/2159] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:35.235063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ed02b-98ab-45ca-8ece-014a9cbe6b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.235364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ed02b-98ab-45ca-8ece-014a9cbe6b25 admin admin] PATH_INFO: `/v3/users/6210e1fa640847cf9ab72f67ffd0346f` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.235887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def0286-e175-4277-8f38-3274be8dc975 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.237439 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6def0286-e175-4277-8f38-3274be8dc975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:35.238107 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ed02b-98ab-45ca-8ece-014a9cbe6b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6210e1fa640847cf9ab72f67ffd0346f)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.241964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ed02b-98ab-45ca-8ece-014a9cbe6b25 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.251144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def0286-e175-4277-8f38-3274be8dc975 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.256862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab60ad-e32c-41d8-966e-c999ddba1b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.257519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab60ad-e32c-41d8-966e-c999ddba1b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.257799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab60ad-e32c-41d8-966e-c999ddba1b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.258074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab60ad-e32c-41d8-966e-c999ddba1b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.259166 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab60ad-e32c-41d8-966e-c999ddba1b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.261018 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab60ad-e32c-41d8-966e-c999ddba1b5f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.279472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1077/2160] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:35.279472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00198bcd-7c88-414d-a01c-cc404ec27c87 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.279472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00198bcd-7c88-414d-a01c-cc404ec27c87 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.279472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00198bcd-7c88-414d-a01c-cc404ec27c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.305173 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-00198bcd-7c88-414d-a01c-cc404ec27c87 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:35.306773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-00198bcd-7c88-414d-a01c-cc404ec27c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:35.316935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1078/2161] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:35.319029 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543ce4-b383-46b6-8036-e4a3e6547987 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.319527 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543ce4-b383-46b6-8036-e4a3e6547987 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.319963 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543ce4-b383-46b6-8036-e4a3e6547987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.335218 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-001ed02b-98ab-45ca-8ece-014a9cbe6b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6210e1fa640847cf9ab72f67ffd0346f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.352294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-38543ce4-b383-46b6-8036-e4a3e6547987 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:35.352567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-001ed02b-98ab-45ca-8ece-014a9cbe6b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6210e1fa640847cf9ab72f67ffd0346f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.354523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-38543ce4-b383-46b6-8036-e4a3e6547987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:35.367700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1079/2162] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:35.373691 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38543ce4-b383-46b6-8036-e4a3e6547987 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.378400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-001ed02b-98ab-45ca-8ece-014a9cbe6b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6210e1fa640847cf9ab72f67ffd0346f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.379588 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-001ed02b-98ab-45ca-8ece-014a9cbe6b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6210e1fa640847cf9ab72f67ffd0346f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.380525 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-001ed02b-98ab-45ca-8ece-014a9cbe6b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6210e1fa640847cf9ab72f67ffd0346f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.382996 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38543ce4-b383-46b6-8036-e4a3e6547987 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.389633 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb31ae-cee5-42d4-be56-51ae7c8136a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.390533 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb31ae-cee5-42d4-be56-51ae7c8136a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.394937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb31ae-cee5-42d4-be56-51ae7c8136a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.394937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb31ae-cee5-42d4-be56-51ae7c8136a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.394937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb31ae-cee5-42d4-be56-51ae7c8136a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.394937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb31ae-cee5-42d4-be56-51ae7c8136a6 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.414089 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1080/2163] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:35.414361 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1084/2164] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:35 2022] DELETE /identity/v3/users/6210e1fa640847cf9ab72f67ffd0346f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:35.414520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fa4ba-c3ac-429f-b158-c67cf2fee91a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.414520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fa4ba-c3ac-429f-b158-c67cf2fee91a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.414520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fa4ba-c3ac-429f-b158-c67cf2fee91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.414971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ed02b-98ab-45ca-8ece-014a9cbe6b25 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.419726 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-001ed02b-98ab-45ca-8ece-014a9cbe6b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:35.425060 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:35.448721 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-828fa4ba-c3ac-429f-b158-c67cf2fee91a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:35.450300 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-828fa4ba-c3ac-429f-b158-c67cf2fee91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:35.466891 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:35.524264 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ed02b-98ab-45ca-8ece-014a9cbe6b25 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.529731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bcb9a-45c0-4016-b523-e0b36e029ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.530704 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bcb9a-45c0-4016-b523-e0b36e029ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.530704 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bcb9a-45c0-4016-b523-e0b36e029ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.530972 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bcb9a-45c0-4016-b523-e0b36e029ef5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.532160 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bcb9a-45c0-4016-b523-e0b36e029ef5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:35.532286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bcb9a-45c0-4016-b523-e0b36e029ef5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.534799 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bcb9a-45c0-4016-b523-e0b36e029ef5 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.556255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1085/2165] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:35.556255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bcb9a-45c0-4016-b523-e0b36e029ef5 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.558540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-813bcb9a-45c0-4016-b523-e0b36e029ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:35.575516 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1081/2166] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:35.575516 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fa4ba-c3ac-429f-b158-c67cf2fee91a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.579125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bcb9a-45c0-4016-b523-e0b36e029ef5 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.585563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8605e10-3026-46ce-a478-412a63633070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.586451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8605e10-3026-46ce-a478-412a63633070 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.586877 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8605e10-3026-46ce-a478-412a63633070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.587250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8605e10-3026-46ce-a478-412a63633070 admin admin] PATH_INFO: `/v3/projects/9906f5bb9cbe468bae0cdbf351832c3a/users/3340cc123b0d4ff089889b133b32815e/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.588958 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fa4ba-c3ac-429f-b158-c67cf2fee91a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.596381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73746ce5-924a-4440-a050-5b84a5057807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.597284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73746ce5-924a-4440-a050-5b84a5057807 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.598279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73746ce5-924a-4440-a050-5b84a5057807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.598279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73746ce5-924a-4440-a050-5b84a5057807 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.599453 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73746ce5-924a-4440-a050-5b84a5057807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.602366 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73746ce5-924a-4440-a050-5b84a5057807 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.607915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8605e10-3026-46ce-a478-412a63633070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9906f5bb9cbe468bae0cdbf351832c3a, user_id=3340cc123b0d4ff089889b133b32815e, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.612738 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8605e10-3026-46ce-a478-412a63633070 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.632500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1086/2167] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:35 2022] PUT /identity/v3/projects/9906f5bb9cbe468bae0cdbf351832c3a/users/3340cc123b0d4ff089889b133b32815e/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:35.633664 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8605e10-3026-46ce-a478-412a63633070 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.664281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1082/2168] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:35 2022] POST /identity/v3/projects => generated 363 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:35.664281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c9e05-f57c-401a-a129-d842c32b952f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.664281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c9e05-f57c-401a-a129-d842c32b952f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.664281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c9e05-f57c-401a-a129-d842c32b952f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.686924 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ce6c9e05-f57c-401a-a129-d842c32b952f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:35.688219 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ce6c9e05-f57c-401a-a129-d842c32b952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:35.794190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8605e10-3026-46ce-a478-412a63633070 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.795106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1083/2169] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:35.799125 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c9e05-f57c-401a-a129-d842c32b952f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.802287 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097fa46-92e2-4deb-b656-aa48f6b5efae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.803584 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097fa46-92e2-4deb-b656-aa48f6b5efae admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.804165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097fa46-92e2-4deb-b656-aa48f6b5efae admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.804751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097fa46-92e2-4deb-b656-aa48f6b5efae admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.806670 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097fa46-92e2-4deb-b656-aa48f6b5efae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:35.807328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097fa46-92e2-4deb-b656-aa48f6b5efae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.810435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097fa46-92e2-4deb-b656-aa48f6b5efae admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.817246 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c9e05-f57c-401a-a129-d842c32b952f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.824084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88051463-6bdc-4454-a387-0d3624d71cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.824762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88051463-6bdc-4454-a387-0d3624d71cca admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.827431 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88051463-6bdc-4454-a387-0d3624d71cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.827767 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88051463-6bdc-4454-a387-0d3624d71cca admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.828873 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88051463-6bdc-4454-a387-0d3624d71cca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.831610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88051463-6bdc-4454-a387-0d3624d71cca admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.834146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1087/2170] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:35.836682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097fa46-92e2-4deb-b656-aa48f6b5efae admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.839691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0097fa46-92e2-4deb-b656-aa48f6b5efae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:35.872097 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1084/2171] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:35 2022] POST /identity/v3/users => generated 282 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:35.873271 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88051463-6bdc-4454-a387-0d3624d71cca admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.900284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88051463-6bdc-4454-a387-0d3624d71cca admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.908145 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57096a-ff77-498b-b90d-96116f63a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.909325 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57096a-ff77-498b-b90d-96116f63a720 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.909531 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57096a-ff77-498b-b90d-96116f63a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.911636 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57096a-ff77-498b-b90d-96116f63a720 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.911636 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57096a-ff77-498b-b90d-96116f63a720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.914341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57096a-ff77-498b-b90d-96116f63a720 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.944253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097fa46-92e2-4deb-b656-aa48f6b5efae admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.949433 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562de9e3-5a2f-4d25-a751-d52a343a7bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.950254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562de9e3-5a2f-4d25-a751-d52a343a7bfa service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.950630 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562de9e3-5a2f-4d25-a751-d52a343a7bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.951022 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562de9e3-5a2f-4d25-a751-d52a343a7bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.958328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1085/2172] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:35 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:35.959226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57096a-ff77-498b-b90d-96116f63a720 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.967493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562de9e3-5a2f-4d25-a751-d52a343a7bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.969716 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562de9e3-5a2f-4d25-a751-d52a343a7bfa service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.981903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1088/2173] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:35.982972 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562de9e3-5a2f-4d25-a751-d52a343a7bfa service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.997043 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562de9e3-5a2f-4d25-a751-d52a343a7bfa service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.049784 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:36.074079 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:36.112996 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57096a-ff77-498b-b90d-96116f63a720 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.119656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4b7c4-e65a-4e42-873b-2a28562f8237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.120409 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4b7c4-e65a-4e42-873b-2a28562f8237 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.120690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4b7c4-e65a-4e42-873b-2a28562f8237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.120956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4b7c4-e65a-4e42-873b-2a28562f8237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.121947 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4b7c4-e65a-4e42-873b-2a28562f8237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.124118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4b7c4-e65a-4e42-873b-2a28562f8237 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.141742 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1086/2174] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:36.142789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4b7c4-e65a-4e42-873b-2a28562f8237 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.144962 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-62b4b7c4-e65a-4e42-873b-2a28562f8237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:36.154508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2510bc9-cb16-401d-8bbf-dee448cb6606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.155408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2510bc9-cb16-401d-8bbf-dee448cb6606 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.155929 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2510bc9-cb16-401d-8bbf-dee448cb6606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.156479 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2510bc9-cb16-401d-8bbf-dee448cb6606 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.159367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2510bc9-cb16-401d-8bbf-dee448cb6606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.166966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2510bc9-cb16-401d-8bbf-dee448cb6606 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.167497 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4b7c4-e65a-4e42-873b-2a28562f8237 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.182533 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fcade-ef24-401d-b65b-ee7e87238da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.185158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fcade-ef24-401d-b65b-ee7e87238da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.187853 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fcade-ef24-401d-b65b-ee7e87238da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.188366 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fcade-ef24-401d-b65b-ee7e87238da3 admin admin] PATH_INFO: `/v3/projects/8bf9e6053a194af8a1f0593c5372d72c` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.192866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736fcade-ef24-401d-b65b-ee7e87238da3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf9e6053a194af8a1f0593c5372d72c)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.195225 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736fcade-ef24-401d-b65b-ee7e87238da3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.214361 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1089/2175] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:35 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:36.215126 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2510bc9-cb16-401d-8bbf-dee448cb6606 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.240107 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2510bc9-cb16-401d-8bbf-dee448cb6606 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.253637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59460a72-375b-4dde-8e07-27163d1e7c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.254621 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59460a72-375b-4dde-8e07-27163d1e7c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.254854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59460a72-375b-4dde-8e07-27163d1e7c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.255377 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59460a72-375b-4dde-8e07-27163d1e7c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.256389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59460a72-375b-4dde-8e07-27163d1e7c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.259417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59460a72-375b-4dde-8e07-27163d1e7c4c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.281663 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1090/2176] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:36.281663 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59460a72-375b-4dde-8e07-27163d1e7c4c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.302062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-736fcade-ef24-401d-b65b-ee7e87238da3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf9e6053a194af8a1f0593c5372d72c', 'request_id': 'req-736fcade-ef24-401d-b65b-ee7e87238da3'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:36.304455 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59460a72-375b-4dde-8e07-27163d1e7c4c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.318700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-736fcade-ef24-401d-b65b-ee7e87238da3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf9e6053a194af8a1f0593c5372d72c', 'request_id': 'req-736fcade-ef24-401d-b65b-ee7e87238da3'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:36.344273 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-736fcade-ef24-401d-b65b-ee7e87238da3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf9e6053a194af8a1f0593c5372d72c', 'request_id': 'req-736fcade-ef24-401d-b65b-ee7e87238da3'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:36.376391 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-736fcade-ef24-401d-b65b-ee7e87238da3 admin admin] The token cache is being invalidate because project 8bf9e6053a194af8a1f0593c5372d72c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:36.376850 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-736fcade-ef24-401d-b65b-ee7e87238da3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:36.378784 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-736fcade-ef24-401d-b65b-ee7e87238da3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:36.384985 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1087/2177] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:36 2022] DELETE /identity/v3/projects/8bf9e6053a194af8a1f0593c5372d72c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:36.384985 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fcade-ef24-401d-b65b-ee7e87238da3 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.386857 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-736fcade-ef24-401d-b65b-ee7e87238da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:36.406430 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c35c68-62f7-4967-8f7c-366ef16d1052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.407334 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35c68-62f7-4967-8f7c-366ef16d1052 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.407763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35c68-62f7-4967-8f7c-366ef16d1052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.408225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35c68-62f7-4967-8f7c-366ef16d1052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.409636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c35c68-62f7-4967-8f7c-366ef16d1052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.411688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c35c68-62f7-4967-8f7c-366ef16d1052 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.447076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1091/2178] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:36.450999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c35c68-62f7-4967-8f7c-366ef16d1052 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.459204 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c0c35c68-62f7-4967-8f7c-366ef16d1052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:36.507606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fcade-ef24-401d-b65b-ee7e87238da3 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.513456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d4ad5-7c37-49f6-a001-e471e369e4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.514543 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d4ad5-7c37-49f6-a001-e471e369e4ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.515035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d4ad5-7c37-49f6-a001-e471e369e4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.515449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d4ad5-7c37-49f6-a001-e471e369e4ee admin admin] PATH_INFO: `/v3/projects/9a8418ba06d8494db1e5fad08e9f1ba2/users/a45beb9ce0764169bbe1a27c5e045330/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.536333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d4ad5-7c37-49f6-a001-e471e369e4ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8418ba06d8494db1e5fad08e9f1ba2, user_id=a45beb9ce0764169bbe1a27c5e045330, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.539821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d4ad5-7c37-49f6-a001-e471e369e4ee admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.602355 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1088/2179] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:36 2022] PUT /identity/v3/projects/9a8418ba06d8494db1e5fad08e9f1ba2/users/a45beb9ce0764169bbe1a27c5e045330/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:36.613412 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c35c68-62f7-4967-8f7c-366ef16d1052 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.613741 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbffc04-3731-4c6d-a237-238bea0d9663 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.613741 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbffc04-3731-4c6d-a237-238bea0d9663 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.613741 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbffc04-3731-4c6d-a237-238bea0d9663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.644399 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-cbbffc04-3731-4c6d-a237-238bea0d9663 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:36.646238 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-cbbffc04-3731-4c6d-a237-238bea0d9663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:36.733969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:36.758833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e61625-8d8d-4700-bd3e-43efa840b28d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.759751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e61625-8d8d-4700-bd3e-43efa840b28d service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.760324 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e61625-8d8d-4700-bd3e-43efa840b28d service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.760966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e61625-8d8d-4700-bd3e-43efa840b28d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.764763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-91e61625-8d8d-4700-bd3e-43efa840b28d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:36.770270 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1089/2180] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:36.774476 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbffc04-3731-4c6d-a237-238bea0d9663 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.776854 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-cbbffc04-3731-4c6d-a237-238bea0d9663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:36.787523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:36.798521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbffc04-3731-4c6d-a237-238bea0d9663 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.810496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce123-450f-42e5-a700-0f0af4c0126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.810987 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce123-450f-42e5-a700-0f0af4c0126d admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.811259 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce123-450f-42e5-a700-0f0af4c0126d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.811509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce123-450f-42e5-a700-0f0af4c0126d admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.812389 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abce123-450f-42e5-a700-0f0af4c0126d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.814125 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abce123-450f-42e5-a700-0f0af4c0126d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.833067 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1090/2181] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:36.834580 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4c4af-e0bc-4f9f-bdf7-4cf7ca9f446f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.835011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4c4af-e0bc-4f9f-bdf7-4cf7ca9f446f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.835873 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4c4af-e0bc-4f9f-bdf7-4cf7ca9f446f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.882197 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-60b4c4af-e0bc-4f9f-bdf7-4cf7ca9f446f None None] MFA Rules not processed for user `a45beb9ce0764169bbe1a27c5e045330`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:36.883419 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-60b4c4af-e0bc-4f9f-bdf7-4cf7ca9f446f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:36.888600 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e61625-8d8d-4700-bd3e-43efa840b28d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.890753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e61625-8d8d-4700-bd3e-43efa840b28d service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.902387 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1092/2182] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:36.903953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468aedb-c553-4f0e-99fa-5f2f20d9a13c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.904416 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468aedb-c553-4f0e-99fa-5f2f20d9a13c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.904561 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468aedb-c553-4f0e-99fa-5f2f20d9a13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.928558 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-9468aedb-c553-4f0e-99fa-5f2f20d9a13c None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:36.930189 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9468aedb-c553-4f0e-99fa-5f2f20d9a13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:36.941860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1093/2183] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:36.942944 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468aedb-c553-4f0e-99fa-5f2f20d9a13c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.954983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468aedb-c553-4f0e-99fa-5f2f20d9a13c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.960828 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d3ad2-1882-4643-b72e-b657934d26fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.962079 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d3ad2-1882-4643-b72e-b657934d26fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.962917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d3ad2-1882-4643-b72e-b657934d26fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.962917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d3ad2-1882-4643-b72e-b657934d26fc admin admin] PATH_INFO: `/v3/projects/5784b4c11d8c4276bf1bffee35046e03/users/de7b236b37fd4fe9a94b04d55239c115/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.998222 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1091/2184] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:36.999432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4c4af-e0bc-4f9f-bdf7-4cf7ca9f446f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:37.015565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4c4af-e0bc-4f9f-bdf7-4cf7ca9f446f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:37.023286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d3ad2-1882-4643-b72e-b657934d26fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5784b4c11d8c4276bf1bffee35046e03, user_id=de7b236b37fd4fe9a94b04d55239c115, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:37.025070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7ce57-c9a2-418d-b84c-145b5e3e0e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:37.026030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d3ad2-1882-4643-b72e-b657934d26fc admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:37.026522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7ce57-c9a2-418d-b84c-145b5e3e0e52 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:37.027311 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7ce57-c9a2-418d-b84c-145b5e3e0e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:37.028052 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7ce57-c9a2-418d-b84c-145b5e3e0e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:37.029154 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7ce57-c9a2-418d-b84c-145b5e3e0e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:37.030209 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7ce57-c9a2-418d-b84c-145b5e3e0e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:37.034208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7ce57-c9a2-418d-b84c-145b5e3e0e52 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:37.051796 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1094/2185] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:36 2022] PUT /identity/v3/projects/5784b4c11d8c4276bf1bffee35046e03/users/de7b236b37fd4fe9a94b04d55239c115/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:37.053447 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d3ad2-1882-4643-b72e-b657934d26fc admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:37.056915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-498d3ad2-1882-4643-b72e-b657934d26fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:37.077911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1092/2186] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:37.082042 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec71587-00b8-4d7e-84c5-fb9c091c02ce None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:37.082524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec71587-00b8-4d7e-84c5-fb9c091c02ce None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:37.082812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec71587-00b8-4d7e-84c5-fb9c091c02ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:37.148884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1ec71587-00b8-4d7e-84c5-fb9c091c02ce None None] MFA Rules not processed for user `de7b236b37fd4fe9a94b04d55239c115`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:37.150578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1ec71587-00b8-4d7e-84c5-fb9c091c02ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:37.210025 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d3ad2-1882-4643-b72e-b657934d26fc admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:37.223562 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8586d5-ab34-4f8f-9e1f-5139c61b2a2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:37.225704 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8586d5-ab34-4f8f-9e1f-5139c61b2a2e service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:37.225994 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8586d5-ab34-4f8f-9e1f-5139c61b2a2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:37.226262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8586d5-ab34-4f8f-9e1f-5139c61b2a2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:37.391026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1093/2187] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:37.391947 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec71587-00b8-4d7e-84c5-fb9c091c02ce None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:37.440207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8586d5-ab34-4f8f-9e1f-5139c61b2a2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:37.443188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8586d5-ab34-4f8f-9e1f-5139c61b2a2e service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:37.464109 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:37.468394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1095/2188] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:37.471844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8586d5-ab34-4f8f-9e1f-5139c61b2a2e service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:37.532206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec71587-00b8-4d7e-84c5-fb9c091c02ce None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:37.540165 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b2ca6-31df-4436-a735-baed1ded4eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:37.541565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b2ca6-31df-4436-a735-baed1ded4eed admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:37.542096 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b2ca6-31df-4436-a735-baed1ded4eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:37.542590 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b2ca6-31df-4436-a735-baed1ded4eed admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:37.543826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b2ca6-31df-4436-a735-baed1ded4eed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:37.548787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b2ca6-31df-4436-a735-baed1ded4eed admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:37.589792 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:37.630993 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1094/2189] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:37 2022] POST /identity/v3/projects => generated 375 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:37.637528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b2ca6-31df-4436-a735-baed1ded4eed admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:37.653256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8586d5-ab34-4f8f-9e1f-5139c61b2a2e service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:37.791813 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b2ca6-31df-4436-a735-baed1ded4eed admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:37.811951 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92433f22-ac01-4c1c-9327-9beea64f86e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:37.813027 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92433f22-ac01-4c1c-9327-9beea64f86e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:37.814310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92433f22-ac01-4c1c-9327-9beea64f86e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:37.826106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92433f22-ac01-4c1c-9327-9beea64f86e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:37.826106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92433f22-ac01-4c1c-9327-9beea64f86e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:37.826106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92433f22-ac01-4c1c-9327-9beea64f86e3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:37.828723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2204c7-9a5d-485e-b3d3-9e498c5c4c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:37.832008 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2204c7-9a5d-485e-b3d3-9e498c5c4c57 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:37.832544 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2204c7-9a5d-485e-b3d3-9e498c5c4c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:37.833026 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2204c7-9a5d-485e-b3d3-9e498c5c4c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:37.836835 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2204c7-9a5d-485e-b3d3-9e498c5c4c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:37.843553 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2204c7-9a5d-485e-b3d3-9e498c5c4c57 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:37.913058 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1095/2190] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:37 2022] POST /identity/v3/users => generated 288 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:37.925518 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92433f22-ac01-4c1c-9327-9beea64f86e3 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:37.944011 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1096/2191] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:37 2022] POST /identity/v3/projects => generated 383 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:37.945666 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2204c7-9a5d-485e-b3d3-9e498c5c4c57 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:37.956119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92433f22-ac01-4c1c-9327-9beea64f86e3 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:38.109518 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2204c7-9a5d-485e-b3d3-9e498c5c4c57 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:38.115525 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b449b-5361-4167-af93-a9ee117fb1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:38.116805 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b449b-5361-4167-af93-a9ee117fb1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:38.117780 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b449b-5361-4167-af93-a9ee117fb1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:38.117780 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b449b-5361-4167-af93-a9ee117fb1c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:38.118543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b449b-5361-4167-af93-a9ee117fb1c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:38.120791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b449b-5361-4167-af93-a9ee117fb1c3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:38.139593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d55b2-e114-4833-864d-ff36bc098ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:38.140622 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d55b2-e114-4833-864d-ff36bc098ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:38.144496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d55b2-e114-4833-864d-ff36bc098ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:38.145018 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d55b2-e114-4833-864d-ff36bc098ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:38.146080 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d55b2-e114-4833-864d-ff36bc098ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:38.151676 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d55b2-e114-4833-864d-ff36bc098ab5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:38.152767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1097/2192] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:37 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:38.156451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b449b-5361-4167-af93-a9ee117fb1c3 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:38.188841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1096/2193] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:38.189304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b449b-5361-4167-af93-a9ee117fb1c3 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:38.190864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d55b2-e114-4833-864d-ff36bc098ab5 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:38.202115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873b6c0-2128-46a2-ba92-391c5f12221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:38.203706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873b6c0-2128-46a2-ba92-391c5f12221d admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:38.204283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873b6c0-2128-46a2-ba92-391c5f12221d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:38.205791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873b6c0-2128-46a2-ba92-391c5f12221d admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:38.207630 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873b6c0-2128-46a2-ba92-391c5f12221d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:38.212604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873b6c0-2128-46a2-ba92-391c5f12221d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:38.215330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d55b2-e114-4833-864d-ff36bc098ab5 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:38.232229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d366f70-5444-475c-b20d-41953fee584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:38.233100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d366f70-5444-475c-b20d-41953fee584b admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:38.233988 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d366f70-5444-475c-b20d-41953fee584b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:38.235113 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d366f70-5444-475c-b20d-41953fee584b admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:38.237969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d366f70-5444-475c-b20d-41953fee584b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:38.240360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d366f70-5444-475c-b20d-41953fee584b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:38.250460 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1098/2194] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:38.252124 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873b6c0-2128-46a2-ba92-391c5f12221d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:38.266649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1097/2195] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:38.272162 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d366f70-5444-475c-b20d-41953fee584b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:38.290310 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873b6c0-2128-46a2-ba92-391c5f12221d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:38.299583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d366f70-5444-475c-b20d-41953fee584b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:38.305483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c5ff2-375d-48c8-811a-738eb18dd7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:38.307451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c5ff2-375d-48c8-811a-738eb18dd7ac admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:38.309311 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c5ff2-375d-48c8-811a-738eb18dd7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:38.309788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c5ff2-375d-48c8-811a-738eb18dd7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:38.312057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c5ff2-375d-48c8-811a-738eb18dd7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:38.313992 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959969ee-73b1-4a21-8b00-896ad8237270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:38.315021 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959969ee-73b1-4a21-8b00-896ad8237270 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:38.315467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959969ee-73b1-4a21-8b00-896ad8237270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:38.315891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959969ee-73b1-4a21-8b00-896ad8237270 admin admin] PATH_INFO: `/v3/projects/cee05c5504684cf89e5965e2663e5a8d/users/6174c8e1704844eb870a4dc8a1ac7f1d/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:38.316328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c5ff2-375d-48c8-811a-738eb18dd7ac admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:38.377500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1099/2196] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:38.383959 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c5ff2-375d-48c8-811a-738eb18dd7ac admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:38.398385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959969ee-73b1-4a21-8b00-896ad8237270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee05c5504684cf89e5965e2663e5a8d, user_id=6174c8e1704844eb870a4dc8a1ac7f1d, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:38.419408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959969ee-73b1-4a21-8b00-896ad8237270 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:38.420384 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c5ff2-375d-48c8-811a-738eb18dd7ac admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:38.434643 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41947afc-0cd0-47b0-b139-1730787bc4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:38.435478 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947afc-0cd0-47b0-b139-1730787bc4bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:38.436283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947afc-0cd0-47b0-b139-1730787bc4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:38.438146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947afc-0cd0-47b0-b139-1730787bc4bb admin admin] PATH_INFO: `/v3/projects/b65c48856c914e67a9ad2533874ac57b/users/411fe8a118a04f6eb0072f190a9c0317/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:38.465405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1098/2197] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:38 2022] PUT /identity/v3/projects/cee05c5504684cf89e5965e2663e5a8d/users/6174c8e1704844eb870a4dc8a1ac7f1d/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:38.465405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959969ee-73b1-4a21-8b00-896ad8237270 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:38.491875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41947afc-0cd0-47b0-b139-1730787bc4bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65c48856c914e67a9ad2533874ac57b, user_id=411fe8a118a04f6eb0072f190a9c0317, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:38.502006 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41947afc-0cd0-47b0-b139-1730787bc4bb admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:38.510700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:38.555259 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1100/2198] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:38 2022] PUT /identity/v3/projects/b65c48856c914e67a9ad2533874ac57b/users/411fe8a118a04f6eb0072f190a9c0317/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:38.557135 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc4f9a-51e6-4582-9552-63ef3c146b8e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:38.557723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc4f9a-51e6-4582-9552-63ef3c146b8e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:38.558118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc4f9a-51e6-4582-9552-63ef3c146b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:38.621321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:38.623791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959969ee-73b1-4a21-8b00-896ad8237270 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:38.626690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-14fc4f9a-51e6-4582-9552-63ef3c146b8e None None] MFA Rules not processed for user `6174c8e1704844eb870a4dc8a1ac7f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:38.629463 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-14fc4f9a-51e6-4582-9552-63ef3c146b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:38.756154 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd098e-7704-4a82-b078-995c663fdeb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:38.758337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd098e-7704-4a82-b078-995c663fdeb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:38.759195 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd098e-7704-4a82-b078-995c663fdeb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:38.759860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd098e-7704-4a82-b078-995c663fdeb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:38.764447 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f6cd098e-7704-4a82-b078-995c663fdeb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:38.768400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1101/2199] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:38.770521 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1c74f-324d-4135-af69-20ec0e3b94ed None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:38.771055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1c74f-324d-4135-af69-20ec0e3b94ed None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:38.771641 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1c74f-324d-4135-af69-20ec0e3b94ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:38.818254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-56c1c74f-324d-4135-af69-20ec0e3b94ed None None] MFA Rules not processed for user `411fe8a118a04f6eb0072f190a9c0317`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:38.828229 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-56c1c74f-324d-4135-af69-20ec0e3b94ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:38.932397 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd098e-7704-4a82-b078-995c663fdeb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:38.943671 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd098e-7704-4a82-b078-995c663fdeb1 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:38.982136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1099/2200] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:32:38.984712 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd098e-7704-4a82-b078-995c663fdeb1 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:39.008757 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1102/2201] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:39.027877 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1c74f-324d-4135-af69-20ec0e3b94ed None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:39.194365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1c74f-324d-4135-af69-20ec0e3b94ed None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:39.210799 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe36dd4-79aa-45b3-b7c2-733f37dae760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:39.211957 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe36dd4-79aa-45b3-b7c2-733f37dae760 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:39.212253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe36dd4-79aa-45b3-b7c2-733f37dae760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:39.212558 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe36dd4-79aa-45b3-b7c2-733f37dae760 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:39.213239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe36dd4-79aa-45b3-b7c2-733f37dae760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:39.220943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe36dd4-79aa-45b3-b7c2-733f37dae760 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:39.255637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd098e-7704-4a82-b078-995c663fdeb1 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:39.267902 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524fae0-7e52-45ad-9975-f0b7df8accc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:39.270489 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524fae0-7e52-45ad-9975-f0b7df8accc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:39.270489 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524fae0-7e52-45ad-9975-f0b7df8accc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:39.270920 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524fae0-7e52-45ad-9975-f0b7df8accc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:39.272635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524fae0-7e52-45ad-9975-f0b7df8accc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:39.285351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1103/2202] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:39 2022] POST /identity/v3/projects => generated 383 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:39.290111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524fae0-7e52-45ad-9975-f0b7df8accc1 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:39.296541 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe36dd4-79aa-45b3-b7c2-733f37dae760 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:39.363460 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:39.378652 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1100/2203] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:38 2022] POST /identity/v3/projects => generated 375 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:39.380026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524fae0-7e52-45ad-9975-f0b7df8accc1 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:39.405292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:39.494658 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe36dd4-79aa-45b3-b7c2-733f37dae760 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:39.524795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524fae0-7e52-45ad-9975-f0b7df8accc1 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:39.532284 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a44a09-e679-4fa1-9ce0-c62ee9242ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:39.532813 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a44a09-e679-4fa1-9ce0-c62ee9242ebc admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:39.533091 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a44a09-e679-4fa1-9ce0-c62ee9242ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:39.533392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a44a09-e679-4fa1-9ce0-c62ee9242ebc admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:39.534988 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a44a09-e679-4fa1-9ce0-c62ee9242ebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:39.537019 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a44a09-e679-4fa1-9ce0-c62ee9242ebc admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:39.594916 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1101/2204] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:39 2022] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:39.599702 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a44a09-e679-4fa1-9ce0-c62ee9242ebc admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:39.623786 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a44a09-e679-4fa1-9ce0-c62ee9242ebc admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:39.639724 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73207f3-22b7-4cec-8549-c08e31c89837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:39.640785 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73207f3-22b7-4cec-8549-c08e31c89837 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:39.641385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73207f3-22b7-4cec-8549-c08e31c89837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:39.644257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73207f3-22b7-4cec-8549-c08e31c89837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:39.645468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73207f3-22b7-4cec-8549-c08e31c89837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:39.648732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73207f3-22b7-4cec-8549-c08e31c89837 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:39.672328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2015d-1a7c-4d80-a592-04f46e207731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:39.672818 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2015d-1a7c-4d80-a592-04f46e207731 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:39.674642 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2015d-1a7c-4d80-a592-04f46e207731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:39.674642 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2015d-1a7c-4d80-a592-04f46e207731 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:39.675298 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2015d-1a7c-4d80-a592-04f46e207731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:39.678225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2015d-1a7c-4d80-a592-04f46e207731 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:39.680840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1102/2205] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:39.686493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73207f3-22b7-4cec-8549-c08e31c89837 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:39.731320 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73207f3-22b7-4cec-8549-c08e31c89837 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:39.750388 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1104/2206] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:39 2022] POST /identity/v3/users => generated 298 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:39.755207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2015d-1a7c-4d80-a592-04f46e207731 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:39.769458 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a2eac-ac41-4929-975d-06c48f6e2949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:39.771411 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a2eac-ac41-4929-975d-06c48f6e2949 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:39.772211 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a2eac-ac41-4929-975d-06c48f6e2949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:39.774073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a2eac-ac41-4929-975d-06c48f6e2949 admin admin] PATH_INFO: `/v3/projects/028a81f4110947388440f7abd1599993/users/dc24e95984c44d9fa2a1b7b58fdfc73e/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:39.783672 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2015d-1a7c-4d80-a592-04f46e207731 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:39.800370 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957249b-3e72-420d-8747-627d7101b0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:39.801008 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957249b-3e72-420d-8747-627d7101b0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:39.802097 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957249b-3e72-420d-8747-627d7101b0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:39.802838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957249b-3e72-420d-8747-627d7101b0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:39.803443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957249b-3e72-420d-8747-627d7101b0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:39.805377 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957249b-3e72-420d-8747-627d7101b0c1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:39.856469 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1105/2207] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:32:39.859159 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a2eac-ac41-4929-975d-06c48f6e2949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028a81f4110947388440f7abd1599993, user_id=dc24e95984c44d9fa2a1b7b58fdfc73e, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:39.866133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957249b-3e72-420d-8747-627d7101b0c1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:39.882319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a2eac-ac41-4929-975d-06c48f6e2949 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:39.888637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957249b-3e72-420d-8747-627d7101b0c1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:39.898978 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16ff95-b678-4eb3-b742-5034ac41b934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:39.900742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16ff95-b678-4eb3-b742-5034ac41b934 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:39.901568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16ff95-b678-4eb3-b742-5034ac41b934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:39.901875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16ff95-b678-4eb3-b742-5034ac41b934 admin admin] PATH_INFO: `/v3/projects/20d921e5c1eb41e09ec9a3e73b84d219/users/9dc41ecf1c084158a6c29f284620c24f/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:39.934526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1103/2208] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:39 2022] PUT /identity/v3/projects/028a81f4110947388440f7abd1599993/users/dc24e95984c44d9fa2a1b7b58fdfc73e/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:39.940613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a2eac-ac41-4929-975d-06c48f6e2949 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:39.964432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16ff95-b678-4eb3-b742-5034ac41b934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d921e5c1eb41e09ec9a3e73b84d219, user_id=9dc41ecf1c084158a6c29f284620c24f, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:39.974677 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16ff95-b678-4eb3-b742-5034ac41b934 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:40.022853 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1106/2209] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:39 2022] PUT /identity/v3/projects/20d921e5c1eb41e09ec9a3e73b84d219/users/9dc41ecf1c084158a6c29f284620c24f/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:40.027699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16ff95-b678-4eb3-b742-5034ac41b934 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:40.229493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16ff95-b678-4eb3-b742-5034ac41b934 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:40.243662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a2eac-ac41-4929-975d-06c48f6e2949 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:40.247707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645780f-d4b0-4522-a9ae-b039bf6fe529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:40.248537 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645780f-d4b0-4522-a9ae-b039bf6fe529 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.248828 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645780f-d4b0-4522-a9ae-b039bf6fe529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.249105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645780f-d4b0-4522-a9ae-b039bf6fe529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.253971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645780f-d4b0-4522-a9ae-b039bf6fe529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:40.263959 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645780f-d4b0-4522-a9ae-b039bf6fe529 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:40.272856 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1f9fb-cea4-4baf-bf7e-91cb339be8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:40.273954 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1f9fb-cea4-4baf-bf7e-91cb339be8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.274429 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1f9fb-cea4-4baf-bf7e-91cb339be8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.274886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1f9fb-cea4-4baf-bf7e-91cb339be8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.281290 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1f9fb-cea4-4baf-bf7e-91cb339be8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:40.285264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1f9fb-cea4-4baf-bf7e-91cb339be8c7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:40.287299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1107/2210] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:40.288819 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645780f-d4b0-4522-a9ae-b039bf6fe529 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:40.305617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645780f-d4b0-4522-a9ae-b039bf6fe529 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:40.315106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998903d0-5b4b-4129-9758-b80b9bd102ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:40.315927 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998903d0-5b4b-4129-9758-b80b9bd102ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.316233 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998903d0-5b4b-4129-9758-b80b9bd102ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.316526 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998903d0-5b4b-4129-9758-b80b9bd102ec admin admin] PATH_INFO: `/v3/projects/20d921e5c1eb41e09ec9a3e73b84d219/users/9dc41ecf1c084158a6c29f284620c24f/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.319841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998903d0-5b4b-4129-9758-b80b9bd102ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d921e5c1eb41e09ec9a3e73b84d219, user_id=9dc41ecf1c084158a6c29f284620c24f, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:40.337392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1104/2211] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:40.337870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998903d0-5b4b-4129-9758-b80b9bd102ec admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:40.347183 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1f9fb-cea4-4baf-bf7e-91cb339be8c7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:40.375236 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1108/2212] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:40 2022] PUT /identity/v3/projects/20d921e5c1eb41e09ec9a3e73b84d219/users/9dc41ecf1c084158a6c29f284620c24f/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:40.386442 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1f9fb-cea4-4baf-bf7e-91cb339be8c7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:40.403295 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273603f-1009-4798-8bec-05101d2ec643 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.403633 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273603f-1009-4798-8bec-05101d2ec643 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.403881 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273603f-1009-4798-8bec-05101d2ec643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.420383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:40.483315 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2273603f-1009-4798-8bec-05101d2ec643 None None] MFA Rules not processed for user `9dc41ecf1c084158a6c29f284620c24f`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:40.488523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2273603f-1009-4798-8bec-05101d2ec643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:40.603780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f2a50-3fe2-45ec-81a7-19072271a5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:40.605232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f2a50-3fe2-45ec-81a7-19072271a5a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.605830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f2a50-3fe2-45ec-81a7-19072271a5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.608278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f2a50-3fe2-45ec-81a7-19072271a5a5 admin admin] PATH_INFO: `/v3/projects/028a81f4110947388440f7abd1599993/users/dc24e95984c44d9fa2a1b7b58fdfc73e/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.638556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f2a50-3fe2-45ec-81a7-19072271a5a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028a81f4110947388440f7abd1599993, user_id=dc24e95984c44d9fa2a1b7b58fdfc73e, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:40.653867 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f2a50-3fe2-45ec-81a7-19072271a5a5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:40.671220 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:40.740051 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1105/2213] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:40 2022] PUT /identity/v3/projects/028a81f4110947388440f7abd1599993/users/dc24e95984c44d9fa2a1b7b58fdfc73e/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:40.751400 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55555017-f063-46a8-a9ae-60cd55e0687e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.751827 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55555017-f063-46a8-a9ae-60cd55e0687e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.752693 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55555017-f063-46a8-a9ae-60cd55e0687e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.752902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1109/2214] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:40.783209 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273603f-1009-4798-8bec-05101d2ec643 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:40.848928 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-55555017-f063-46a8-a9ae-60cd55e0687e None None] MFA Rules not processed for user `dc24e95984c44d9fa2a1b7b58fdfc73e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:40.853071 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-55555017-f063-46a8-a9ae-60cd55e0687e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:40.900114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273603f-1009-4798-8bec-05101d2ec643 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:40.989998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41addcb8-3ac3-4026-b4e0-8386c1ef58bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:40.990727 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41addcb8-3ac3-4026-b4e0-8386c1ef58bf service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.991028 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41addcb8-3ac3-4026-b4e0-8386c1ef58bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.991301 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41addcb8-3ac3-4026-b4e0-8386c1ef58bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.100446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1106/2215] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:41.168944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55555017-f063-46a8-a9ae-60cd55e0687e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:41.192795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55555017-f063-46a8-a9ae-60cd55e0687e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:41.198379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41addcb8-3ac3-4026-b4e0-8386c1ef58bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:41.199946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41addcb8-3ac3-4026-b4e0-8386c1ef58bf service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:41.208755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf1173-6921-4552-b083-3062bd82da9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:41.209431 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf1173-6921-4552-b083-3062bd82da9f service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.210362 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf1173-6921-4552-b083-3062bd82da9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.210656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf1173-6921-4552-b083-3062bd82da9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.220642 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:41.242644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1110/2216] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:32:41.397556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf1173-6921-4552-b083-3062bd82da9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:41.400806 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf1173-6921-4552-b083-3062bd82da9f service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:41.430986 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1107/2217] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:42.793611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41addcb8-3ac3-4026-b4e0-8386c1ef58bf service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:42.797091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-41addcb8-3ac3-4026-b4e0-8386c1ef58bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:42.999472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41addcb8-3ac3-4026-b4e0-8386c1ef58bf service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:43.013221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b28b8b-085b-4307-853f-23d0d293a83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:43.015022 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28b8b-085b-4307-853f-23d0d293a83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:43.016706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28b8b-085b-4307-853f-23d0d293a83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:43.019753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28b8b-085b-4307-853f-23d0d293a83f admin admin] PATH_INFO: `/v3/users/f2d1c2e456ed40d184609ee3ffc48d18` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:43.020790 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b28b8b-085b-4307-853f-23d0d293a83f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d1c2e456ed40d184609ee3ffc48d18)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:43.025523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b28b8b-085b-4307-853f-23d0d293a83f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:43.251798 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d4b28b8b-085b-4307-853f-23d0d293a83f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d1c2e456ed40d184609ee3ffc48d18'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:43.292357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d4b28b8b-085b-4307-853f-23d0d293a83f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d1c2e456ed40d184609ee3ffc48d18'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:43.366162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d4b28b8b-085b-4307-853f-23d0d293a83f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d1c2e456ed40d184609ee3ffc48d18'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:43.367552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d4b28b8b-085b-4307-853f-23d0d293a83f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d1c2e456ed40d184609ee3ffc48d18'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:43.368712 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d4b28b8b-085b-4307-853f-23d0d293a83f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d1c2e456ed40d184609ee3ffc48d18'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:43.415447 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ea7bb-14f6-4b86-8ec7-a5635ef38e38 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:43.416026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ea7bb-14f6-4b86-8ec7-a5635ef38e38 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:43.417119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ea7bb-14f6-4b86-8ec7-a5635ef38e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:43.423727 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1111/2218] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:42 2022] DELETE /identity/v3/users/f2d1c2e456ed40d184609ee3ffc48d18 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:43.460019 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b61ea7bb-14f6-4b86-8ec7-a5635ef38e38 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:43.462702 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b61ea7bb-14f6-4b86-8ec7-a5635ef38e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:43.644966 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1108/2219] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:43.667863 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b28b8b-085b-4307-853f-23d0d293a83f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:43.672145 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d4b28b8b-085b-4307-853f-23d0d293a83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:43.892915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b28b8b-085b-4307-853f-23d0d293a83f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:43.906609 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed9d8b-0fb2-4486-bb2e-f311198132d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:43.907904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed9d8b-0fb2-4486-bb2e-f311198132d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:43.908383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed9d8b-0fb2-4486-bb2e-f311198132d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:43.908839 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed9d8b-0fb2-4486-bb2e-f311198132d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:43.939940 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed9d8b-0fb2-4486-bb2e-f311198132d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:43.943874 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed9d8b-0fb2-4486-bb2e-f311198132d4 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:43.977797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1112/2220] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:44.116626 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ea7bb-14f6-4b86-8ec7-a5635ef38e38 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:44.120360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b61ea7bb-14f6-4b86-8ec7-a5635ef38e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:44.183630 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:44.344784 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ea7bb-14f6-4b86-8ec7-a5635ef38e38 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:44.359623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06217b74-88a2-4816-b38c-709f5a6c90e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:44.360768 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06217b74-88a2-4816-b38c-709f5a6c90e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:44.361386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06217b74-88a2-4816-b38c-709f5a6c90e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:44.362010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06217b74-88a2-4816-b38c-709f5a6c90e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:44.366123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-06217b74-88a2-4816-b38c-709f5a6c90e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:44.567982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06217b74-88a2-4816-b38c-709f5a6c90e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:44.574856 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06217b74-88a2-4816-b38c-709f5a6c90e0 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:44.603151 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1109/2221] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:44.816195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed9d8b-0fb2-4486-bb2e-f311198132d4 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:44.818704 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-57ed9d8b-0fb2-4486-bb2e-f311198132d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:44.880000 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed9d8b-0fb2-4486-bb2e-f311198132d4 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:44.896790 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625d642-103f-4226-849e-b8f54d8910f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:44.897998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625d642-103f-4226-849e-b8f54d8910f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:44.898693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625d642-103f-4226-849e-b8f54d8910f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:44.899378 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625d642-103f-4226-849e-b8f54d8910f8 admin admin] PATH_INFO: `/v3/projects/fac25f79d04040149978b30ddbf5df7e` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:44.904206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625d642-103f-4226-849e-b8f54d8910f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fac25f79d04040149978b30ddbf5df7e)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:44.908057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625d642-103f-4226-849e-b8f54d8910f8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:44.994292 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:45.033799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06217b74-88a2-4816-b38c-709f5a6c90e0 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:45.036897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-06217b74-88a2-4816-b38c-709f5a6c90e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:45.067142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06217b74-88a2-4816-b38c-709f5a6c90e0 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:45.078757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77b412-fffc-48d4-9fd2-345fde0844fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:45.080176 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77b412-fffc-48d4-9fd2-345fde0844fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:45.080952 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77b412-fffc-48d4-9fd2-345fde0844fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:45.081689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77b412-fffc-48d4-9fd2-345fde0844fd admin admin] PATH_INFO: `/v3/users/7e00c9346e054aa093ac25f6a896cd63` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:45.084703 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77b412-fffc-48d4-9fd2-345fde0844fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e00c9346e054aa093ac25f6a896cd63)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:45.089181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77b412-fffc-48d4-9fd2-345fde0844fd admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:45.113059 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3625d642-103f-4226-849e-b8f54d8910f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fac25f79d04040149978b30ddbf5df7e', 'request_id': 'req-3625d642-103f-4226-849e-b8f54d8910f8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:45.126194 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3625d642-103f-4226-849e-b8f54d8910f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fac25f79d04040149978b30ddbf5df7e', 'request_id': 'req-3625d642-103f-4226-849e-b8f54d8910f8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:45.156865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3625d642-103f-4226-849e-b8f54d8910f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fac25f79d04040149978b30ddbf5df7e', 'request_id': 'req-3625d642-103f-4226-849e-b8f54d8910f8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:45.197174 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3625d642-103f-4226-849e-b8f54d8910f8 admin admin] The token cache is being invalidate because project fac25f79d04040149978b30ddbf5df7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:45.197698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3625d642-103f-4226-849e-b8f54d8910f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:45.202513 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3625d642-103f-4226-849e-b8f54d8910f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:45.209433 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1113/2222] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:44 2022] DELETE /identity/v3/projects/fac25f79d04040149978b30ddbf5df7e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:45.227906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a176cd5-31d0-49ad-8c03-666209d5f2aa None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:45.229076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a176cd5-31d0-49ad-8c03-666209d5f2aa None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:45.231966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a176cd5-31d0-49ad-8c03-666209d5f2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:45.265908 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3b77b412-fffc-48d4-9fd2-345fde0844fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e00c9346e054aa093ac25f6a896cd63'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:45.290517 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-9a176cd5-31d0-49ad-8c03-666209d5f2aa None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:45.292235 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9a176cd5-31d0-49ad-8c03-666209d5f2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:45.294240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3b77b412-fffc-48d4-9fd2-345fde0844fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e00c9346e054aa093ac25f6a896cd63'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:45.321849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3b77b412-fffc-48d4-9fd2-345fde0844fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e00c9346e054aa093ac25f6a896cd63'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:45.326155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3b77b412-fffc-48d4-9fd2-345fde0844fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e00c9346e054aa093ac25f6a896cd63'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:45.350370 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3b77b412-fffc-48d4-9fd2-345fde0844fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e00c9346e054aa093ac25f6a896cd63'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:45.376565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1110/2223] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:45 2022] DELETE /identity/v3/users/7e00c9346e054aa093ac25f6a896cd63 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:45.381587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c57cb6-3d51-427d-ad02-16ca2de032db None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:45.381878 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c57cb6-3d51-427d-ad02-16ca2de032db None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:45.382181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c57cb6-3d51-427d-ad02-16ca2de032db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:45.457812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-78c57cb6-3d51-427d-ad02-16ca2de032db None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:45.473255 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-78c57cb6-3d51-427d-ad02-16ca2de032db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:45.634045 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1114/2224] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:45.648659 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:45.656391 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0ba9f-0f17-44b6-92d8-a7a7a3c88426 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:45.657649 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0ba9f-0f17-44b6-92d8-a7a7a3c88426 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:45.658429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0ba9f-0f17-44b6-92d8-a7a7a3c88426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:45.716638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-44a0ba9f-0f17-44b6-92d8-a7a7a3c88426 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:45.726966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-44a0ba9f-0f17-44b6-92d8-a7a7a3c88426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:45.764314 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1111/2225] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:45.787364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1115/2226] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:45.794189 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c57cb6-3d51-427d-ad02-16ca2de032db None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:45.796619 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-78c57cb6-3d51-427d-ad02-16ca2de032db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:45.796897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0ba9f-0f17-44b6-92d8-a7a7a3c88426 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:45.813475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0ba9f-0f17-44b6-92d8-a7a7a3c88426 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:45.822582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd10e3-a2d9-4c3c-8137-fcc4f7233437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:45.824142 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd10e3-a2d9-4c3c-8137-fcc4f7233437 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:45.824970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd10e3-a2d9-4c3c-8137-fcc4f7233437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:45.825674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd10e3-a2d9-4c3c-8137-fcc4f7233437 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:45.827179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd10e3-a2d9-4c3c-8137-fcc4f7233437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:45.827843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd10e3-a2d9-4c3c-8137-fcc4f7233437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:45.831454 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd10e3-a2d9-4c3c-8137-fcc4f7233437 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:45.870562 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1116/2227] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:32:45.872811 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd10e3-a2d9-4c3c-8137-fcc4f7233437 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:45.910483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd10e3-a2d9-4c3c-8137-fcc4f7233437 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:45.920815 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059179b-f6b9-47ef-a884-6ca7351372ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:45.922490 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059179b-f6b9-47ef-a884-6ca7351372ac admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:45.923800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059179b-f6b9-47ef-a884-6ca7351372ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:45.924742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059179b-f6b9-47ef-a884-6ca7351372ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:45.926674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059179b-f6b9-47ef-a884-6ca7351372ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:45.931847 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059179b-f6b9-47ef-a884-6ca7351372ac admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:45.961458 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c57cb6-3d51-427d-ad02-16ca2de032db None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:45.985810 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c09fc6-5baf-4ebb-8f10-c835693e6e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:45.987095 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c09fc6-5baf-4ebb-8f10-c835693e6e14 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:45.987615 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c09fc6-5baf-4ebb-8f10-c835693e6e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:45.988116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c09fc6-5baf-4ebb-8f10-c835693e6e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:45.993430 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1117/2228] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:45 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:46.007138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059179b-f6b9-47ef-a884-6ca7351372ac admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:46.009895 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c09fc6-5baf-4ebb-8f10-c835693e6e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:46.014351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c09fc6-5baf-4ebb-8f10-c835693e6e14 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:46.068827 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1112/2229] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:46.082849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c09fc6-5baf-4ebb-8f10-c835693e6e14 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:46.085897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f1c09fc6-5baf-4ebb-8f10-c835693e6e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:46.131098 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c09fc6-5baf-4ebb-8f10-c835693e6e14 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:46.242217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059179b-f6b9-47ef-a884-6ca7351372ac admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:46.262761 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71133210-1328-417a-8581-1e183f3d6104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:46.263409 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71133210-1328-417a-8581-1e183f3d6104 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:46.263696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71133210-1328-417a-8581-1e183f3d6104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:46.263974 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71133210-1328-417a-8581-1e183f3d6104 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:46.264770 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71133210-1328-417a-8581-1e183f3d6104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:46.281615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71133210-1328-417a-8581-1e183f3d6104 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:46.296139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:46.325457 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1118/2230] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:46 2022] POST /identity/v3/users => generated 285 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:46.336665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71133210-1328-417a-8581-1e183f3d6104 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:46.355111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732a559-73e4-4aa1-a701-264185078585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:46.356330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732a559-73e4-4aa1-a701-264185078585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:46.356664 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732a559-73e4-4aa1-a701-264185078585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:46.357142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732a559-73e4-4aa1-a701-264185078585 admin admin] PATH_INFO: `/v3/users/6174c8e1704844eb870a4dc8a1ac7f1d` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:46.359960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732a559-73e4-4aa1-a701-264185078585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6174c8e1704844eb870a4dc8a1ac7f1d)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:46.361653 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71133210-1328-417a-8581-1e183f3d6104 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:46.366097 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732a559-73e4-4aa1-a701-264185078585 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:46.388299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21b668-050e-4784-af73-cf951b68b02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:46.392054 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21b668-050e-4784-af73-cf951b68b02f admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:46.395868 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21b668-050e-4784-af73-cf951b68b02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:46.396514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21b668-050e-4784-af73-cf951b68b02f admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:46.399444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21b668-050e-4784-af73-cf951b68b02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:46.404420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21b668-050e-4784-af73-cf951b68b02f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:46.453204 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1119/2231] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:46.460845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21b668-050e-4784-af73-cf951b68b02f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:46.468853 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1d21b668-050e-4784-af73-cf951b68b02f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:46.605030 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2732a559-73e4-4aa1-a701-264185078585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6174c8e1704844eb870a4dc8a1ac7f1d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:46.673812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2732a559-73e4-4aa1-a701-264185078585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6174c8e1704844eb870a4dc8a1ac7f1d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:46.688686 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21b668-050e-4784-af73-cf951b68b02f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:46.690105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2732a559-73e4-4aa1-a701-264185078585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6174c8e1704844eb870a4dc8a1ac7f1d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:46.690954 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2732a559-73e4-4aa1-a701-264185078585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6174c8e1704844eb870a4dc8a1ac7f1d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:46.699591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463bc0d-2eb5-47d4-85aa-8a1b304c5b4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:46.700879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463bc0d-2eb5-47d4-85aa-8a1b304c5b4b service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:46.701604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463bc0d-2eb5-47d4-85aa-8a1b304c5b4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:46.702098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463bc0d-2eb5-47d4-85aa-8a1b304c5b4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:46.705946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9463bc0d-2eb5-47d4-85aa-8a1b304c5b4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:46.710406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2732a559-73e4-4aa1-a701-264185078585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6174c8e1704844eb870a4dc8a1ac7f1d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:46.731281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1113/2232] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:46 2022] DELETE /identity/v3/users/6174c8e1704844eb870a4dc8a1ac7f1d => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:46.732507 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732a559-73e4-4aa1-a701-264185078585 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:46.735565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2732a559-73e4-4aa1-a701-264185078585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:46.778009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:46.924005 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463bc0d-2eb5-47d4-85aa-8a1b304c5b4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:46.933078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463bc0d-2eb5-47d4-85aa-8a1b304c5b4b service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:46.997092 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1120/2233] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:46.999687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d182f-a2c4-47f9-9ca8-817986e4e4ec None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:47.002061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d182f-a2c4-47f9-9ca8-817986e4e4ec None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:47.002762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d182f-a2c4-47f9-9ca8-817986e4e4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:47.008129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732a559-73e4-4aa1-a701-264185078585 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:47.017650 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298d966-8e12-4acc-871a-e26a9d9cf270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:47.019003 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298d966-8e12-4acc-871a-e26a9d9cf270 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:47.019528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298d966-8e12-4acc-871a-e26a9d9cf270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:47.020036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298d966-8e12-4acc-871a-e26a9d9cf270 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:47.023118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298d966-8e12-4acc-871a-e26a9d9cf270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:47.027880 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298d966-8e12-4acc-871a-e26a9d9cf270 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:47.062578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1114/2234] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:47.062578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c55e3c-30c2-41cb-abfb-5b43a7ae4c2a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:47.063025 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-047d182f-a2c4-47f9-9ca8-817986e4e4ec None None] MFA Rules not processed for user `3340cc123b0d4ff089889b133b32815e`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:47.063181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c55e3c-30c2-41cb-abfb-5b43a7ae4c2a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:47.063181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c55e3c-30c2-41cb-abfb-5b43a7ae4c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:47.063506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-047d182f-a2c4-47f9-9ca8-817986e4e4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:47.117479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e0c55e3c-30c2-41cb-abfb-5b43a7ae4c2a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:47.122361 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e0c55e3c-30c2-41cb-abfb-5b43a7ae4c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:47.189300 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1115/2235] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:47.208125 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c55e3c-30c2-41cb-abfb-5b43a7ae4c2a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:47.212579 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e0c55e3c-30c2-41cb-abfb-5b43a7ae4c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:47.242528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c55e3c-30c2-41cb-abfb-5b43a7ae4c2a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:47.279707 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b2607-15ee-4739-834e-81b594136542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:47.280882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b2607-15ee-4739-834e-81b594136542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:47.281301 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b2607-15ee-4739-834e-81b594136542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:47.281643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b2607-15ee-4739-834e-81b594136542 admin admin] PATH_INFO: `/v3/projects/092a8ec21546435b81bb1be36658a337` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:47.283802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b2607-15ee-4739-834e-81b594136542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=092a8ec21546435b81bb1be36658a337)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:47.293567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1121/2236] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:47.293986 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b2607-15ee-4739-834e-81b594136542 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:47.294088 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d182f-a2c4-47f9-9ca8-817986e4e4ec None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:47.350713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d182f-a2c4-47f9-9ca8-817986e4e4ec None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:47.364767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db7228-7b0d-4044-bee0-c04c7dc89617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:47.366551 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db7228-7b0d-4044-bee0-c04c7dc89617 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:47.367267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db7228-7b0d-4044-bee0-c04c7dc89617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:47.367748 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db7228-7b0d-4044-bee0-c04c7dc89617 admin admin] PATH_INFO: `/v3/projects/9ff1ddc7d2974cbc84f2e8098f6f5fec/users/8ed6af21302d4b8c9998cee0c316b8cf/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:47.439780 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db7228-7b0d-4044-bee0-c04c7dc89617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff1ddc7d2974cbc84f2e8098f6f5fec, user_id=8ed6af21302d4b8c9998cee0c316b8cf, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:47.442993 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5d5b2607-15ee-4739-834e-81b594136542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092a8ec21546435b81bb1be36658a337', 'request_id': 'req-5d5b2607-15ee-4739-834e-81b594136542'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:47.445438 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db7228-7b0d-4044-bee0-c04c7dc89617 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:47.459600 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:47.462765 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5d5b2607-15ee-4739-834e-81b594136542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092a8ec21546435b81bb1be36658a337', 'request_id': 'req-5d5b2607-15ee-4739-834e-81b594136542'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:47.476916 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5d5b2607-15ee-4739-834e-81b594136542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092a8ec21546435b81bb1be36658a337', 'request_id': 'req-5d5b2607-15ee-4739-834e-81b594136542'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:47.496063 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5d5b2607-15ee-4739-834e-81b594136542 admin admin] The token cache is being invalidate because project 092a8ec21546435b81bb1be36658a337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:47.496626 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5d5b2607-15ee-4739-834e-81b594136542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:47.497848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5d5b2607-15ee-4739-834e-81b594136542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:47.500578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1116/2238] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:47 2022] DELETE /identity/v3/projects/092a8ec21546435b81bb1be36658a337 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:47.501920 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b2607-15ee-4739-834e-81b594136542 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:47.502378 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1122/2238] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:47 2022] PUT /identity/v3/projects/9ff1ddc7d2974cbc84f2e8098f6f5fec/users/8ed6af21302d4b8c9998cee0c316b8cf/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:47.503475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db7228-7b0d-4044-bee0-c04c7dc89617 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:47.504226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5d5b2607-15ee-4739-834e-81b594136542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:47.510141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c2db7228-7b0d-4044-bee0-c04c7dc89617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:47.682484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b2607-15ee-4739-834e-81b594136542 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:47.748412 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db7228-7b0d-4044-bee0-c04c7dc89617 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:47.758937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020462c-6abd-4a15-80b1-0587a849815c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:47.760089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020462c-6abd-4a15-80b1-0587a849815c service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:47.760663 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020462c-6abd-4a15-80b1-0587a849815c service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:47.761475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020462c-6abd-4a15-80b1-0587a849815c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:47.765803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0020462c-6abd-4a15-80b1-0587a849815c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:47.767488 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:47.817692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdb502-7160-46fc-9e9c-4fff3d349c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:47.819058 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdb502-7160-46fc-9e9c-4fff3d349c25 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:47.819392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdb502-7160-46fc-9e9c-4fff3d349c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:47.820003 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdb502-7160-46fc-9e9c-4fff3d349c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:47.824558 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-81cdb502-7160-46fc-9e9c-4fff3d349c25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:47.904443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020462c-6abd-4a15-80b1-0587a849815c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:47.906592 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020462c-6abd-4a15-80b1-0587a849815c service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:47.918746 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1123/2239] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:47.919737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020462c-6abd-4a15-80b1-0587a849815c service nova] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:47.921099 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0020462c-6abd-4a15-80b1-0587a849815c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:47.966134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdb502-7160-46fc-9e9c-4fff3d349c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:47.968982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdb502-7160-46fc-9e9c-4fff3d349c25 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:48.015112 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1117/2240] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:48.021608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3ae99-e3a0-46cf-8c6b-ca9c35acdb93 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:48.022152 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3ae99-e3a0-46cf-8c6b-ca9c35acdb93 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:48.022609 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3ae99-e3a0-46cf-8c6b-ca9c35acdb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:48.058170 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020462c-6abd-4a15-80b1-0587a849815c service nova] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:48.077263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02c698-5f73-44fc-95fe-e48c159e493d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:48.078607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02c698-5f73-44fc-95fe-e48c159e493d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:48.080347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02c698-5f73-44fc-95fe-e48c159e493d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:48.080962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02c698-5f73-44fc-95fe-e48c159e493d admin admin] PATH_INFO: `/v3/users/9faa214c764f43f39f4abe791ecb71da` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:48.085073 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02c698-5f73-44fc-95fe-e48c159e493d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9faa214c764f43f39f4abe791ecb71da)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:48.105492 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02c698-5f73-44fc-95fe-e48c159e493d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:48.115406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f1f3ae99-e3a0-46cf-8c6b-ca9c35acdb93 None None] MFA Rules not processed for user `8ed6af21302d4b8c9998cee0c316b8cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:48.117137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f1f3ae99-e3a0-46cf-8c6b-ca9c35acdb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:48.236920 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:48.301669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-df02c698-5f73-44fc-95fe-e48c159e493d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9faa214c764f43f39f4abe791ecb71da'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:48.323701 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-df02c698-5f73-44fc-95fe-e48c159e493d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9faa214c764f43f39f4abe791ecb71da'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:48.364404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-df02c698-5f73-44fc-95fe-e48c159e493d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9faa214c764f43f39f4abe791ecb71da'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:48.366070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-df02c698-5f73-44fc-95fe-e48c159e493d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9faa214c764f43f39f4abe791ecb71da'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:48.366901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-df02c698-5f73-44fc-95fe-e48c159e493d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9faa214c764f43f39f4abe791ecb71da'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:48.398511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1124/2241] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:47 2022] DELETE /identity/v3/users/9faa214c764f43f39f4abe791ecb71da => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:48.415404 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1118/2242] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:48.426915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02c698-5f73-44fc-95fe-e48c159e493d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:48.429424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-df02c698-5f73-44fc-95fe-e48c159e493d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:48.672892 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02c698-5f73-44fc-95fe-e48c159e493d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:48.679839 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b95709-6eed-472b-9502-2a38cfd09e0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47429aec6d8a4339b4ec0fb32b25e90b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:48.680986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b95709-6eed-472b-9502-2a38cfd09e0b service glance] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:48.681517 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b95709-6eed-472b-9502-2a38cfd09e0b service glance] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:48.682129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b95709-6eed-472b-9502-2a38cfd09e0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:48.686662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a7b95709-6eed-472b-9502-2a38cfd09e0b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:48.867688 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b95709-6eed-472b-9502-2a38cfd09e0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:48.874521 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b95709-6eed-472b-9502-2a38cfd09e0b service glance] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:48.930451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3ae99-e3a0-46cf-8c6b-ca9c35acdb93 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:48.934171 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f1f3ae99-e3a0-46cf-8c6b-ca9c35acdb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:48.941610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1125/2243] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:48.978340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3ae99-e3a0-46cf-8c6b-ca9c35acdb93 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:49.105644 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a69a93-85cc-46ee-996e-da5d18e28ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:49.107827 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a69a93-85cc-46ee-996e-da5d18e28ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:49.109578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a69a93-85cc-46ee-996e-da5d18e28ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:49.112431 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a69a93-85cc-46ee-996e-da5d18e28ba0 admin admin] PATH_INFO: `/v3/projects/cee05c5504684cf89e5965e2663e5a8d` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:49.120213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a69a93-85cc-46ee-996e-da5d18e28ba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee05c5504684cf89e5965e2663e5a8d)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:49.128554 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a69a93-85cc-46ee-996e-da5d18e28ba0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:49.194603 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:49.325781 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-75a69a93-85cc-46ee-996e-da5d18e28ba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee05c5504684cf89e5965e2663e5a8d', 'request_id': 'req-75a69a93-85cc-46ee-996e-da5d18e28ba0'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.367453 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-75a69a93-85cc-46ee-996e-da5d18e28ba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee05c5504684cf89e5965e2663e5a8d', 'request_id': 'req-75a69a93-85cc-46ee-996e-da5d18e28ba0'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.390689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-75a69a93-85cc-46ee-996e-da5d18e28ba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee05c5504684cf89e5965e2663e5a8d', 'request_id': 'req-75a69a93-85cc-46ee-996e-da5d18e28ba0'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.436956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-75a69a93-85cc-46ee-996e-da5d18e28ba0 admin admin] The token cache is being invalidate because project cee05c5504684cf89e5965e2663e5a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:49.437990 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-75a69a93-85cc-46ee-996e-da5d18e28ba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.438579 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-75a69a93-85cc-46ee-996e-da5d18e28ba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.440806 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1119/2244] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:48 2022] DELETE /identity/v3/projects/cee05c5504684cf89e5965e2663e5a8d => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:49.445348 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b95709-6eed-472b-9502-2a38cfd09e0b service glance] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:49.450025 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a7b95709-6eed-472b-9502-2a38cfd09e0b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:49.497047 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b95709-6eed-472b-9502-2a38cfd09e0b service glance] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:49.505410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a69a93-85cc-46ee-996e-da5d18e28ba0 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:49.518346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-75a69a93-85cc-46ee-996e-da5d18e28ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:49.779086 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a69a93-85cc-46ee-996e-da5d18e28ba0 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:49.787415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd5b59-5d5f-4fc3-8917-85765718f108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:49.788150 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd5b59-5d5f-4fc3-8917-85765718f108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:49.788559 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd5b59-5d5f-4fc3-8917-85765718f108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:49.788840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd5b59-5d5f-4fc3-8917-85765718f108 admin admin] PATH_INFO: `/v3/projects/ff3eaa088ad44db68a15ec7bbcfce42a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:49.790424 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd5b59-5d5f-4fc3-8917-85765718f108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff3eaa088ad44db68a15ec7bbcfce42a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:49.793498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd5b59-5d5f-4fc3-8917-85765718f108 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:49.795622 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:49.860352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9b37c-e444-4e4e-9063-be3151001284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:49.862395 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9b37c-e444-4e4e-9063-be3151001284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:49.862690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9b37c-e444-4e4e-9063-be3151001284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:49.862974 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9b37c-e444-4e4e-9063-be3151001284 admin admin] PATH_INFO: `/v3/users/dc24e95984c44d9fa2a1b7b58fdfc73e` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:49.871871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9b37c-e444-4e4e-9063-be3151001284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc24e95984c44d9fa2a1b7b58fdfc73e)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:49.891328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9b37c-e444-4e4e-9063-be3151001284 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:49.960661 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-49cd5b59-5d5f-4fc3-8917-85765718f108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff3eaa088ad44db68a15ec7bbcfce42a', 'request_id': 'req-49cd5b59-5d5f-4fc3-8917-85765718f108'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.982364 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-49cd5b59-5d5f-4fc3-8917-85765718f108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff3eaa088ad44db68a15ec7bbcfce42a', 'request_id': 'req-49cd5b59-5d5f-4fc3-8917-85765718f108'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.002854 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-49cd5b59-5d5f-4fc3-8917-85765718f108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff3eaa088ad44db68a15ec7bbcfce42a', 'request_id': 'req-49cd5b59-5d5f-4fc3-8917-85765718f108'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.051982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-49cd5b59-5d5f-4fc3-8917-85765718f108 admin admin] The token cache is being invalidate because project ff3eaa088ad44db68a15ec7bbcfce42a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:50.052530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-49cd5b59-5d5f-4fc3-8917-85765718f108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.057089 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-49cd5b59-5d5f-4fc3-8917-85765718f108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.061294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-87d9b37c-e444-4e4e-9063-be3151001284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc24e95984c44d9fa2a1b7b58fdfc73e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.066329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1120/2245] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:49 2022] DELETE /identity/v3/projects/ff3eaa088ad44db68a15ec7bbcfce42a => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:50.073753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd5b59-5d5f-4fc3-8917-85765718f108 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:50.078450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-49cd5b59-5d5f-4fc3-8917-85765718f108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:50.090075 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-87d9b37c-e444-4e4e-9063-be3151001284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc24e95984c44d9fa2a1b7b58fdfc73e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.158780 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-87d9b37c-e444-4e4e-9063-be3151001284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc24e95984c44d9fa2a1b7b58fdfc73e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.162733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-87d9b37c-e444-4e4e-9063-be3151001284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc24e95984c44d9fa2a1b7b58fdfc73e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.165403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-87d9b37c-e444-4e4e-9063-be3151001284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc24e95984c44d9fa2a1b7b58fdfc73e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.227767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1126/2246] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:49 2022] DELETE /identity/v3/users/dc24e95984c44d9fa2a1b7b58fdfc73e => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:50.259793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:50.389229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd5b59-5d5f-4fc3-8917-85765718f108 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:50.583573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a92be1-be53-4d5b-875d-c69c213a8420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:50.584846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a92be1-be53-4d5b-875d-c69c213a8420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:50.585213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a92be1-be53-4d5b-875d-c69c213a8420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:50.586196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a92be1-be53-4d5b-875d-c69c213a8420 admin admin] PATH_INFO: `/v3/users/6c5fbd7bf17944c3850dfcef99c97f2c` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:50.600808 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a92be1-be53-4d5b-875d-c69c213a8420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c5fbd7bf17944c3850dfcef99c97f2c)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:50.609261 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a92be1-be53-4d5b-875d-c69c213a8420 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:50.810503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d8a92be1-be53-4d5b-875d-c69c213a8420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c5fbd7bf17944c3850dfcef99c97f2c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.866393 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d8a92be1-be53-4d5b-875d-c69c213a8420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c5fbd7bf17944c3850dfcef99c97f2c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.888085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d8a92be1-be53-4d5b-875d-c69c213a8420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c5fbd7bf17944c3850dfcef99c97f2c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.889519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d8a92be1-be53-4d5b-875d-c69c213a8420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c5fbd7bf17944c3850dfcef99c97f2c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.921754 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d8a92be1-be53-4d5b-875d-c69c213a8420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c5fbd7bf17944c3850dfcef99c97f2c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.956824 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1121/2247] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:50 2022] DELETE /identity/v3/users/6c5fbd7bf17944c3850dfcef99c97f2c => generated 0 bytes in 885 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:52.504540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9b37c-e444-4e4e-9063-be3151001284 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:52.506908 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-87d9b37c-e444-4e4e-9063-be3151001284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:52.559779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9b37c-e444-4e4e-9063-be3151001284 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:52.681945 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4c7de-073b-4a7e-a4d8-19a0188eee77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:52.683386 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4c7de-073b-4a7e-a4d8-19a0188eee77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:52.684262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4c7de-073b-4a7e-a4d8-19a0188eee77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:52.684823 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4c7de-073b-4a7e-a4d8-19a0188eee77 admin admin] PATH_INFO: `/v3/projects/028a81f4110947388440f7abd1599993` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:52.686735 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4c7de-073b-4a7e-a4d8-19a0188eee77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=028a81f4110947388440f7abd1599993)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:52.689832 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4c7de-073b-4a7e-a4d8-19a0188eee77 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:52.712567 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a92be1-be53-4d5b-875d-c69c213a8420 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:52.718606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d8a92be1-be53-4d5b-875d-c69c213a8420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:52.754940 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a92be1-be53-4d5b-875d-c69c213a8420 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:52.771660 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f822f11-dc88-481d-ada1-8af134c8dd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:52.775704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f822f11-dc88-481d-ada1-8af134c8dd26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:52.776741 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f822f11-dc88-481d-ada1-8af134c8dd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:52.778527 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f822f11-dc88-481d-ada1-8af134c8dd26 admin admin] PATH_INFO: `/v3/projects/0d991e7b9e394e9fa66618839c797f83` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:52.786529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f822f11-dc88-481d-ada1-8af134c8dd26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d991e7b9e394e9fa66618839c797f83)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:52.790523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1fc4c7de-073b-4a7e-a4d8-19a0188eee77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028a81f4110947388440f7abd1599993', 'request_id': 'req-1fc4c7de-073b-4a7e-a4d8-19a0188eee77'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:52.800889 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1fc4c7de-073b-4a7e-a4d8-19a0188eee77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028a81f4110947388440f7abd1599993', 'request_id': 'req-1fc4c7de-073b-4a7e-a4d8-19a0188eee77'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:52.801196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f822f11-dc88-481d-ada1-8af134c8dd26 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:52.811954 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1fc4c7de-073b-4a7e-a4d8-19a0188eee77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028a81f4110947388440f7abd1599993', 'request_id': 'req-1fc4c7de-073b-4a7e-a4d8-19a0188eee77'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:52.825250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:52.838895 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1fc4c7de-073b-4a7e-a4d8-19a0188eee77 admin admin] The token cache is being invalidate because project 028a81f4110947388440f7abd1599993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:52.840749 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1fc4c7de-073b-4a7e-a4d8-19a0188eee77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:52.841769 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1fc4c7de-073b-4a7e-a4d8-19a0188eee77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:52.848751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1127/2248] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:52 2022] DELETE /identity/v3/projects/028a81f4110947388440f7abd1599993 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:52.850920 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899933f0-d96a-4b03-92a6-7c40e6fa6311 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:52.850920 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899933f0-d96a-4b03-92a6-7c40e6fa6311 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:52.851308 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899933f0-d96a-4b03-92a6-7c40e6fa6311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:52.895696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-899933f0-d96a-4b03-92a6-7c40e6fa6311 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:52.897810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-899933f0-d96a-4b03-92a6-7c40e6fa6311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:52.952550 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9f822f11-dc88-481d-ada1-8af134c8dd26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d991e7b9e394e9fa66618839c797f83', 'request_id': 'req-9f822f11-dc88-481d-ada1-8af134c8dd26'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:52.976467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9f822f11-dc88-481d-ada1-8af134c8dd26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d991e7b9e394e9fa66618839c797f83', 'request_id': 'req-9f822f11-dc88-481d-ada1-8af134c8dd26'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:52.980462 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:53.002136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9f822f11-dc88-481d-ada1-8af134c8dd26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d991e7b9e394e9fa66618839c797f83', 'request_id': 'req-9f822f11-dc88-481d-ada1-8af134c8dd26'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:53.006658 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1128/2249] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:53.016437 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166eeee-bd37-48df-9784-1bc7571f2ea1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:53.018363 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166eeee-bd37-48df-9784-1bc7571f2ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:53.018768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166eeee-bd37-48df-9784-1bc7571f2ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:53.037032 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9f822f11-dc88-481d-ada1-8af134c8dd26 admin admin] The token cache is being invalidate because project 0d991e7b9e394e9fa66618839c797f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:53.039267 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9f822f11-dc88-481d-ada1-8af134c8dd26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:53.041381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9f822f11-dc88-481d-ada1-8af134c8dd26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:53.049918 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1122/2250] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:52 2022] DELETE /identity/v3/projects/0d991e7b9e394e9fa66618839c797f83 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:53.052486 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d63168-43a2-4d24-9ba5-c7ab445e6f70 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:53.053205 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d63168-43a2-4d24-9ba5-c7ab445e6f70 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:53.053205 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d63168-43a2-4d24-9ba5-c7ab445e6f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:53.060856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7166eeee-bd37-48df-9784-1bc7571f2ea1 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:53.063381 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7166eeee-bd37-48df-9784-1bc7571f2ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:53.077341 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1129/2251] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:53.089971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-24d63168-43a2-4d24-9ba5-c7ab445e6f70 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:53.091162 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-24d63168-43a2-4d24-9ba5-c7ab445e6f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:53.099929 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166eeee-bd37-48df-9784-1bc7571f2ea1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:53.100972 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1123/2252] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:53.115775 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9b68b-3836-44f0-a355-aee6e024d315 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:53.116141 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9b68b-3836-44f0-a355-aee6e024d315 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:53.116514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9b68b-3836-44f0-a355-aee6e024d315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:53.129900 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166eeee-bd37-48df-9784-1bc7571f2ea1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:53.152467 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43357928-6c9e-4d52-989c-d4164b641c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:53.153110 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43357928-6c9e-4d52-989c-d4164b641c99 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:53.154040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43357928-6c9e-4d52-989c-d4164b641c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:53.154280 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43357928-6c9e-4d52-989c-d4164b641c99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:53.155065 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43357928-6c9e-4d52-989c-d4164b641c99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:53.155437 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43357928-6c9e-4d52-989c-d4164b641c99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:53.157411 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43357928-6c9e-4d52-989c-d4164b641c99 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:53.167494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-75f9b68b-3836-44f0-a355-aee6e024d315 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:53.172524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-75f9b68b-3836-44f0-a355-aee6e024d315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:53.201533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1130/2253] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:53.204703 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1124/2254] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:53.204906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43357928-6c9e-4d52-989c-d4164b641c99 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:53.224202 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9b68b-3836-44f0-a355-aee6e024d315 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:53.251331 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43357928-6c9e-4d52-989c-d4164b641c99 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:53.257155 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc3b9b-df44-498e-b7b4-0a7fa42715ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:53.258411 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc3b9b-df44-498e-b7b4-0a7fa42715ac admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:53.258847 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc3b9b-df44-498e-b7b4-0a7fa42715ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:53.259332 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc3b9b-df44-498e-b7b4-0a7fa42715ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:53.263247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc3b9b-df44-498e-b7b4-0a7fa42715ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:53.263247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc3b9b-df44-498e-b7b4-0a7fa42715ac admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:53.329753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9b68b-3836-44f0-a355-aee6e024d315 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:53.361774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1131/2255] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:53 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:53.367445 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc3b9b-df44-498e-b7b4-0a7fa42715ac admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:53.371124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d4738-aec0-4674-b6bc-b00d10d05fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:53.372008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d4738-aec0-4674-b6bc-b00d10d05fbd admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:53.372476 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d4738-aec0-4674-b6bc-b00d10d05fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:53.372918 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d4738-aec0-4674-b6bc-b00d10d05fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:53.374129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d4738-aec0-4674-b6bc-b00d10d05fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:53.392323 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d4738-aec0-4674-b6bc-b00d10d05fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:53.395602 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d4738-aec0-4674-b6bc-b00d10d05fbd admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:53.465013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1125/2256] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:53.466530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d4738-aec0-4674-b6bc-b00d10d05fbd admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:53.495811 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d4738-aec0-4674-b6bc-b00d10d05fbd admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:53.555407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc3b9b-df44-498e-b7b4-0a7fa42715ac admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:53.572981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f40206-cb61-408e-a554-00fa5d291cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:53.573753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f40206-cb61-408e-a554-00fa5d291cab admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:53.574025 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f40206-cb61-408e-a554-00fa5d291cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:53.574292 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f40206-cb61-408e-a554-00fa5d291cab admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:53.574962 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f40206-cb61-408e-a554-00fa5d291cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:53.585718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f40206-cb61-408e-a554-00fa5d291cab admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:53.626427 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1132/2257] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:53 2022] POST /identity/v3/users => generated 288 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:53.627933 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f0a94-c222-48b1-bc48-ed552c6a7680 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:53.628218 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f0a94-c222-48b1-bc48-ed552c6a7680 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:53.628476 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f0a94-c222-48b1-bc48-ed552c6a7680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:53.691135 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c69f0a94-c222-48b1-bc48-ed552c6a7680 None None] MFA Rules not processed for user `3340cc123b0d4ff089889b133b32815e`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:53.692753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c69f0a94-c222-48b1-bc48-ed552c6a7680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:53.749069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b885c-80b2-4dfc-b7e3-c51803d90416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:53.750193 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b885c-80b2-4dfc-b7e3-c51803d90416 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:53.750954 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b885c-80b2-4dfc-b7e3-c51803d90416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:53.752487 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b885c-80b2-4dfc-b7e3-c51803d90416 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:53.759359 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b885c-80b2-4dfc-b7e3-c51803d90416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:53.773595 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b885c-80b2-4dfc-b7e3-c51803d90416 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:53.788001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:53.831065 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1133/2258] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:53.831065 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f0a94-c222-48b1-bc48-ed552c6a7680 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:53.859604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f0a94-c222-48b1-bc48-ed552c6a7680 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:53.865690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cfc58-e158-470c-8575-e069ef4ec04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:53.866368 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cfc58-e158-470c-8575-e069ef4ec04b admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:53.866525 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cfc58-e158-470c-8575-e069ef4ec04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:53.866776 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cfc58-e158-470c-8575-e069ef4ec04b admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:53.867483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81cfc58-e158-470c-8575-e069ef4ec04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:53.871701 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81cfc58-e158-470c-8575-e069ef4ec04b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:53.882819 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1126/2259] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:53 2022] POST /identity/v3/projects => generated 369 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:53.884419 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b885c-80b2-4dfc-b7e3-c51803d90416 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:53.889054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ee7b885c-80b2-4dfc-b7e3-c51803d90416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:53.914084 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1134/2260] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:53.923301 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cfc58-e158-470c-8575-e069ef4ec04b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:53.947449 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cfc58-e158-470c-8575-e069ef4ec04b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:54.077970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b885c-80b2-4dfc-b7e3-c51803d90416 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:54.087107 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057883a-7249-4359-92d6-3f58137ee06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:54.087985 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92c543-cf97-4f7b-8310-f583adda085b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:54.089038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92c543-cf97-4f7b-8310-f583adda085b admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:54.089574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92c543-cf97-4f7b-8310-f583adda085b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:54.090050 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92c543-cf97-4f7b-8310-f583adda085b admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:54.090629 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057883a-7249-4359-92d6-3f58137ee06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:54.092277 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92c543-cf97-4f7b-8310-f583adda085b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:54.096808 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92c543-cf97-4f7b-8310-f583adda085b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:54.103052 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057883a-7249-4359-92d6-3f58137ee06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:54.103881 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057883a-7249-4359-92d6-3f58137ee06f admin admin] PATH_INFO: `/v3/users/de7b236b37fd4fe9a94b04d55239c115` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:54.106699 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057883a-7249-4359-92d6-3f58137ee06f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de7b236b37fd4fe9a94b04d55239c115)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:54.116836 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057883a-7249-4359-92d6-3f58137ee06f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:54.153010 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1135/2261] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:53 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:54.154294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92c543-cf97-4f7b-8310-f583adda085b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:54.170244 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92c543-cf97-4f7b-8310-f583adda085b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:54.181181 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3edb8-82d2-4f2b-a9c3-9cd6b7b458db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:54.183606 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3edb8-82d2-4f2b-a9c3-9cd6b7b458db admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:54.183949 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3edb8-82d2-4f2b-a9c3-9cd6b7b458db admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:54.184293 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3edb8-82d2-4f2b-a9c3-9cd6b7b458db admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:54.185235 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3edb8-82d2-4f2b-a9c3-9cd6b7b458db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:54.190705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3edb8-82d2-4f2b-a9c3-9cd6b7b458db admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:54.213801 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1136/2262] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:54.214892 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3edb8-82d2-4f2b-a9c3-9cd6b7b458db admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:54.227955 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3edb8-82d2-4f2b-a9c3-9cd6b7b458db admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:54.231979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:54.237452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f143ff1-cda8-4898-813e-c71ca3503636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:54.237809 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2057883a-7249-4359-92d6-3f58137ee06f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de7b236b37fd4fe9a94b04d55239c115'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:54.238498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f143ff1-cda8-4898-813e-c71ca3503636 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:54.239386 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f143ff1-cda8-4898-813e-c71ca3503636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:54.240021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f143ff1-cda8-4898-813e-c71ca3503636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:54.241114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f143ff1-cda8-4898-813e-c71ca3503636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:54.243534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f143ff1-cda8-4898-813e-c71ca3503636 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:54.269036 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1137/2263] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:54.269036 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f143ff1-cda8-4898-813e-c71ca3503636 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:54.271872 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2057883a-7249-4359-92d6-3f58137ee06f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de7b236b37fd4fe9a94b04d55239c115'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:54.290371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f143ff1-cda8-4898-813e-c71ca3503636 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:54.292503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2057883a-7249-4359-92d6-3f58137ee06f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de7b236b37fd4fe9a94b04d55239c115'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:54.293332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2057883a-7249-4359-92d6-3f58137ee06f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de7b236b37fd4fe9a94b04d55239c115'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:54.299258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1608c91-7886-4857-ba53-31abd18a0411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:54.302486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1608c91-7886-4857-ba53-31abd18a0411 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:54.302486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1608c91-7886-4857-ba53-31abd18a0411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:54.302486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1608c91-7886-4857-ba53-31abd18a0411 admin admin] PATH_INFO: `/v3/projects/20fddf2e39774d658b2750b88bc41205/users/fc4a4f6139484ded8dc13d4911e30715/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:54.314478 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2057883a-7249-4359-92d6-3f58137ee06f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de7b236b37fd4fe9a94b04d55239c115'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:54.327642 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1608c91-7886-4857-ba53-31abd18a0411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20fddf2e39774d658b2750b88bc41205, user_id=fc4a4f6139484ded8dc13d4911e30715, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:54.330585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1608c91-7886-4857-ba53-31abd18a0411 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:54.343198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1127/2264] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:53 2022] DELETE /identity/v3/users/de7b236b37fd4fe9a94b04d55239c115 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:54.344654 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057883a-7249-4359-92d6-3f58137ee06f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:54.346527 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2057883a-7249-4359-92d6-3f58137ee06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:54.361582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1138/2265] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:54 2022] PUT /identity/v3/projects/20fddf2e39774d658b2750b88bc41205/users/fc4a4f6139484ded8dc13d4911e30715/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:54.363159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62dee0-a36e-4ae1-8ef2-9caea0478994 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:54.363436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62dee0-a36e-4ae1-8ef2-9caea0478994 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:54.363705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62dee0-a36e-4ae1-8ef2-9caea0478994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:54.411909 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6e62dee0-a36e-4ae1-8ef2-9caea0478994 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:54.414170 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6e62dee0-a36e-4ae1-8ef2-9caea0478994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:54.490391 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057883a-7249-4359-92d6-3f58137ee06f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:54.515900 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1139/2266] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:54.523976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65049940-0e42-47ba-9252-b3a114d86fd6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:54.524341 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65049940-0e42-47ba-9252-b3a114d86fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:54.524790 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65049940-0e42-47ba-9252-b3a114d86fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:54.590976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-65049940-0e42-47ba-9252-b3a114d86fd6 None None] MFA Rules not processed for user `fc4a4f6139484ded8dc13d4911e30715`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:54.593697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-65049940-0e42-47ba-9252-b3a114d86fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:54.612682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:54.619842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250e4c0-8530-41f5-ba85-0dc7add0f197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:54.620734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250e4c0-8530-41f5-ba85-0dc7add0f197 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:54.621027 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250e4c0-8530-41f5-ba85-0dc7add0f197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:54.621300 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250e4c0-8530-41f5-ba85-0dc7add0f197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:54.622061 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250e4c0-8530-41f5-ba85-0dc7add0f197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:54.625181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250e4c0-8530-41f5-ba85-0dc7add0f197 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:54.649540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1128/2267] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:54.649540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250e4c0-8530-41f5-ba85-0dc7add0f197 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:54.657682 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7250e4c0-8530-41f5-ba85-0dc7add0f197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:54.734502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1140/2268] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:54.746199 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65049940-0e42-47ba-9252-b3a114d86fd6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:54.764737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250e4c0-8530-41f5-ba85-0dc7add0f197 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:54.768043 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65049940-0e42-47ba-9252-b3a114d86fd6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:54.771009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628b2a4-17cd-40b8-803b-1280a10418bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:54.771944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628b2a4-17cd-40b8-803b-1280a10418bc service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:54.772384 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628b2a4-17cd-40b8-803b-1280a10418bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:54.772758 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628b2a4-17cd-40b8-803b-1280a10418bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:54.775532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600f80d-f211-4ae0-9705-9ec788508dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:54.776673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600f80d-f211-4ae0-9705-9ec788508dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:54.777022 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600f80d-f211-4ae0-9705-9ec788508dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:54.777532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600f80d-f211-4ae0-9705-9ec788508dcc admin admin] PATH_INFO: `/v3/projects/a8234bfb0fa2491a8eb7237fddb602af/users/9f199d768e94440a9b38709a196b2a66/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:54.787492 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628b2a4-17cd-40b8-803b-1280a10418bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:54.789446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628b2a4-17cd-40b8-803b-1280a10418bc service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:54.803088 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600f80d-f211-4ae0-9705-9ec788508dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8234bfb0fa2491a8eb7237fddb602af, user_id=9f199d768e94440a9b38709a196b2a66, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:54.807105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600f80d-f211-4ae0-9705-9ec788508dcc admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:54.813821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1129/2269] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:54.815295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628b2a4-17cd-40b8-803b-1280a10418bc service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:54.817997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3628b2a4-17cd-40b8-803b-1280a10418bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:54.832209 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:54.853464 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1141/2270] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:54 2022] PUT /identity/v3/projects/a8234bfb0fa2491a8eb7237fddb602af/users/9f199d768e94440a9b38709a196b2a66/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:54.854652 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec0df8-ad23-4e49-ab87-df895a67feed None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:54.854983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec0df8-ad23-4e49-ab87-df895a67feed None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:54.855292 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec0df8-ad23-4e49-ab87-df895a67feed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:54.995809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-fcec0df8-ad23-4e49-ab87-df895a67feed None None] MFA Rules not processed for user `9f199d768e94440a9b38709a196b2a66`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:55.001448 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fcec0df8-ad23-4e49-ab87-df895a67feed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:55.023457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628b2a4-17cd-40b8-803b-1280a10418bc service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:55.246115 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42929cc8-cf0f-4526-93fa-dab8945f3df9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:55.251196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42929cc8-cf0f-4526-93fa-dab8945f3df9 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:55.251627 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42929cc8-cf0f-4526-93fa-dab8945f3df9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:55.251778 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42929cc8-cf0f-4526-93fa-dab8945f3df9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:55.432051 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1142/2271] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 579 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:55.474877 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec0df8-ad23-4e49-ab87-df895a67feed None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:55.483851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fcec0df8-ad23-4e49-ab87-df895a67feed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:55.627223 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42929cc8-cf0f-4526-93fa-dab8945f3df9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:55.632531 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42929cc8-cf0f-4526-93fa-dab8945f3df9 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:55.673349 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1130/2272] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 859 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:55.801278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec0df8-ad23-4e49-ab87-df895a67feed None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:55.822817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4fa15-1e95-447a-926f-1cb60e9545de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47429aec6d8a4339b4ec0fb32b25e90b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:55.823477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4fa15-1e95-447a-926f-1cb60e9545de service glance] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:55.826547 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4fa15-1e95-447a-926f-1cb60e9545de service glance] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:55.826797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4fa15-1e95-447a-926f-1cb60e9545de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:55.886581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4fa15-1e95-447a-926f-1cb60e9545de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:55.889997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4fa15-1e95-447a-926f-1cb60e9545de service glance] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:55.918248 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1143/2273] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:55.950121 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42929cc8-cf0f-4526-93fa-dab8945f3df9 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:55.955915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-42929cc8-cf0f-4526-93fa-dab8945f3df9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:56.176529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42929cc8-cf0f-4526-93fa-dab8945f3df9 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:56.197950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10aab5-f651-47ae-aba7-651e599426b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:56.199980 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10aab5-f651-47ae-aba7-651e599426b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:56.200290 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10aab5-f651-47ae-aba7-651e599426b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:56.200569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10aab5-f651-47ae-aba7-651e599426b5 admin admin] PATH_INFO: `/v3/projects/5784b4c11d8c4276bf1bffee35046e03` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:56.202358 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10aab5-f651-47ae-aba7-651e599426b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5784b4c11d8c4276bf1bffee35046e03)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:56.207250 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10aab5-f651-47ae-aba7-651e599426b5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:56.251499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:56.310759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8d10aab5-f651-47ae-aba7-651e599426b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5784b4c11d8c4276bf1bffee35046e03', 'request_id': 'req-8d10aab5-f651-47ae-aba7-651e599426b5'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:56.323577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8d10aab5-f651-47ae-aba7-651e599426b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5784b4c11d8c4276bf1bffee35046e03', 'request_id': 'req-8d10aab5-f651-47ae-aba7-651e599426b5'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:56.337843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8d10aab5-f651-47ae-aba7-651e599426b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5784b4c11d8c4276bf1bffee35046e03', 'request_id': 'req-8d10aab5-f651-47ae-aba7-651e599426b5'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:56.355898 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8d10aab5-f651-47ae-aba7-651e599426b5 admin admin] The token cache is being invalidate because project 5784b4c11d8c4276bf1bffee35046e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:56.355898 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8d10aab5-f651-47ae-aba7-651e599426b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:56.374511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8d10aab5-f651-47ae-aba7-651e599426b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:56.380403 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1131/2274] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:55 2022] DELETE /identity/v3/projects/5784b4c11d8c4276bf1bffee35046e03 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:56.388257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4fa15-1e95-447a-926f-1cb60e9545de service glance] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:56.408040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4fa15-1e95-447a-926f-1cb60e9545de service glance] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:56.454262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:56.576534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120bf66-a224-479a-99f4-414d44eec745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:56.578736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120bf66-a224-479a-99f4-414d44eec745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:56.579302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120bf66-a224-479a-99f4-414d44eec745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:56.581302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120bf66-a224-479a-99f4-414d44eec745 admin admin] PATH_INFO: `/v3/users/411fe8a118a04f6eb0072f190a9c0317` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:56.585189 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120bf66-a224-479a-99f4-414d44eec745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=411fe8a118a04f6eb0072f190a9c0317)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:56.590298 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120bf66-a224-479a-99f4-414d44eec745 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:56.707995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c120bf66-a224-479a-99f4-414d44eec745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '411fe8a118a04f6eb0072f190a9c0317'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:56.728992 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c120bf66-a224-479a-99f4-414d44eec745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '411fe8a118a04f6eb0072f190a9c0317'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:56.778214 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c120bf66-a224-479a-99f4-414d44eec745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '411fe8a118a04f6eb0072f190a9c0317'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:56.779563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c120bf66-a224-479a-99f4-414d44eec745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '411fe8a118a04f6eb0072f190a9c0317'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:56.780543 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c120bf66-a224-479a-99f4-414d44eec745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '411fe8a118a04f6eb0072f190a9c0317'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:56.818881 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1144/2275] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:56 2022] DELETE /identity/v3/users/411fe8a118a04f6eb0072f190a9c0317 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:57.476925 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496cf20-4d2b-4ab2-bb33-165758c3bc3b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:57.477482 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496cf20-4d2b-4ab2-bb33-165758c3bc3b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:57.477982 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496cf20-4d2b-4ab2-bb33-165758c3bc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:57.514796 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f496cf20-4d2b-4ab2-bb33-165758c3bc3b None None] MFA Rules not processed for user `fc4a4f6139484ded8dc13d4911e30715`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:57.517128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f496cf20-4d2b-4ab2-bb33-165758c3bc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:57.608452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120bf66-a224-479a-99f4-414d44eec745 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:57.610600 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c120bf66-a224-479a-99f4-414d44eec745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:57.614028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1132/2276] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:57.697948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120bf66-a224-479a-99f4-414d44eec745 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:57.702981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fece13-075a-4aaa-bb26-6e7788be6d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:57.703654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fece13-075a-4aaa-bb26-6e7788be6d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:57.703928 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fece13-075a-4aaa-bb26-6e7788be6d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:57.704196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fece13-075a-4aaa-bb26-6e7788be6d5c admin admin] PATH_INFO: `/v3/projects/b65c48856c914e67a9ad2533874ac57b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:57.705562 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fece13-075a-4aaa-bb26-6e7788be6d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b65c48856c914e67a9ad2533874ac57b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:57.707607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fece13-075a-4aaa-bb26-6e7788be6d5c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:57.769755 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:57.782572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-82fece13-075a-4aaa-bb26-6e7788be6d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65c48856c914e67a9ad2533874ac57b', 'request_id': 'req-82fece13-075a-4aaa-bb26-6e7788be6d5c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:57.804898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-82fece13-075a-4aaa-bb26-6e7788be6d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65c48856c914e67a9ad2533874ac57b', 'request_id': 'req-82fece13-075a-4aaa-bb26-6e7788be6d5c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:57.817714 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-82fece13-075a-4aaa-bb26-6e7788be6d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65c48856c914e67a9ad2533874ac57b', 'request_id': 'req-82fece13-075a-4aaa-bb26-6e7788be6d5c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:57.854868 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-82fece13-075a-4aaa-bb26-6e7788be6d5c admin admin] The token cache is being invalidate because project b65c48856c914e67a9ad2533874ac57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:57.855731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-82fece13-075a-4aaa-bb26-6e7788be6d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:57.856522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-82fece13-075a-4aaa-bb26-6e7788be6d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:57.859396 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1145/2277] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:57 2022] DELETE /identity/v3/projects/b65c48856c914e67a9ad2533874ac57b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:57.864394 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496cf20-4d2b-4ab2-bb33-165758c3bc3b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:57.884007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496cf20-4d2b-4ab2-bb33-165758c3bc3b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:58.004109 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ca4e0-d891-4728-85b4-c638339d7f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:58.005434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ca4e0-d891-4728-85b4-c638339d7f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:58.005937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ca4e0-d891-4728-85b4-c638339d7f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:58.006641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ca4e0-d891-4728-85b4-c638339d7f96 admin admin] PATH_INFO: `/v3/users/9dc41ecf1c084158a6c29f284620c24f` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:58.008543 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ca4e0-d891-4728-85b4-c638339d7f96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc41ecf1c084158a6c29f284620c24f)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:58.011768 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ca4e0-d891-4728-85b4-c638339d7f96 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:58.144412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-305ca4e0-d891-4728-85b4-c638339d7f96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc41ecf1c084158a6c29f284620c24f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:58.184862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:58.239979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-305ca4e0-d891-4728-85b4-c638339d7f96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc41ecf1c084158a6c29f284620c24f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:58.277524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-305ca4e0-d891-4728-85b4-c638339d7f96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc41ecf1c084158a6c29f284620c24f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:58.278799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-305ca4e0-d891-4728-85b4-c638339d7f96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc41ecf1c084158a6c29f284620c24f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:58.310683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-305ca4e0-d891-4728-85b4-c638339d7f96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc41ecf1c084158a6c29f284620c24f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:58.349032 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1133/2278] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:57 2022] DELETE /identity/v3/users/9dc41ecf1c084158a6c29f284620c24f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:59.223289 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fece13-075a-4aaa-bb26-6e7788be6d5c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:59.228192 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-82fece13-075a-4aaa-bb26-6e7788be6d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:59.291040 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fece13-075a-4aaa-bb26-6e7788be6d5c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:59.432696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e539cf-e62a-413a-bd8b-3fff767817dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:59.433539 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e539cf-e62a-413a-bd8b-3fff767817dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:59.433854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e539cf-e62a-413a-bd8b-3fff767817dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:59.434186 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e539cf-e62a-413a-bd8b-3fff767817dd admin admin] PATH_INFO: `/v3/projects/20d921e5c1eb41e09ec9a3e73b84d219` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:59.435607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e539cf-e62a-413a-bd8b-3fff767817dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d921e5c1eb41e09ec9a3e73b84d219)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:59.442310 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e539cf-e62a-413a-bd8b-3fff767817dd admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:59.606794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d8e539cf-e62a-413a-bd8b-3fff767817dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d921e5c1eb41e09ec9a3e73b84d219', 'request_id': 'req-d8e539cf-e62a-413a-bd8b-3fff767817dd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:59.640231 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d8e539cf-e62a-413a-bd8b-3fff767817dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d921e5c1eb41e09ec9a3e73b84d219', 'request_id': 'req-d8e539cf-e62a-413a-bd8b-3fff767817dd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:59.661207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d8e539cf-e62a-413a-bd8b-3fff767817dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d921e5c1eb41e09ec9a3e73b84d219', 'request_id': 'req-d8e539cf-e62a-413a-bd8b-3fff767817dd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:59.696326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d8e539cf-e62a-413a-bd8b-3fff767817dd admin admin] The token cache is being invalidate because project 20d921e5c1eb41e09ec9a3e73b84d219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:59.696581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d8e539cf-e62a-413a-bd8b-3fff767817dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:59.705863 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d8e539cf-e62a-413a-bd8b-3fff767817dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:59.705863 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1146/2279] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:59 2022] DELETE /identity/v3/projects/20d921e5c1eb41e09ec9a3e73b84d219 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:59.708723 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99c87b-250d-4706-bcc8-13641d59cf7f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:59.709726 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99c87b-250d-4706-bcc8-13641d59cf7f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:59.709726 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99c87b-250d-4706-bcc8-13641d59cf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:59.779685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-4f99c87b-250d-4706-bcc8-13641d59cf7f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:59.785936 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4f99c87b-250d-4706-bcc8-13641d59cf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:00.051125 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1134/2280] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:00.060270 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614986f9-c747-42da-a623-265f8f5ae38e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:00.060581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614986f9-c747-42da-a623-265f8f5ae38e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:00.060883 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614986f9-c747-42da-a623-265f8f5ae38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:00.101338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-614986f9-c747-42da-a623-265f8f5ae38e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:00.103448 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-614986f9-c747-42da-a623-265f8f5ae38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:00.121242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1147/2281] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:33:00.127497 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99c87b-250d-4706-bcc8-13641d59cf7f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:00.145604 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99c87b-250d-4706-bcc8-13641d59cf7f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:00.170383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed52e97-27bc-4f4d-ab95-95dada698b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:00.171958 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed52e97-27bc-4f4d-ab95-95dada698b9e admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:00.172403 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed52e97-27bc-4f4d-ab95-95dada698b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:00.172821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed52e97-27bc-4f4d-ab95-95dada698b9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:00.173995 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed52e97-27bc-4f4d-ab95-95dada698b9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:33:00.174750 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed52e97-27bc-4f4d-ab95-95dada698b9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:00.178071 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed52e97-27bc-4f4d-ab95-95dada698b9e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:00.221520 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1135/2282] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:33:00.227970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614986f9-c747-42da-a623-265f8f5ae38e None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:00.245466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614986f9-c747-42da-a623-265f8f5ae38e None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:00.256830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666f981-25e9-487d-8050-9ed18b25b868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:00.258083 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666f981-25e9-487d-8050-9ed18b25b868 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:00.258690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666f981-25e9-487d-8050-9ed18b25b868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:00.259352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666f981-25e9-487d-8050-9ed18b25b868 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:00.260708 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666f981-25e9-487d-8050-9ed18b25b868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:00.264424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666f981-25e9-487d-8050-9ed18b25b868 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:00.407568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1148/2283] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:00 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:33:00.415035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed52e97-27bc-4f4d-ab95-95dada698b9e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:00.438122 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed52e97-27bc-4f4d-ab95-95dada698b9e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:00.568727 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c51f2b-90d6-4f62-af2a-8b35502b50ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:00.570652 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c51f2b-90d6-4f62-af2a-8b35502b50ac admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:00.570652 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c51f2b-90d6-4f62-af2a-8b35502b50ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:00.570652 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c51f2b-90d6-4f62-af2a-8b35502b50ac admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:00.571271 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c51f2b-90d6-4f62-af2a-8b35502b50ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:00.574086 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c51f2b-90d6-4f62-af2a-8b35502b50ac admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:00.611861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1136/2284] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:00 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:33:00.617638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666f981-25e9-487d-8050-9ed18b25b868 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:00.637133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666f981-25e9-487d-8050-9ed18b25b868 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:00.657179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbad6c-f931-465e-9acb-0021fa5ce5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:00.658823 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbad6c-f931-465e-9acb-0021fa5ce5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:00.659444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbad6c-f931-465e-9acb-0021fa5ce5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:00.660033 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbad6c-f931-465e-9acb-0021fa5ce5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:00.661426 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbad6c-f931-465e-9acb-0021fa5ce5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:00.665611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbad6c-f931-465e-9acb-0021fa5ce5a3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:00.687982 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1149/2285] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:00.693641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c51f2b-90d6-4f62-af2a-8b35502b50ac admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:00.725692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c51f2b-90d6-4f62-af2a-8b35502b50ac admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:00.735319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e7dfc-e203-401a-a9fc-edf39a4d07b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:00.736328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e7dfc-e203-401a-a9fc-edf39a4d07b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:00.736757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e7dfc-e203-401a-a9fc-edf39a4d07b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:00.737241 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e7dfc-e203-401a-a9fc-edf39a4d07b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:00.738422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e7dfc-e203-401a-a9fc-edf39a4d07b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:00.741493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e7dfc-e203-401a-a9fc-edf39a4d07b3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:00.772883 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1137/2286] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:00.774583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbad6c-f931-465e-9acb-0021fa5ce5a3 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:00.792871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbad6c-f931-465e-9acb-0021fa5ce5a3 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:00.803344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5eed6-0a98-4860-b5cf-9a0f60041a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:00.804214 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5eed6-0a98-4860-b5cf-9a0f60041a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:00.804525 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5eed6-0a98-4860-b5cf-9a0f60041a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:00.804808 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5eed6-0a98-4860-b5cf-9a0f60041a13 admin admin] PATH_INFO: `/v3/projects/d8dca4d9e351481bbd6f3f6c540ca54c/users/b8e37363fa2e414faa1cf0ea75d97fd5/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:00.841118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5eed6-0a98-4860-b5cf-9a0f60041a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8dca4d9e351481bbd6f3f6c540ca54c, user_id=b8e37363fa2e414faa1cf0ea75d97fd5, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:00.846763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5eed6-0a98-4860-b5cf-9a0f60041a13 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:00.852996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:00.892217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1150/2287] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:00 2022] PUT /identity/v3/projects/d8dca4d9e351481bbd6f3f6c540ca54c/users/b8e37363fa2e414faa1cf0ea75d97fd5/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:00.899552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4f4b7-51cb-432b-bae0-bd99d658294a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:00.900495 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4f4b7-51cb-432b-bae0-bd99d658294a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:00.900916 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4f4b7-51cb-432b-bae0-bd99d658294a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:00.996436 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6bc4f4b7-51cb-432b-bae0-bd99d658294a None None] MFA Rules not processed for user `b8e37363fa2e414faa1cf0ea75d97fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:01.001554 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6bc4f4b7-51cb-432b-bae0-bd99d658294a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:01.046491 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:01.131662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1138/2288] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:33:01.157132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5eed6-0a98-4860-b5cf-9a0f60041a13 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:01.159169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bbf5eed6-0a98-4860-b5cf-9a0f60041a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:01.280994 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5eed6-0a98-4860-b5cf-9a0f60041a13 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:01.286411 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dd894-d943-4897-ba66-64f054159c90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:01.287522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dd894-d943-4897-ba66-64f054159c90 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:01.288004 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dd894-d943-4897-ba66-64f054159c90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:01.288486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dd894-d943-4897-ba66-64f054159c90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:01.317885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411dd894-d943-4897-ba66-64f054159c90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:01.320206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411dd894-d943-4897-ba66-64f054159c90 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:01.348115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1151/2289] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:01.395527 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4f4b7-51cb-432b-bae0-bd99d658294a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:01.632688 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4f4b7-51cb-432b-bae0-bd99d658294a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:01.651720 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02534c-6049-400f-9780-bf074f78b9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:01.652721 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02534c-6049-400f-9780-bf074f78b9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:01.653083 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02534c-6049-400f-9780-bf074f78b9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:01.653384 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02534c-6049-400f-9780-bf074f78b9d0 admin admin] PATH_INFO: `/v3/users/b8e37363fa2e414faa1cf0ea75d97fd5` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:01.656160 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02534c-6049-400f-9780-bf074f78b9d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e37363fa2e414faa1cf0ea75d97fd5)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:01.677926 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02534c-6049-400f-9780-bf074f78b9d0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:01.880559 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3f02534c-6049-400f-9780-bf074f78b9d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e37363fa2e414faa1cf0ea75d97fd5'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:01.950941 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3f02534c-6049-400f-9780-bf074f78b9d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e37363fa2e414faa1cf0ea75d97fd5'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:01.992569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3f02534c-6049-400f-9780-bf074f78b9d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e37363fa2e414faa1cf0ea75d97fd5'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:01.994377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3f02534c-6049-400f-9780-bf074f78b9d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e37363fa2e414faa1cf0ea75d97fd5'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:02.011807 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3f02534c-6049-400f-9780-bf074f78b9d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e37363fa2e414faa1cf0ea75d97fd5'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:02.026750 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1139/2290] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:01 2022] DELETE /identity/v3/users/b8e37363fa2e414faa1cf0ea75d97fd5 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:02.032608 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca55ba-4029-4a3e-a5db-91f6e2a0b02c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:02.032894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca55ba-4029-4a3e-a5db-91f6e2a0b02c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:02.033168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca55ba-4029-4a3e-a5db-91f6e2a0b02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:02.055997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-39ca55ba-4029-4a3e-a5db-91f6e2a0b02c None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:02.057600 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-39ca55ba-4029-4a3e-a5db-91f6e2a0b02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:02.208975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1152/2291] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:02.224034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02534c-6049-400f-9780-bf074f78b9d0 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:02.226365 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3f02534c-6049-400f-9780-bf074f78b9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:02.326454 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:02.332905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02534c-6049-400f-9780-bf074f78b9d0 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:02.347944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f215429-274f-4de7-a21c-e73d494093c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:02.349276 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f215429-274f-4de7-a21c-e73d494093c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:02.349624 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f215429-274f-4de7-a21c-e73d494093c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:02.350106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f215429-274f-4de7-a21c-e73d494093c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:02.363626 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f215429-274f-4de7-a21c-e73d494093c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:02.365242 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f215429-274f-4de7-a21c-e73d494093c1 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:02.386087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1140/2292] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:03.001616 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca55ba-4029-4a3e-a5db-91f6e2a0b02c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:03.005105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-39ca55ba-4029-4a3e-a5db-91f6e2a0b02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:03.042642 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca55ba-4029-4a3e-a5db-91f6e2a0b02c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:03.049833 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6fae8-6548-4742-92f6-6a072eb7706c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:03.051058 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6fae8-6548-4742-92f6-6a072eb7706c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:03.051714 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6fae8-6548-4742-92f6-6a072eb7706c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:03.052228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6fae8-6548-4742-92f6-6a072eb7706c admin admin] PATH_INFO: `/v3/projects/d8dca4d9e351481bbd6f3f6c540ca54c` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:03.054449 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6fae8-6548-4742-92f6-6a072eb7706c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8dca4d9e351481bbd6f3f6c540ca54c)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:03.057017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6fae8-6548-4742-92f6-6a072eb7706c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:03.134844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69b6fae8-6548-4742-92f6-6a072eb7706c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8dca4d9e351481bbd6f3f6c540ca54c', 'request_id': 'req-69b6fae8-6548-4742-92f6-6a072eb7706c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.151640 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69b6fae8-6548-4742-92f6-6a072eb7706c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8dca4d9e351481bbd6f3f6c540ca54c', 'request_id': 'req-69b6fae8-6548-4742-92f6-6a072eb7706c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.167239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69b6fae8-6548-4742-92f6-6a072eb7706c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8dca4d9e351481bbd6f3f6c540ca54c', 'request_id': 'req-69b6fae8-6548-4742-92f6-6a072eb7706c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.201614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69b6fae8-6548-4742-92f6-6a072eb7706c admin admin] The token cache is being invalidate because project d8dca4d9e351481bbd6f3f6c540ca54c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:03.202283 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69b6fae8-6548-4742-92f6-6a072eb7706c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.203427 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69b6fae8-6548-4742-92f6-6a072eb7706c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:03.206870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1153/2293] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:02 2022] DELETE /identity/v3/projects/d8dca4d9e351481bbd6f3f6c540ca54c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:03.215862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f50d4-9cbe-4f05-99b6-256c4379dc54 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:03.216624 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f50d4-9cbe-4f05-99b6-256c4379dc54 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:03.217109 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f50d4-9cbe-4f05-99b6-256c4379dc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:03.290850 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-2e0f50d4-9cbe-4f05-99b6-256c4379dc54 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:03.293342 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2e0f50d4-9cbe-4f05-99b6-256c4379dc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:03.440759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1141/2294] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:03.452819 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016b1a3-3732-4140-8b0c-a7122b1b31a8 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:03.453712 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016b1a3-3732-4140-8b0c-a7122b1b31a8 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:03.454166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016b1a3-3732-4140-8b0c-a7122b1b31a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:03.519312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5016b1a3-3732-4140-8b0c-a7122b1b31a8 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:03.523291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5016b1a3-3732-4140-8b0c-a7122b1b31a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:03.564306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1154/2295] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:03.570664 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f50d4-9cbe-4f05-99b6-256c4379dc54 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:03.593111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f50d4-9cbe-4f05-99b6-256c4379dc54 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:03.614023 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1081e5-22d3-4038-8183-a05e2afd2a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:03.615835 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1081e5-22d3-4038-8183-a05e2afd2a69 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:03.616805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1081e5-22d3-4038-8183-a05e2afd2a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:03.619370 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1081e5-22d3-4038-8183-a05e2afd2a69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:03.620907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1081e5-22d3-4038-8183-a05e2afd2a69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:33:03.629409 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1081e5-22d3-4038-8183-a05e2afd2a69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:03.629409 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1081e5-22d3-4038-8183-a05e2afd2a69 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:03.648162 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1142/2296] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:33:03.653941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016b1a3-3732-4140-8b0c-a7122b1b31a8 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:03.677621 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016b1a3-3732-4140-8b0c-a7122b1b31a8 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:03.696328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c61e3-41c5-4792-87fa-e103ae55b000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:03.697813 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c61e3-41c5-4792-87fa-e103ae55b000 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:03.698287 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c61e3-41c5-4792-87fa-e103ae55b000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:03.698752 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c61e3-41c5-4792-87fa-e103ae55b000 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:03.705929 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c61e3-41c5-4792-87fa-e103ae55b000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:03.718689 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c61e3-41c5-4792-87fa-e103ae55b000 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:03.793532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:03.832738 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1155/2297] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:03 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:03.833410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1081e5-22d3-4038-8183-a05e2afd2a69 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:03.847603 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1081e5-22d3-4038-8183-a05e2afd2a69 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:03.989180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdd606-bf57-4182-8b8a-1ab2ec5b76e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:03.990489 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdd606-bf57-4182-8b8a-1ab2ec5b76e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:03.991244 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdd606-bf57-4182-8b8a-1ab2ec5b76e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:03.991688 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdd606-bf57-4182-8b8a-1ab2ec5b76e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:03.993034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdd606-bf57-4182-8b8a-1ab2ec5b76e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.007362 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdd606-bf57-4182-8b8a-1ab2ec5b76e6 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.083075 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c61e3-41c5-4792-87fa-e103ae55b000 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:04.094108 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1143/2298] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:03 2022] POST /identity/v3/users => generated 288 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:04.100711 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c61e3-41c5-4792-87fa-e103ae55b000 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:04.110550 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79b2a5-347c-4a73-92bd-d6655c09662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:04.115721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79b2a5-347c-4a73-92bd-d6655c09662e admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.116364 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79b2a5-347c-4a73-92bd-d6655c09662e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.116860 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79b2a5-347c-4a73-92bd-d6655c09662e admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.117883 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79b2a5-347c-4a73-92bd-d6655c09662e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.120794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79b2a5-347c-4a73-92bd-d6655c09662e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.144053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1156/2299] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:04.146401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdd606-bf57-4182-8b8a-1ab2ec5b76e6 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:04.178738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdd606-bf57-4182-8b8a-1ab2ec5b76e6 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:04.206067 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47305a8-d66b-4030-9a19-22a278993fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:04.206935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47305a8-d66b-4030-9a19-22a278993fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.207296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47305a8-d66b-4030-9a19-22a278993fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.207643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47305a8-d66b-4030-9a19-22a278993fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.208425 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47305a8-d66b-4030-9a19-22a278993fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.210280 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47305a8-d66b-4030-9a19-22a278993fa1 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.242065 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1144/2300] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:04.248118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79b2a5-347c-4a73-92bd-d6655c09662e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:04.265175 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79b2a5-347c-4a73-92bd-d6655c09662e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:04.272258 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e651d11-2051-4d88-a26b-c6d9a3d3675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:04.273341 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e651d11-2051-4d88-a26b-c6d9a3d3675a admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.273665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e651d11-2051-4d88-a26b-c6d9a3d3675a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.273932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e651d11-2051-4d88-a26b-c6d9a3d3675a admin admin] PATH_INFO: `/v3/projects/a4730003fc4c467cb4606dfbd463adda/users/28eba4ca76e34677a225aaadd9566bdb/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.297553 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e651d11-2051-4d88-a26b-c6d9a3d3675a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4730003fc4c467cb4606dfbd463adda, user_id=28eba4ca76e34677a225aaadd9566bdb, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.301068 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e651d11-2051-4d88-a26b-c6d9a3d3675a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.322889 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1157/2301] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:04 2022] PUT /identity/v3/projects/a4730003fc4c467cb4606dfbd463adda/users/28eba4ca76e34677a225aaadd9566bdb/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:04.345108 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de205f-8044-4510-985c-548533139fc3 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.352554 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de205f-8044-4510-985c-548533139fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.352759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de205f-8044-4510-985c-548533139fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.411042 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-30de205f-8044-4510-985c-548533139fc3 None None] MFA Rules not processed for user `28eba4ca76e34677a225aaadd9566bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:04.413676 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-30de205f-8044-4510-985c-548533139fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:04.480877 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:04.513396 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1145/2302] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:04.526459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e651d11-2051-4d88-a26b-c6d9a3d3675a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:04.528606 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1e651d11-2051-4d88-a26b-c6d9a3d3675a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:04.621319 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e651d11-2051-4d88-a26b-c6d9a3d3675a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:04.626446 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17a009-237a-41fe-946d-853af7883ae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:04.627411 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17a009-237a-41fe-946d-853af7883ae3 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:04.627822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17a009-237a-41fe-946d-853af7883ae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:04.628242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17a009-237a-41fe-946d-853af7883ae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:04.640307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17a009-237a-41fe-946d-853af7883ae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:04.641879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17a009-237a-41fe-946d-853af7883ae3 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:04.662008 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1158/2303] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:07.552683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1531c4-7c99-4a31-bfd7-c59c7ebb51e8 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:07.553234 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1531c4-7c99-4a31-bfd7-c59c7ebb51e8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:07.553449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1531c4-7c99-4a31-bfd7-c59c7ebb51e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:07.576045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-2d1531c4-7c99-4a31-bfd7-c59c7ebb51e8 None None] MFA Rules not processed for user `960befc2f96b4565b9a99026d906f3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:07.577510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2d1531c4-7c99-4a31-bfd7-c59c7ebb51e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:07.646858 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1146/2304] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:14.650240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:16.944868 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17a009-237a-41fe-946d-853af7883ae3 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:17.201062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17a009-237a-41fe-946d-853af7883ae3 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:17.207251 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ebd6a-04b1-44cc-b74d-7976ed83729a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:17.208520 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ebd6a-04b1-44cc-b74d-7976ed83729a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:17.209063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ebd6a-04b1-44cc-b74d-7976ed83729a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:17.209677 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ebd6a-04b1-44cc-b74d-7976ed83729a admin admin] PATH_INFO: `/v3/users/28eba4ca76e34677a225aaadd9566bdb` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:17.211774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ebd6a-04b1-44cc-b74d-7976ed83729a admin admin] RBAC: Authorizing `identity:delete_user(user_id=28eba4ca76e34677a225aaadd9566bdb)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:17.215547 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ebd6a-04b1-44cc-b74d-7976ed83729a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:17.341645 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e89ebd6a-04b1-44cc-b74d-7976ed83729a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28eba4ca76e34677a225aaadd9566bdb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:17.366580 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e89ebd6a-04b1-44cc-b74d-7976ed83729a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28eba4ca76e34677a225aaadd9566bdb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:17.398363 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e89ebd6a-04b1-44cc-b74d-7976ed83729a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28eba4ca76e34677a225aaadd9566bdb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:17.400604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e89ebd6a-04b1-44cc-b74d-7976ed83729a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28eba4ca76e34677a225aaadd9566bdb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:17.402644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e89ebd6a-04b1-44cc-b74d-7976ed83729a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28eba4ca76e34677a225aaadd9566bdb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:17.431008 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1159/2305] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:16 2022] DELETE /identity/v3/users/28eba4ca76e34677a225aaadd9566bdb => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:17.436521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc3f45-0e71-4182-9a4b-f3e87021b7d1 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:17.437465 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc3f45-0e71-4182-9a4b-f3e87021b7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:17.437465 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc3f45-0e71-4182-9a4b-f3e87021b7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:17.464087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-affc3f45-0e71-4182-9a4b-f3e87021b7d1 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:17.465522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-affc3f45-0e71-4182-9a4b-f3e87021b7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:17.605241 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1147/2306] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:33:17.621902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ebd6a-04b1-44cc-b74d-7976ed83729a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:17.624500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e89ebd6a-04b1-44cc-b74d-7976ed83729a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:17.733653 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ebd6a-04b1-44cc-b74d-7976ed83729a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:17.738108 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3048f64-fee3-4a2c-b921-b4ee91ae12ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:17.738909 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3048f64-fee3-4a2c-b921-b4ee91ae12ec service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:17.739307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3048f64-fee3-4a2c-b921-b4ee91ae12ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:17.739761 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3048f64-fee3-4a2c-b921-b4ee91ae12ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:17.754015 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3048f64-fee3-4a2c-b921-b4ee91ae12ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:17.755521 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3048f64-fee3-4a2c-b921-b4ee91ae12ec service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:17.770785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1160/2307] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:33:18.676672 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc3f45-0e71-4182-9a4b-f3e87021b7d1 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:18.683170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-affc3f45-0e71-4182-9a4b-f3e87021b7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:18.722283 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc3f45-0e71-4182-9a4b-f3e87021b7d1 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:18.733573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782ca04-a823-4c50-a384-529c87a3d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:18.735914 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782ca04-a823-4c50-a384-529c87a3d313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:18.736407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782ca04-a823-4c50-a384-529c87a3d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:18.736898 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782ca04-a823-4c50-a384-529c87a3d313 admin admin] PATH_INFO: `/v3/projects/a4730003fc4c467cb4606dfbd463adda` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:18.739402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782ca04-a823-4c50-a384-529c87a3d313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4730003fc4c467cb4606dfbd463adda)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:18.743498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782ca04-a823-4c50-a384-529c87a3d313 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:18.855062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0782ca04-a823-4c50-a384-529c87a3d313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4730003fc4c467cb4606dfbd463adda', 'request_id': 'req-0782ca04-a823-4c50-a384-529c87a3d313'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:18.869555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0782ca04-a823-4c50-a384-529c87a3d313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4730003fc4c467cb4606dfbd463adda', 'request_id': 'req-0782ca04-a823-4c50-a384-529c87a3d313'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:18.879530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0782ca04-a823-4c50-a384-529c87a3d313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4730003fc4c467cb4606dfbd463adda', 'request_id': 'req-0782ca04-a823-4c50-a384-529c87a3d313'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:18.902495 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0782ca04-a823-4c50-a384-529c87a3d313 admin admin] The token cache is being invalidate because project a4730003fc4c467cb4606dfbd463adda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:18.907769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0782ca04-a823-4c50-a384-529c87a3d313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:18.908627 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0782ca04-a823-4c50-a384-529c87a3d313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:18.910785 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1148/2308] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:18 2022] DELETE /identity/v3/projects/a4730003fc4c467cb4606dfbd463adda => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:27.763244 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:28.897960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:29.103710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e64cb-a5a7-4663-baf2-348de3edba34 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:29.104358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e64cb-a5a7-4663-baf2-348de3edba34 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:29.104358 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e64cb-a5a7-4663-baf2-348de3edba34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:29.129671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e44e64cb-a5a7-4663-baf2-348de3edba34 None None] MFA Rules not processed for user `0327aa38835f41a7a82802f9cad2e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:29.130982 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e44e64cb-a5a7-4663-baf2-348de3edba34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:29.231828 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1161/2309] 10.222.0.52 () {58 vars in 1009 bytes} [Mon Aug 29 20:33:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:29.297660 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782ca04-a823-4c50-a384-529c87a3d313 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:29.299391 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0782ca04-a823-4c50-a384-529c87a3d313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:29.403808 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782ca04-a823-4c50-a384-529c87a3d313 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:29.416229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2e403-f9d0-460a-8fcc-4cff8d643b6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9791ea73d46b191ad9fc146297565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:29.416901 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2e403-f9d0-460a-8fcc-4cff8d643b6a service swift] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:29.417174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2e403-f9d0-460a-8fcc-4cff8d643b6a service swift] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:29.417749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2e403-f9d0-460a-8fcc-4cff8d643b6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:29.428966 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2e403-f9d0-460a-8fcc-4cff8d643b6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:29.430790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2e403-f9d0-460a-8fcc-4cff8d643b6a service swift] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:29.445814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1149/2310] 10.222.0.52 () {60 vars in 1384 bytes} [Mon Aug 29 20:33:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:33:29.726599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e64cb-a5a7-4663-baf2-348de3edba34 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:29.728206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e44e64cb-a5a7-4663-baf2-348de3edba34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:29.914575 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e64cb-a5a7-4663-baf2-348de3edba34 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:29.928412 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40d860-ac79-4ec2-8711-99fc81f9a366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:29.929197 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40d860-ac79-4ec2-8711-99fc81f9a366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:29.932611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40d860-ac79-4ec2-8711-99fc81f9a366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:29.932611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40d860-ac79-4ec2-8711-99fc81f9a366 admin admin] PATH_INFO: `/v3/users/8ed6af21302d4b8c9998cee0c316b8cf` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:29.934685 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40d860-ac79-4ec2-8711-99fc81f9a366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed6af21302d4b8c9998cee0c316b8cf)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:29.936838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40d860-ac79-4ec2-8711-99fc81f9a366 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:30.081928 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1b40d860-ac79-4ec2-8711-99fc81f9a366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed6af21302d4b8c9998cee0c316b8cf'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:30.104094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1b40d860-ac79-4ec2-8711-99fc81f9a366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed6af21302d4b8c9998cee0c316b8cf'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:30.148300 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1b40d860-ac79-4ec2-8711-99fc81f9a366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed6af21302d4b8c9998cee0c316b8cf'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:30.149179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1b40d860-ac79-4ec2-8711-99fc81f9a366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed6af21302d4b8c9998cee0c316b8cf'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:30.150081 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1b40d860-ac79-4ec2-8711-99fc81f9a366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed6af21302d4b8c9998cee0c316b8cf'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:30.219876 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1162/2311] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:29 2022] DELETE /identity/v3/users/8ed6af21302d4b8c9998cee0c316b8cf => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:33:30.222012 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a582878-00cf-4253-93b0-0cdba11384fd None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:30.222489 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a582878-00cf-4253-93b0-0cdba11384fd None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:30.222968 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a582878-00cf-4253-93b0-0cdba11384fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:30.277122 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1a582878-00cf-4253-93b0-0cdba11384fd None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:30.279303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1a582878-00cf-4253-93b0-0cdba11384fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:30.406523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1150/2312] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:30.418670 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40d860-ac79-4ec2-8711-99fc81f9a366 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:30.421224 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1b40d860-ac79-4ec2-8711-99fc81f9a366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:30.458390 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:30.510660 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40d860-ac79-4ec2-8711-99fc81f9a366 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:30.516660 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5dd39-5124-49d9-87d9-c8845902ade8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:30.517809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5dd39-5124-49d9-87d9-c8845902ade8 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:30.518313 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5dd39-5124-49d9-87d9-c8845902ade8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:30.518809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5dd39-5124-49d9-87d9-c8845902ade8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:30.539043 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5dd39-5124-49d9-87d9-c8845902ade8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:30.540871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5dd39-5124-49d9-87d9-c8845902ade8 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:30.560133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1163/2313] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:30.573514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb782ae-d3f9-4b86-a4b2-7ccf716a2c2d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:30.573959 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb782ae-d3f9-4b86-a4b2-7ccf716a2c2d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:30.574316 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb782ae-d3f9-4b86-a4b2-7ccf716a2c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:30.606122 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-9eb782ae-d3f9-4b86-a4b2-7ccf716a2c2d None None] MFA Rules not processed for user `0327aa38835f41a7a82802f9cad2e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:30.608667 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9eb782ae-d3f9-4b86-a4b2-7ccf716a2c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:30.719757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1151/2314] 10.222.0.52 () {58 vars in 967 bytes} [Mon Aug 29 20:33:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:30.739019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5dd39-5124-49d9-87d9-c8845902ade8 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:30.743941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-43f5dd39-5124-49d9-87d9-c8845902ade8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:30.870407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5dd39-5124-49d9-87d9-c8845902ade8 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:30.888025 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bdf3e-d6a9-4c25-9f0e-f5a4085ea066 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9791ea73d46b191ad9fc146297565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:30.889219 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bdf3e-d6a9-4c25-9f0e-f5a4085ea066 service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:30.889219 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bdf3e-d6a9-4c25-9f0e-f5a4085ea066 service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:30.889573 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bdf3e-d6a9-4c25-9f0e-f5a4085ea066 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:30.903650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bdf3e-d6a9-4c25-9f0e-f5a4085ea066 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:30.906183 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bdf3e-d6a9-4c25-9f0e-f5a4085ea066 service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:30.920513 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1164/2315] 10.222.0.52 () {60 vars in 1384 bytes} [Mon Aug 29 20:33:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:33:31.080916 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb782ae-d3f9-4b86-a4b2-7ccf716a2c2d None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:31.084118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9eb782ae-d3f9-4b86-a4b2-7ccf716a2c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:31.115425 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb782ae-d3f9-4b86-a4b2-7ccf716a2c2d None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:31.124114 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d304bec-8eb2-44e7-9e78-0093601c33b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:31.125515 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d304bec-8eb2-44e7-9e78-0093601c33b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:31.126063 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d304bec-8eb2-44e7-9e78-0093601c33b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:31.127549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d304bec-8eb2-44e7-9e78-0093601c33b9 admin admin] PATH_INFO: `/v3/projects/9ff1ddc7d2974cbc84f2e8098f6f5fec` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:31.129182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d304bec-8eb2-44e7-9e78-0093601c33b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ff1ddc7d2974cbc84f2e8098f6f5fec)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:31.132042 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d304bec-8eb2-44e7-9e78-0093601c33b9 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:31.212811 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:31.242667 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9d304bec-8eb2-44e7-9e78-0093601c33b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ff1ddc7d2974cbc84f2e8098f6f5fec', 'request_id': 'req-9d304bec-8eb2-44e7-9e78-0093601c33b9'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:31.257256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9d304bec-8eb2-44e7-9e78-0093601c33b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ff1ddc7d2974cbc84f2e8098f6f5fec', 'request_id': 'req-9d304bec-8eb2-44e7-9e78-0093601c33b9'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:31.280390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9d304bec-8eb2-44e7-9e78-0093601c33b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ff1ddc7d2974cbc84f2e8098f6f5fec', 'request_id': 'req-9d304bec-8eb2-44e7-9e78-0093601c33b9'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:31.310882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9d304bec-8eb2-44e7-9e78-0093601c33b9 admin admin] The token cache is being invalidate because project 9ff1ddc7d2974cbc84f2e8098f6f5fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:31.311187 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9d304bec-8eb2-44e7-9e78-0093601c33b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:31.311979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9d304bec-8eb2-44e7-9e78-0093601c33b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:31.313581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1152/2316] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:31 2022] DELETE /identity/v3/projects/9ff1ddc7d2974cbc84f2e8098f6f5fec => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:31.325188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef55ca-d38e-4af9-8797-2c341a7a90fa None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:31.325717 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef55ca-d38e-4af9-8797-2c341a7a90fa None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:31.335949 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef55ca-d38e-4af9-8797-2c341a7a90fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:31.370666 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c3ef55ca-d38e-4af9-8797-2c341a7a90fa None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:31.372087 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c3ef55ca-d38e-4af9-8797-2c341a7a90fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:31.428421 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40ac7d-3f2a-4594-96a3-a91b398cc094 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:31.428878 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40ac7d-3f2a-4594-96a3-a91b398cc094 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:31.430596 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40ac7d-3f2a-4594-96a3-a91b398cc094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:31.482855 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ba40ac7d-3f2a-4594-96a3-a91b398cc094 None None] MFA Rules not processed for user `0327aa38835f41a7a82802f9cad2e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:31.486767 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ba40ac7d-3f2a-4594-96a3-a91b398cc094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:31.538979 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1165/2317] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:31.549330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e68393-2e5e-4fc8-aecc-9aa5a0cbcde6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:31.549552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e68393-2e5e-4fc8-aecc-9aa5a0cbcde6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:31.549820 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e68393-2e5e-4fc8-aecc-9aa5a0cbcde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:31.603684 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-51e68393-2e5e-4fc8-aecc-9aa5a0cbcde6 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:31.607568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-51e68393-2e5e-4fc8-aecc-9aa5a0cbcde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:31.635769 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1166/2318] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:31.640447 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e68393-2e5e-4fc8-aecc-9aa5a0cbcde6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:31.660852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e68393-2e5e-4fc8-aecc-9aa5a0cbcde6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:31.678420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21994326-cfcb-4386-94c3-90a31a7d1b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:31.679384 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21994326-cfcb-4386-94c3-90a31a7d1b7d admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:31.679885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21994326-cfcb-4386-94c3-90a31a7d1b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:31.680569 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21994326-cfcb-4386-94c3-90a31a7d1b7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:31.681776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1153/2319] 10.222.0.52 () {58 vars in 1009 bytes} [Mon Aug 29 20:33:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:31.682307 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21994326-cfcb-4386-94c3-90a31a7d1b7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:33:31.682872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21994326-cfcb-4386-94c3-90a31a7d1b7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:31.685166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21994326-cfcb-4386-94c3-90a31a7d1b7d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:31.702412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40ac7d-3f2a-4594-96a3-a91b398cc094 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:31.707344 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ba40ac7d-3f2a-4594-96a3-a91b398cc094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:31.714094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1167/2320] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:33:31.718336 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21994326-cfcb-4386-94c3-90a31a7d1b7d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:31.732740 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21994326-cfcb-4386-94c3-90a31a7d1b7d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:31.738372 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e2e0e-5b31-463b-9f28-329516c2e8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:31.739004 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2e0e-5b31-463b-9f28-329516c2e8af admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:31.739291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2e0e-5b31-463b-9f28-329516c2e8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:31.739751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2e0e-5b31-463b-9f28-329516c2e8af admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:31.740534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e2e0e-5b31-463b-9f28-329516c2e8af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:31.742698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e2e0e-5b31-463b-9f28-329516c2e8af admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:31.802707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1168/2321] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:31 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:31.812201 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e2e0e-5b31-463b-9f28-329516c2e8af admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:31.848053 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:31.891333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40ac7d-3f2a-4594-96a3-a91b398cc094 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:31.939681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e2e0e-5b31-463b-9f28-329516c2e8af admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:31.951518 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ce7f0-3c92-4cc2-a54e-4273667e5b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:31.967009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ce7f0-3c92-4cc2-a54e-4273667e5b10 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:31.967767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ce7f0-3c92-4cc2-a54e-4273667e5b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:31.969177 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ce7f0-3c92-4cc2-a54e-4273667e5b10 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:31.970544 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ce7f0-3c92-4cc2-a54e-4273667e5b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:31.980064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ce7f0-3c92-4cc2-a54e-4273667e5b10 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:32.048423 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1169/2322] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:31 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:32.050201 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ce7f0-3c92-4cc2-a54e-4273667e5b10 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:32.080533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ce7f0-3c92-4cc2-a54e-4273667e5b10 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:32.103993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01b6a9-3d11-4941-9e44-b6bedf2041d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:32.104659 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01b6a9-3d11-4941-9e44-b6bedf2041d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:32.111422 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01b6a9-3d11-4941-9e44-b6bedf2041d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:32.112074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01b6a9-3d11-4941-9e44-b6bedf2041d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:32.113202 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01b6a9-3d11-4941-9e44-b6bedf2041d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:32.118736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01b6a9-3d11-4941-9e44-b6bedf2041d9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:32.141897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e206ec-f306-4cf2-880f-42746b1da3cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9791ea73d46b191ad9fc146297565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:32.142544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e206ec-f306-4cf2-880f-42746b1da3cc service swift] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:32.142821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e206ec-f306-4cf2-880f-42746b1da3cc service swift] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:32.143090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e206ec-f306-4cf2-880f-42746b1da3cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:32.155322 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1170/2323] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:32.163527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01b6a9-3d11-4941-9e44-b6bedf2041d9 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:32.168423 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:32.200179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01b6a9-3d11-4941-9e44-b6bedf2041d9 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:32.208636 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef470d6a-3a47-4163-bffd-0ef6200c8945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:32.209906 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef470d6a-3a47-4163-bffd-0ef6200c8945 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:32.210430 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef470d6a-3a47-4163-bffd-0ef6200c8945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:32.211403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef470d6a-3a47-4163-bffd-0ef6200c8945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:32.212274 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef470d6a-3a47-4163-bffd-0ef6200c8945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:32.215832 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef470d6a-3a47-4163-bffd-0ef6200c8945 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:32.245169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1171/2324] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:32.245169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef470d6a-3a47-4163-bffd-0ef6200c8945 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:32.273834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef470d6a-3a47-4163-bffd-0ef6200c8945 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:32.282525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e206ec-f306-4cf2-880f-42746b1da3cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:32.283098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1763c6-d2b7-49cc-977e-322770aba963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:32.284265 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1763c6-d2b7-49cc-977e-322770aba963 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:32.284764 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1763c6-d2b7-49cc-977e-322770aba963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:32.285168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e206ec-f306-4cf2-880f-42746b1da3cc service swift] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:32.285299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1763c6-d2b7-49cc-977e-322770aba963 admin admin] PATH_INFO: `/v3/projects/16390dcaf6c14eaba9db7ce3e6d24615/users/c68df8a70f884874b5ed7fea0e986c88/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:32.299074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1154/2325] 10.222.0.52 () {60 vars in 1384 bytes} [Mon Aug 29 20:33:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:33:32.341616 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1763c6-d2b7-49cc-977e-322770aba963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16390dcaf6c14eaba9db7ce3e6d24615, user_id=c68df8a70f884874b5ed7fea0e986c88, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:32.347198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1763c6-d2b7-49cc-977e-322770aba963 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:32.404009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1172/2326] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:32 2022] PUT /identity/v3/projects/16390dcaf6c14eaba9db7ce3e6d24615/users/c68df8a70f884874b5ed7fea0e986c88/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:32.414050 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8db40-c497-4388-8c2b-c69d809185e8 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:32.414564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8db40-c497-4388-8c2b-c69d809185e8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:32.415215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8db40-c497-4388-8c2b-c69d809185e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:32.449047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b6a8db40-c497-4388-8c2b-c69d809185e8 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:32.450749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b6a8db40-c497-4388-8c2b-c69d809185e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:32.558126 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1155/2327] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:32.581344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1763c6-d2b7-49cc-977e-322770aba963 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:32.583717 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9e1763c6-d2b7-49cc-977e-322770aba963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:32.710622 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1763c6-d2b7-49cc-977e-322770aba963 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:32.711583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8db40-c497-4388-8c2b-c69d809185e8 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:32.715007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b6a8db40-c497-4388-8c2b-c69d809185e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:32.717245 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2d264-7061-402f-a657-1d0cf4f55371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:32.718433 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d264-7061-402f-a657-1d0cf4f55371 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:32.718911 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d264-7061-402f-a657-1d0cf4f55371 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:32.719387 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d264-7061-402f-a657-1d0cf4f55371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:32.744601 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8db40-c497-4388-8c2b-c69d809185e8 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:32.747657 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2d264-7061-402f-a657-1d0cf4f55371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:32.750998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2d264-7061-402f-a657-1d0cf4f55371 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:32.756831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bb382-6daf-4748-a1bf-088f82f18c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:32.758599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bb382-6daf-4748-a1bf-088f82f18c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:32.759374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bb382-6daf-4748-a1bf-088f82f18c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:32.760416 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bb382-6daf-4748-a1bf-088f82f18c4e admin admin] PATH_INFO: `/v3/users/9f199d768e94440a9b38709a196b2a66` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:32.764671 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bb382-6daf-4748-a1bf-088f82f18c4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f199d768e94440a9b38709a196b2a66)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:32.770524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bb382-6daf-4748-a1bf-088f82f18c4e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:32.772022 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1173/2328] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:32.877759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788be50-bf12-477e-90d4-9f67f878e846 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:32.878620 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788be50-bf12-477e-90d4-9f67f878e846 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:32.879311 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788be50-bf12-477e-90d4-9f67f878e846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:32.886638 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-364bb382-6daf-4748-a1bf-088f82f18c4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f199d768e94440a9b38709a196b2a66'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:32.916847 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c788be50-bf12-477e-90d4-9f67f878e846 None None] MFA Rules not processed for user `0327aa38835f41a7a82802f9cad2e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:32.919109 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c788be50-bf12-477e-90d4-9f67f878e846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:32.925836 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-364bb382-6daf-4748-a1bf-088f82f18c4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f199d768e94440a9b38709a196b2a66'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:32.947796 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-364bb382-6daf-4748-a1bf-088f82f18c4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f199d768e94440a9b38709a196b2a66'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:32.949131 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-364bb382-6daf-4748-a1bf-088f82f18c4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f199d768e94440a9b38709a196b2a66'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:32.966737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-364bb382-6daf-4748-a1bf-088f82f18c4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f199d768e94440a9b38709a196b2a66'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:32.984412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1156/2329] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:32 2022] DELETE /identity/v3/users/9f199d768e94440a9b38709a196b2a66 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:32.988485 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a268610-d39a-48f7-8dbf-8e7517a3643e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:32.989028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a268610-d39a-48f7-8dbf-8e7517a3643e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:32.991214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a268610-d39a-48f7-8dbf-8e7517a3643e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:33.029299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1a268610-d39a-48f7-8dbf-8e7517a3643e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:33.031449 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1a268610-d39a-48f7-8dbf-8e7517a3643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:33.055121 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1174/2330] 10.222.0.52 () {58 vars in 967 bytes} [Mon Aug 29 20:33:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:33.062484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:33.084131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788be50-bf12-477e-90d4-9f67f878e846 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:33.089005 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c788be50-bf12-477e-90d4-9f67f878e846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:33.117118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:33.215368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1157/2331] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:33.232238 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a268610-d39a-48f7-8dbf-8e7517a3643e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:33.234879 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1a268610-d39a-48f7-8dbf-8e7517a3643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:33.295735 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788be50-bf12-477e-90d4-9f67f878e846 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:33.455587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a268610-d39a-48f7-8dbf-8e7517a3643e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:33.465343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1483c-aa78-4f94-8af4-20bd2650189f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:33.467552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1483c-aa78-4f94-8af4-20bd2650189f service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:33.469009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1483c-aa78-4f94-8af4-20bd2650189f service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:33.471146 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1483c-aa78-4f94-8af4-20bd2650189f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:33.491353 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8f5d7-3413-4afb-9e93-d4bcd784e18d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9791ea73d46b191ad9fc146297565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:33.493302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8f5d7-3413-4afb-9e93-d4bcd784e18d service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:33.493964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8f5d7-3413-4afb-9e93-d4bcd784e18d service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:33.496073 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8f5d7-3413-4afb-9e93-d4bcd784e18d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:33.498375 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1483c-aa78-4f94-8af4-20bd2650189f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:33.503925 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1483c-aa78-4f94-8af4-20bd2650189f service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:33.540227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1158/2332] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:33.782965 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8f5d7-3413-4afb-9e93-d4bcd784e18d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:33.787887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8f5d7-3413-4afb-9e93-d4bcd784e18d service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:33.826812 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1175/2333] 10.222.0.52 () {60 vars in 1384 bytes} [Mon Aug 29 20:33:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 20:33:34.764269 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1483c-aa78-4f94-8af4-20bd2650189f service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:34.770310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-20f1483c-aa78-4f94-8af4-20bd2650189f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:34.802174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1483c-aa78-4f94-8af4-20bd2650189f service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:34.810861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c7877-bb17-4650-9d8e-beb1904cf09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:34.811992 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c7877-bb17-4650-9d8e-beb1904cf09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:34.812277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c7877-bb17-4650-9d8e-beb1904cf09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:34.812547 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c7877-bb17-4650-9d8e-beb1904cf09b admin admin] PATH_INFO: `/v3/projects/a8234bfb0fa2491a8eb7237fddb602af` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:34.814773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c7877-bb17-4650-9d8e-beb1904cf09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8234bfb0fa2491a8eb7237fddb602af)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:34.819215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c7877-bb17-4650-9d8e-beb1904cf09b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:34.941504 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-093c7877-bb17-4650-9d8e-beb1904cf09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8234bfb0fa2491a8eb7237fddb602af', 'request_id': 'req-093c7877-bb17-4650-9d8e-beb1904cf09b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:34.960721 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-093c7877-bb17-4650-9d8e-beb1904cf09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8234bfb0fa2491a8eb7237fddb602af', 'request_id': 'req-093c7877-bb17-4650-9d8e-beb1904cf09b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:34.998806 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-093c7877-bb17-4650-9d8e-beb1904cf09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8234bfb0fa2491a8eb7237fddb602af', 'request_id': 'req-093c7877-bb17-4650-9d8e-beb1904cf09b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:35.042853 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-093c7877-bb17-4650-9d8e-beb1904cf09b admin admin] The token cache is being invalidate because project a8234bfb0fa2491a8eb7237fddb602af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:35.043727 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-093c7877-bb17-4650-9d8e-beb1904cf09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:35.045138 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-093c7877-bb17-4650-9d8e-beb1904cf09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:35.055038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1159/2334] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:34 2022] DELETE /identity/v3/projects/a8234bfb0fa2491a8eb7237fddb602af => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:35.060353 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332ce42-fcfb-4f4a-9c66-7b26b16f847f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:35.061992 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332ce42-fcfb-4f4a-9c66-7b26b16f847f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:35.062737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332ce42-fcfb-4f4a-9c66-7b26b16f847f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:35.159825 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b332ce42-fcfb-4f4a-9c66-7b26b16f847f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:35.162391 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b332ce42-fcfb-4f4a-9c66-7b26b16f847f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:35.403119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69befa97-1741-4ba9-981e-d943feda1f7f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:35.405529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:35.410705 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69befa97-1741-4ba9-981e-d943feda1f7f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:35.411551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69befa97-1741-4ba9-981e-d943feda1f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:35.470113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1176/2335] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:35.472897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37251d-08f5-4bfb-b64a-bf89294460dd None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:35.475373 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37251d-08f5-4bfb-b64a-bf89294460dd None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:35.475944 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37251d-08f5-4bfb-b64a-bf89294460dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:35.530929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-69befa97-1741-4ba9-981e-d943feda1f7f None None] MFA Rules not processed for user `c68df8a70f884874b5ed7fea0e986c88`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:35.534677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-69befa97-1741-4ba9-981e-d943feda1f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:35.542722 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-fd37251d-08f5-4bfb-b64a-bf89294460dd None None] MFA Rules not processed for user `46da39cde1ca40c7a84bb457f0e3bf77`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:35.546100 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fd37251d-08f5-4bfb-b64a-bf89294460dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:35.627646 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:35.715454 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1177/2336] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:35.717888 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e9a5f-cd10-4590-aebd-2d22c24f8cd4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:35.718372 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e9a5f-cd10-4590-aebd-2d22c24f8cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:35.718843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e9a5f-cd10-4590-aebd-2d22c24f8cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:35.766239 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1160/2337] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:35.785579 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69befa97-1741-4ba9-981e-d943feda1f7f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:35.788843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-69befa97-1741-4ba9-981e-d943feda1f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:35.822240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b21e9a5f-cd10-4590-aebd-2d22c24f8cd4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:35.834494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b21e9a5f-cd10-4590-aebd-2d22c24f8cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:35.869063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1178/2338] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:35.878500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e9a5f-cd10-4590-aebd-2d22c24f8cd4 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:35.917822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e9a5f-cd10-4590-aebd-2d22c24f8cd4 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:35.943280 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc6f70-df8c-4536-8887-3bc1f990e431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:35.944247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc6f70-df8c-4536-8887-3bc1f990e431 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:35.944716 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc6f70-df8c-4536-8887-3bc1f990e431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:35.945191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc6f70-df8c-4536-8887-3bc1f990e431 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:35.946641 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc6f70-df8c-4536-8887-3bc1f990e431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:33:35.947059 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc6f70-df8c-4536-8887-3bc1f990e431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:35.954589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc6f70-df8c-4536-8887-3bc1f990e431 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:35.979366 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69befa97-1741-4ba9-981e-d943feda1f7f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:35.993774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1179/2339] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:33:35.998127 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8debe-2b0e-40ae-9052-0593297460c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:35.999620 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8debe-2b0e-40ae-9052-0593297460c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:36.000148 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8debe-2b0e-40ae-9052-0593297460c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:36.000818 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8debe-2b0e-40ae-9052-0593297460c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:36.001030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc6f70-df8c-4536-8887-3bc1f990e431 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:36.039412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8debe-2b0e-40ae-9052-0593297460c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:36.042908 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc6f70-df8c-4536-8887-3bc1f990e431 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:36.050523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8debe-2b0e-40ae-9052-0593297460c9 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:36.052273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0c9d4-162f-4c08-ae98-f3f492deb0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:36.053606 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0c9d4-162f-4c08-ae98-f3f492deb0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:36.054214 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0c9d4-162f-4c08-ae98-f3f492deb0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:36.054845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0c9d4-162f-4c08-ae98-f3f492deb0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:36.057272 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0c9d4-162f-4c08-ae98-f3f492deb0a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:36.065612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0c9d4-162f-4c08-ae98-f3f492deb0a4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:36.091409 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1161/2340] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:33:36.185495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1180/2341] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:35 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:36.192329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8debe-2b0e-40ae-9052-0593297460c9 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:36.219823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8debe-2b0e-40ae-9052-0593297460c9 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:36.472296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a9ef5-b67e-458e-96e0-b2c275b4cca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:36.473385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a9ef5-b67e-458e-96e0-b2c275b4cca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:36.473826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a9ef5-b67e-458e-96e0-b2c275b4cca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:36.474312 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a9ef5-b67e-458e-96e0-b2c275b4cca4 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:36.479999 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a9ef5-b67e-458e-96e0-b2c275b4cca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:36.485339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a9ef5-b67e-458e-96e0-b2c275b4cca4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:36.559144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1162/2342] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:36 2022] POST /identity/v3/users => generated 292 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:36.566392 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0c9d4-162f-4c08-ae98-f3f492deb0a4 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:36.591699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0c9d4-162f-4c08-ae98-f3f492deb0a4 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:36.603513 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22739b8e-61cc-4a1f-b2c5-065631bf8623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:36.604995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22739b8e-61cc-4a1f-b2c5-065631bf8623 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:36.606071 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22739b8e-61cc-4a1f-b2c5-065631bf8623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:36.606665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22739b8e-61cc-4a1f-b2c5-065631bf8623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:36.608362 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22739b8e-61cc-4a1f-b2c5-065631bf8623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:36.612987 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22739b8e-61cc-4a1f-b2c5-065631bf8623 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:36.683429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1181/2343] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:36.689099 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a9ef5-b67e-458e-96e0-b2c275b4cca4 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:36.738252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a9ef5-b67e-458e-96e0-b2c275b4cca4 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:36.755840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3587680-f996-4bd0-abdb-e3bdb36015b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:36.757342 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3587680-f996-4bd0-abdb-e3bdb36015b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:36.758138 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3587680-f996-4bd0-abdb-e3bdb36015b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:36.758720 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3587680-f996-4bd0-abdb-e3bdb36015b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:36.759700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3587680-f996-4bd0-abdb-e3bdb36015b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:36.770200 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3587680-f996-4bd0-abdb-e3bdb36015b2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:36.830197 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1163/2344] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:36.831911 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22739b8e-61cc-4a1f-b2c5-065631bf8623 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:36.867352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22739b8e-61cc-4a1f-b2c5-065631bf8623 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:36.920577 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205739f3-4585-4478-b527-6a74679dcbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:36.924352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205739f3-4585-4478-b527-6a74679dcbb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:36.925059 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205739f3-4585-4478-b527-6a74679dcbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:36.926114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205739f3-4585-4478-b527-6a74679dcbb2 admin admin] PATH_INFO: `/v3/projects/533bc6ed8ce1467c948b1b073e4fe19c/users/e326bb2771be4a43b3503eed33a0a361/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:37.001532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205739f3-4585-4478-b527-6a74679dcbb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=533bc6ed8ce1467c948b1b073e4fe19c, user_id=e326bb2771be4a43b3503eed33a0a361, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:37.010996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205739f3-4585-4478-b527-6a74679dcbb2 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:37.045338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1182/2345] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:36 2022] PUT /identity/v3/projects/533bc6ed8ce1467c948b1b073e4fe19c/users/e326bb2771be4a43b3503eed33a0a361/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:33:37.064707 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa822ed2-e0b9-4fba-a1c7-599fdeb83194 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:37.065107 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa822ed2-e0b9-4fba-a1c7-599fdeb83194 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:37.065778 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa822ed2-e0b9-4fba-a1c7-599fdeb83194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:37.118085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-aa822ed2-e0b9-4fba-a1c7-599fdeb83194 None None] MFA Rules not processed for user `e326bb2771be4a43b3503eed33a0a361`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:37.119721 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-aa822ed2-e0b9-4fba-a1c7-599fdeb83194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:37.240954 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:37.283654 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1164/2346] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:37.303290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205739f3-4585-4478-b527-6a74679dcbb2 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:37.419059 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205739f3-4585-4478-b527-6a74679dcbb2 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:37.427501 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b392bf-8c00-42c0-a603-5c71f64d34b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:37.428547 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b392bf-8c00-42c0-a603-5c71f64d34b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:37.429021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b392bf-8c00-42c0-a603-5c71f64d34b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:37.430176 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b392bf-8c00-42c0-a603-5c71f64d34b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:37.448459 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b392bf-8c00-42c0-a603-5c71f64d34b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:37.451448 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b392bf-8c00-42c0-a603-5c71f64d34b1 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:37.470578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1183/2347] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:37.985851 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa822ed2-e0b9-4fba-a1c7-599fdeb83194 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:37.989058 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-aa822ed2-e0b9-4fba-a1c7-599fdeb83194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:38.121164 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429aab5b-5b2c-432b-8aa2-ac65d6e759b9 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:38.121976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429aab5b-5b2c-432b-8aa2-ac65d6e759b9 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:38.122683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429aab5b-5b2c-432b-8aa2-ac65d6e759b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:38.182829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-429aab5b-5b2c-432b-8aa2-ac65d6e759b9 None None] MFA Rules not processed for user `c68df8a70f884874b5ed7fea0e986c88`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:38.188724 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-429aab5b-5b2c-432b-8aa2-ac65d6e759b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:38.226755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa822ed2-e0b9-4fba-a1c7-599fdeb83194 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:38.238480 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737b507-ad09-4f2c-8fac-2d6fe7b446c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:38.239354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737b507-ad09-4f2c-8fac-2d6fe7b446c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:38.243033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737b507-ad09-4f2c-8fac-2d6fe7b446c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:38.243504 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737b507-ad09-4f2c-8fac-2d6fe7b446c3 admin admin] PATH_INFO: `/v3/users/a45beb9ce0764169bbe1a27c5e045330` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:38.250904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737b507-ad09-4f2c-8fac-2d6fe7b446c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a45beb9ce0764169bbe1a27c5e045330)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:38.256421 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737b507-ad09-4f2c-8fac-2d6fe7b446c3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:38.310935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:38.405463 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1737b507-ad09-4f2c-8fac-2d6fe7b446c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a45beb9ce0764169bbe1a27c5e045330'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:38.416256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1184/2348] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:33:38.416256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429aab5b-5b2c-432b-8aa2-ac65d6e759b9 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:38.416256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-429aab5b-5b2c-432b-8aa2-ac65d6e759b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:38.427879 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1737b507-ad09-4f2c-8fac-2d6fe7b446c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a45beb9ce0764169bbe1a27c5e045330'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:38.443462 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1737b507-ad09-4f2c-8fac-2d6fe7b446c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a45beb9ce0764169bbe1a27c5e045330'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:38.444421 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1737b507-ad09-4f2c-8fac-2d6fe7b446c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a45beb9ce0764169bbe1a27c5e045330'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:38.461458 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1737b507-ad09-4f2c-8fac-2d6fe7b446c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a45beb9ce0764169bbe1a27c5e045330'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:38.462845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429aab5b-5b2c-432b-8aa2-ac65d6e759b9 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:38.482075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1165/2349] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:37 2022] DELETE /identity/v3/users/a45beb9ce0764169bbe1a27c5e045330 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:38.488576 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2d3f3-3892-4ae0-a3c4-c27a297a0cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:38.491328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2d3f3-3892-4ae0-a3c4-c27a297a0cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:38.491680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2d3f3-3892-4ae0-a3c4-c27a297a0cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:38.492686 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2d3f3-3892-4ae0-a3c4-c27a297a0cf4 admin admin] PATH_INFO: `/v3/users/fc4a4f6139484ded8dc13d4911e30715` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:38.494668 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226c939-4e68-4a1a-90ef-3e832c165145 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:38.495011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226c939-4e68-4a1a-90ef-3e832c165145 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:38.495256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226c939-4e68-4a1a-90ef-3e832c165145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:38.500008 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2d3f3-3892-4ae0-a3c4-c27a297a0cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc4a4f6139484ded8dc13d4911e30715)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:38.503081 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2d3f3-3892-4ae0-a3c4-c27a297a0cf4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:38.532931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f226c939-4e68-4a1a-90ef-3e832c165145 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:38.535421 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f226c939-4e68-4a1a-90ef-3e832c165145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:38.634302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-16f2d3f3-3892-4ae0-a3c4-c27a297a0cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc4a4f6139484ded8dc13d4911e30715'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:38.656439 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-16f2d3f3-3892-4ae0-a3c4-c27a297a0cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc4a4f6139484ded8dc13d4911e30715'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:38.683829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-16f2d3f3-3892-4ae0-a3c4-c27a297a0cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc4a4f6139484ded8dc13d4911e30715'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:38.685269 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-16f2d3f3-3892-4ae0-a3c4-c27a297a0cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc4a4f6139484ded8dc13d4911e30715'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:38.686387 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-16f2d3f3-3892-4ae0-a3c4-c27a297a0cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc4a4f6139484ded8dc13d4911e30715'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:38.692933 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1166/2350] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:38.703524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226c939-4e68-4a1a-90ef-3e832c165145 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:38.706116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f226c939-4e68-4a1a-90ef-3e832c165145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:38.713438 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1185/2351] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:38 2022] DELETE /identity/v3/users/fc4a4f6139484ded8dc13d4911e30715 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:38.718483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863d1b0-6a2e-43c0-aabd-e425fc5901d1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:38.718855 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863d1b0-6a2e-43c0-aabd-e425fc5901d1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:38.719208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863d1b0-6a2e-43c0-aabd-e425fc5901d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:38.723888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:38.757221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c863d1b0-6a2e-43c0-aabd-e425fc5901d1 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:38.757221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c863d1b0-6a2e-43c0-aabd-e425fc5901d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:38.829221 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226c939-4e68-4a1a-90ef-3e832c165145 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:38.890376 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1186/2352] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:38.907533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863d1b0-6a2e-43c0-aabd-e425fc5901d1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:38.940667 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c5cf4-5858-4b74-bd5d-6bb21ac0776b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:38.942303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c5cf4-5858-4b74-bd5d-6bb21ac0776b service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:38.943385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c5cf4-5858-4b74-bd5d-6bb21ac0776b service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:38.943752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c5cf4-5858-4b74-bd5d-6bb21ac0776b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:38.970129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c5cf4-5858-4b74-bd5d-6bb21ac0776b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:38.973781 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c5cf4-5858-4b74-bd5d-6bb21ac0776b service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:38.989332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1167/2353] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:33:38.997853 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:39.032792 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863d1b0-6a2e-43c0-aabd-e425fc5901d1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:39.042852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6a244-871b-4249-ac08-80eed1964e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:39.043935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6a244-871b-4249-ac08-80eed1964e84 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:39.044673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6a244-871b-4249-ac08-80eed1964e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:39.045802 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6a244-871b-4249-ac08-80eed1964e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:39.066753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6a244-871b-4249-ac08-80eed1964e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:39.068767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6a244-871b-4249-ac08-80eed1964e84 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:39.099945 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1187/2354] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:33:39.543207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c5cf4-5858-4b74-bd5d-6bb21ac0776b service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:39.545631 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-155c5cf4-5858-4b74-bd5d-6bb21ac0776b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:39.571365 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c5cf4-5858-4b74-bd5d-6bb21ac0776b service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:39.581201 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab4713-2f81-4469-8cbd-fd87e2217bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:39.582155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab4713-2f81-4469-8cbd-fd87e2217bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:39.582490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab4713-2f81-4469-8cbd-fd87e2217bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:39.582906 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab4713-2f81-4469-8cbd-fd87e2217bb4 admin admin] PATH_INFO: `/v3/projects/9a8418ba06d8494db1e5fad08e9f1ba2` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:39.584820 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab4713-2f81-4469-8cbd-fd87e2217bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a8418ba06d8494db1e5fad08e9f1ba2)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:39.587391 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab4713-2f81-4469-8cbd-fd87e2217bb4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:39.635026 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6a244-871b-4249-ac08-80eed1964e84 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:39.636885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f6e6a244-871b-4249-ac08-80eed1964e84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:39.684781 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6a244-871b-4249-ac08-80eed1964e84 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:39.708395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-60ab4713-2f81-4469-8cbd-fd87e2217bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8418ba06d8494db1e5fad08e9f1ba2', 'request_id': 'req-60ab4713-2f81-4469-8cbd-fd87e2217bb4'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:39.735292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-60ab4713-2f81-4469-8cbd-fd87e2217bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8418ba06d8494db1e5fad08e9f1ba2', 'request_id': 'req-60ab4713-2f81-4469-8cbd-fd87e2217bb4'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:39.762614 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-60ab4713-2f81-4469-8cbd-fd87e2217bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8418ba06d8494db1e5fad08e9f1ba2', 'request_id': 'req-60ab4713-2f81-4469-8cbd-fd87e2217bb4'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:39.836699 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-60ab4713-2f81-4469-8cbd-fd87e2217bb4 admin admin] The token cache is being invalidate because project 9a8418ba06d8494db1e5fad08e9f1ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:39.839267 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-60ab4713-2f81-4469-8cbd-fd87e2217bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:39.846683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-60ab4713-2f81-4469-8cbd-fd87e2217bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:39.851635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1168/2355] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:39 2022] DELETE /identity/v3/projects/9a8418ba06d8494db1e5fad08e9f1ba2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:39.860314 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feac381-c140-4cf0-b6dc-abf70effa1bb None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:39.862060 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feac381-c140-4cf0-b6dc-abf70effa1bb None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:39.863010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feac381-c140-4cf0-b6dc-abf70effa1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:39.953559 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5feac381-c140-4cf0-b6dc-abf70effa1bb None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:39.957013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5feac381-c140-4cf0-b6dc-abf70effa1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:39.977794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292456e2-6da9-4b61-ba75-d09d09d2814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:39.979366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292456e2-6da9-4b61-ba75-d09d09d2814f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:39.979831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292456e2-6da9-4b61-ba75-d09d09d2814f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:39.980288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292456e2-6da9-4b61-ba75-d09d09d2814f admin admin] PATH_INFO: `/v3/projects/20fddf2e39774d658b2750b88bc41205` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:39.984231 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292456e2-6da9-4b61-ba75-d09d09d2814f admin admin] RBAC: Authorizing `identity:delete_project(project_id=20fddf2e39774d658b2750b88bc41205)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:39.992696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292456e2-6da9-4b61-ba75-d09d09d2814f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:40.061310 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:40.147498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1169/2356] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:40.163563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-292456e2-6da9-4b61-ba75-d09d09d2814f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20fddf2e39774d658b2750b88bc41205', 'request_id': 'req-292456e2-6da9-4b61-ba75-d09d09d2814f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:40.164281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b519d8-7ed9-4daa-bfda-ce7653098258 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:40.167169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b519d8-7ed9-4daa-bfda-ce7653098258 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:40.167769 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b519d8-7ed9-4daa-bfda-ce7653098258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:40.186051 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-292456e2-6da9-4b61-ba75-d09d09d2814f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20fddf2e39774d658b2750b88bc41205', 'request_id': 'req-292456e2-6da9-4b61-ba75-d09d09d2814f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:40.205156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-292456e2-6da9-4b61-ba75-d09d09d2814f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20fddf2e39774d658b2750b88bc41205', 'request_id': 'req-292456e2-6da9-4b61-ba75-d09d09d2814f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:40.220778 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-98b519d8-7ed9-4daa-bfda-ce7653098258 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:40.223010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-98b519d8-7ed9-4daa-bfda-ce7653098258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:40.223809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-292456e2-6da9-4b61-ba75-d09d09d2814f admin admin] The token cache is being invalidate because project 20fddf2e39774d658b2750b88bc41205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:40.224429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-292456e2-6da9-4b61-ba75-d09d09d2814f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:40.225818 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-292456e2-6da9-4b61-ba75-d09d09d2814f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:40.228366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1188/2357] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:39 2022] DELETE /identity/v3/projects/20fddf2e39774d658b2750b88bc41205 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:33:40.243856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721733-687c-48f4-a675-ea3bf71864df None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:40.244250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721733-687c-48f4-a675-ea3bf71864df None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:40.244417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721733-687c-48f4-a675-ea3bf71864df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:40.311018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4f721733-687c-48f4-a675-ea3bf71864df None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:40.313298 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4f721733-687c-48f4-a675-ea3bf71864df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:40.421336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1170/2358] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:40.424442 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b519d8-7ed9-4daa-bfda-ce7653098258 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:40.450557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b519d8-7ed9-4daa-bfda-ce7653098258 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:40.461066 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa49384-d4a2-40ac-8fe8-73fa7d1211dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:40.462258 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa49384-d4a2-40ac-8fe8-73fa7d1211dd admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:40.463036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa49384-d4a2-40ac-8fe8-73fa7d1211dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:40.463036 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa49384-d4a2-40ac-8fe8-73fa7d1211dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:40.464296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa49384-d4a2-40ac-8fe8-73fa7d1211dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:33:40.464790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa49384-d4a2-40ac-8fe8-73fa7d1211dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:40.468856 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa49384-d4a2-40ac-8fe8-73fa7d1211dd admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:40.482683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1189/2359] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:40.498845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565f96e-5b2e-476c-a94e-d7be8adb77cd None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:40.499369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565f96e-5b2e-476c-a94e-d7be8adb77cd None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:40.499837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565f96e-5b2e-476c-a94e-d7be8adb77cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:40.508500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1171/2360] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:33:40.514996 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa49384-d4a2-40ac-8fe8-73fa7d1211dd admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:40.551561 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa49384-d4a2-40ac-8fe8-73fa7d1211dd admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:40.564935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f565f96e-5b2e-476c-a94e-d7be8adb77cd None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:40.568180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f565f96e-5b2e-476c-a94e-d7be8adb77cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:40.571675 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8f7f7-6d3a-463f-97ae-752adbf745a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:40.572818 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8f7f7-6d3a-463f-97ae-752adbf745a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:40.573509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8f7f7-6d3a-463f-97ae-752adbf745a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:40.574170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8f7f7-6d3a-463f-97ae-752adbf745a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:40.575482 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8f7f7-6d3a-463f-97ae-752adbf745a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:40.579913 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8f7f7-6d3a-463f-97ae-752adbf745a1 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:40.599391 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1190/2361] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:40.605916 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565f96e-5b2e-476c-a94e-d7be8adb77cd None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:40.630045 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565f96e-5b2e-476c-a94e-d7be8adb77cd None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:40.648970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044d432-45e8-48d7-84ec-6db2fcb5e3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:40.650942 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044d432-45e8-48d7-84ec-6db2fcb5e3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:40.651464 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044d432-45e8-48d7-84ec-6db2fcb5e3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:40.652111 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044d432-45e8-48d7-84ec-6db2fcb5e3d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:40.653716 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044d432-45e8-48d7-84ec-6db2fcb5e3d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:33:40.654442 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044d432-45e8-48d7-84ec-6db2fcb5e3d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:40.658023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044d432-45e8-48d7-84ec-6db2fcb5e3d4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:40.662594 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:40.680596 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1172/2362] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:40 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:40.688203 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8f7f7-6d3a-463f-97ae-752adbf745a1 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:40.728431 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1191/2363] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:33:40.732925 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044d432-45e8-48d7-84ec-6db2fcb5e3d4 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:40.758654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044d432-45e8-48d7-84ec-6db2fcb5e3d4 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:40.872500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8f7f7-6d3a-463f-97ae-752adbf745a1 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:40.883758 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c77ee7-bbf9-4981-bedd-e494d8c781c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:40.884478 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c77ee7-bbf9-4981-bedd-e494d8c781c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:40.885101 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c77ee7-bbf9-4981-bedd-e494d8c781c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:40.885746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c77ee7-bbf9-4981-bedd-e494d8c781c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:40.887165 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c77ee7-bbf9-4981-bedd-e494d8c781c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:40.893049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c77ee7-bbf9-4981-bedd-e494d8c781c7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:40.946769 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e3be1-61a5-460c-8009-9e78093c1fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:40.949030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e3be1-61a5-460c-8009-9e78093c1fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:40.950226 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e3be1-61a5-460c-8009-9e78093c1fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:40.950724 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e3be1-61a5-460c-8009-9e78093c1fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:40.952465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e3be1-61a5-460c-8009-9e78093c1fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:40.957194 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e3be1-61a5-460c-8009-9e78093c1fc6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:40.968333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1173/2364] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:40 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:40.974861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c77ee7-bbf9-4981-bedd-e494d8c781c7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:40.997863 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c77ee7-bbf9-4981-bedd-e494d8c781c7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:41.022672 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200e999-832e-45e1-947b-91fc0478b998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:41.023993 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200e999-832e-45e1-947b-91fc0478b998 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:41.024581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200e999-832e-45e1-947b-91fc0478b998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:41.025804 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200e999-832e-45e1-947b-91fc0478b998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:41.032645 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200e999-832e-45e1-947b-91fc0478b998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:41.032929 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1192/2365] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:40 2022] POST /identity/v3/projects => generated 399 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:41.033119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200e999-832e-45e1-947b-91fc0478b998 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:41.035236 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e3be1-61a5-460c-8009-9e78093c1fc6 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:41.058807 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1174/2366] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:41.071873 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200e999-832e-45e1-947b-91fc0478b998 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:41.099328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200e999-832e-45e1-947b-91fc0478b998 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:41.249301 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:41.294021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e3be1-61a5-460c-8009-9e78093c1fc6 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:41.307854 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706694d-6660-4173-a18d-f71550755a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:41.313076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706694d-6660-4173-a18d-f71550755a88 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:41.313975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706694d-6660-4173-a18d-f71550755a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:41.315113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706694d-6660-4173-a18d-f71550755a88 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:41.316530 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706694d-6660-4173-a18d-f71550755a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:41.329220 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706694d-6660-4173-a18d-f71550755a88 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:41.373645 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37da213-61cf-48ee-8315-86f8b14ea2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:41.377712 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37da213-61cf-48ee-8315-86f8b14ea2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:41.380521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37da213-61cf-48ee-8315-86f8b14ea2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:41.381303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37da213-61cf-48ee-8315-86f8b14ea2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:41.383628 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37da213-61cf-48ee-8315-86f8b14ea2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:41.387413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37da213-61cf-48ee-8315-86f8b14ea2c9 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:41.407845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1193/2367] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:41 2022] POST /identity/v3/users => generated 300 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:33:41.417160 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706694d-6660-4173-a18d-f71550755a88 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:41.427067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f706694d-6660-4173-a18d-f71550755a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:41.437104 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1175/2368] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:33:41.437104 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37da213-61cf-48ee-8315-86f8b14ea2c9 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:41.455460 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37da213-61cf-48ee-8315-86f8b14ea2c9 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:41.467592 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b33f9-3fce-409b-85e3-955a5f3c604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:41.468961 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b33f9-3fce-409b-85e3-955a5f3c604e admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:41.469542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b33f9-3fce-409b-85e3-955a5f3c604e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:41.470058 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b33f9-3fce-409b-85e3-955a5f3c604e admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:41.471561 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b33f9-3fce-409b-85e3-955a5f3c604e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:41.474359 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706694d-6660-4173-a18d-f71550755a88 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:41.475511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b33f9-3fce-409b-85e3-955a5f3c604e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:41.493824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ff638-714d-4583-aceb-b2acae186ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:41.497630 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ff638-714d-4583-aceb-b2acae186ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:41.500051 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ff638-714d-4583-aceb-b2acae186ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:41.501102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ff638-714d-4583-aceb-b2acae186ca2 admin admin] PATH_INFO: `/v3/users/e326bb2771be4a43b3503eed33a0a361` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:41.503896 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1176/2369] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:41.505700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b33f9-3fce-409b-85e3-955a5f3c604e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:41.510391 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ff638-714d-4583-aceb-b2acae186ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e326bb2771be4a43b3503eed33a0a361)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:41.524828 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ff638-714d-4583-aceb-b2acae186ca2 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:41.545404 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b33f9-3fce-409b-85e3-955a5f3c604e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:41.566197 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56c4d0-981f-473c-9c2b-0889d5453ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:41.572483 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56c4d0-981f-473c-9c2b-0889d5453ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:41.573579 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56c4d0-981f-473c-9c2b-0889d5453ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:41.575157 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56c4d0-981f-473c-9c2b-0889d5453ac0 admin admin] PATH_INFO: `/v3/projects/b94501f109b54ed780f8d76fe118e75a/users/6bf35c256e554095b0561b8e41d68eaf/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:41.627583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56c4d0-981f-473c-9c2b-0889d5453ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b94501f109b54ed780f8d76fe118e75a, user_id=6bf35c256e554095b0561b8e41d68eaf, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:41.639334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56c4d0-981f-473c-9c2b-0889d5453ac0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:41.678142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1177/2370] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:41 2022] PUT /identity/v3/projects/b94501f109b54ed780f8d76fe118e75a/users/6bf35c256e554095b0561b8e41d68eaf/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:41.680443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-884ff638-714d-4583-aceb-b2acae186ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e326bb2771be4a43b3503eed33a0a361'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:41.682108 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56c4d0-981f-473c-9c2b-0889d5453ac0 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:41.718264 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-884ff638-714d-4583-aceb-b2acae186ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e326bb2771be4a43b3503eed33a0a361'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:41.744776 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:41.765517 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-884ff638-714d-4583-aceb-b2acae186ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e326bb2771be4a43b3503eed33a0a361'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:41.770970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-884ff638-714d-4583-aceb-b2acae186ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e326bb2771be4a43b3503eed33a0a361'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:41.776129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-884ff638-714d-4583-aceb-b2acae186ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e326bb2771be4a43b3503eed33a0a361'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:41.848790 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1194/2371] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:41 2022] DELETE /identity/v3/users/e326bb2771be4a43b3503eed33a0a361 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:41.859193 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adb5d0-4cab-47aa-ada1-a47810deef33 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:41.860082 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adb5d0-4cab-47aa-ada1-a47810deef33 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:41.860761 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adb5d0-4cab-47aa-ada1-a47810deef33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:41.885512 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56c4d0-981f-473c-9c2b-0889d5453ac0 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:41.910927 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-05adb5d0-4cab-47aa-ada1-a47810deef33 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:41.913532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-05adb5d0-4cab-47aa-ada1-a47810deef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:42.114088 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14009173-7fbe-45e8-82e9-4dd08fc695a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:42.116840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14009173-7fbe-45e8-82e9-4dd08fc695a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:42.117785 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14009173-7fbe-45e8-82e9-4dd08fc695a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:42.118528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14009173-7fbe-45e8-82e9-4dd08fc695a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:42.120044 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14009173-7fbe-45e8-82e9-4dd08fc695a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:42.120938 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1195/2372] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:42.123505 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bb08c-e41c-4746-b623-9bd130bbdae1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:42.124126 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bb08c-e41c-4746-b623-9bd130bbdae1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:42.124775 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bb08c-e41c-4746-b623-9bd130bbdae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:42.125902 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14009173-7fbe-45e8-82e9-4dd08fc695a8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:42.169643 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1178/2373] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:42.171438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14009173-7fbe-45e8-82e9-4dd08fc695a8 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:42.176307 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-14009173-7fbe-45e8-82e9-4dd08fc695a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:42.179058 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b06bb08c-e41c-4746-b623-9bd130bbdae1 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:42.182122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b06bb08c-e41c-4746-b623-9bd130bbdae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:42.207794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1196/2374] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:42.210086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bb08c-e41c-4746-b623-9bd130bbdae1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:42.215203 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b06bb08c-e41c-4746-b623-9bd130bbdae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:42.244739 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bb08c-e41c-4746-b623-9bd130bbdae1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:42.257341 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cc3a8-516f-4354-aa2c-f93af71824cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:42.259264 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cc3a8-516f-4354-aa2c-f93af71824cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:42.260368 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cc3a8-516f-4354-aa2c-f93af71824cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:42.261173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cc3a8-516f-4354-aa2c-f93af71824cf admin admin] PATH_INFO: `/v3/projects/57d71ac4439a4165b2f03d48577746be/users/e0b67108eaa647efa23d526ac33eee46/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:42.311354 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:42.326468 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cc3a8-516f-4354-aa2c-f93af71824cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d71ac4439a4165b2f03d48577746be, user_id=e0b67108eaa647efa23d526ac33eee46, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:42.339589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cc3a8-516f-4354-aa2c-f93af71824cf admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:42.377346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14009173-7fbe-45e8-82e9-4dd08fc695a8 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:42.407331 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1197/2375] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:42 2022] PUT /identity/v3/projects/57d71ac4439a4165b2f03d48577746be/users/e0b67108eaa647efa23d526ac33eee46/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:42.411802 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cc3a8-516f-4354-aa2c-f93af71824cf admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:42.424732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a79cc3a8-516f-4354-aa2c-f93af71824cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:42.547078 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e5b48-43f4-4b83-a859-900a7b4d3a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:42.548221 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e5b48-43f4-4b83-a859-900a7b4d3a64 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:42.548742 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e5b48-43f4-4b83-a859-900a7b4d3a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:42.549214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e5b48-43f4-4b83-a859-900a7b4d3a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:42.578445 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cc3a8-516f-4354-aa2c-f93af71824cf admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:42.596416 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b6aa1-d976-422a-a783-81cdd1f5a897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:42.598122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b6aa1-d976-422a-a783-81cdd1f5a897 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:42.598630 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b6aa1-d976-422a-a783-81cdd1f5a897 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:42.599240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b6aa1-d976-422a-a783-81cdd1f5a897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:42.765125 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e5b48-43f4-4b83-a859-900a7b4d3a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:42.768187 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e5b48-43f4-4b83-a859-900a7b4d3a64 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:42.781424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b6aa1-d976-422a-a783-81cdd1f5a897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:42.788113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b6aa1-d976-422a-a783-81cdd1f5a897 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:42.790570 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1179/2376] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:42.794178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f995b9-7bea-46b6-868e-09a49533acae None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:42.794178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f995b9-7bea-46b6-868e-09a49533acae None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:42.794178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f995b9-7bea-46b6-868e-09a49533acae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:42.808919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:42.847007 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1198/2377] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:42.875685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-57f995b9-7bea-46b6-868e-09a49533acae None None] MFA Rules not processed for user `e0b67108eaa647efa23d526ac33eee46`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:42.878976 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-57f995b9-7bea-46b6-868e-09a49533acae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:43.071467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1180/2378] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:43.103139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b6aa1-d976-422a-a783-81cdd1f5a897 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:43.108114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d64b6aa1-d976-422a-a783-81cdd1f5a897 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:43.343403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b6aa1-d976-422a-a783-81cdd1f5a897 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:43.390456 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058edb17-c466-4fc9-9708-207852282ff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:43.393951 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058edb17-c466-4fc9-9708-207852282ff4 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:43.394706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058edb17-c466-4fc9-9708-207852282ff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:43.395481 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058edb17-c466-4fc9-9708-207852282ff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:43.441462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058edb17-c466-4fc9-9708-207852282ff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:43.444299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058edb17-c466-4fc9-9708-207852282ff4 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:43.484715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1199/2379] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:43 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:44.786262 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f995b9-7bea-46b6-868e-09a49533acae None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:44.791808 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-57f995b9-7bea-46b6-868e-09a49533acae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:44.832321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f995b9-7bea-46b6-868e-09a49533acae None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:44.861398 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520a7ff-c20c-47e3-b86e-8225fa209895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:44.863331 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520a7ff-c20c-47e3-b86e-8225fa209895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:44.865332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520a7ff-c20c-47e3-b86e-8225fa209895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:44.866593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520a7ff-c20c-47e3-b86e-8225fa209895 admin admin] PATH_INFO: `/v3/projects/533bc6ed8ce1467c948b1b073e4fe19c` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:44.869979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520a7ff-c20c-47e3-b86e-8225fa209895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=533bc6ed8ce1467c948b1b073e4fe19c)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:44.878399 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520a7ff-c20c-47e3-b86e-8225fa209895 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:45.025746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:45.064492 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4520a7ff-c20c-47e3-b86e-8225fa209895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '533bc6ed8ce1467c948b1b073e4fe19c', 'request_id': 'req-4520a7ff-c20c-47e3-b86e-8225fa209895'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:45.085521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4520a7ff-c20c-47e3-b86e-8225fa209895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '533bc6ed8ce1467c948b1b073e4fe19c', 'request_id': 'req-4520a7ff-c20c-47e3-b86e-8225fa209895'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:45.100207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4520a7ff-c20c-47e3-b86e-8225fa209895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '533bc6ed8ce1467c948b1b073e4fe19c', 'request_id': 'req-4520a7ff-c20c-47e3-b86e-8225fa209895'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:45.121004 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4520a7ff-c20c-47e3-b86e-8225fa209895 admin admin] The token cache is being invalidate because project 533bc6ed8ce1467c948b1b073e4fe19c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:45.121588 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4520a7ff-c20c-47e3-b86e-8225fa209895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:45.123671 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4520a7ff-c20c-47e3-b86e-8225fa209895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:45.125989 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1181/2380] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:44 2022] DELETE /identity/v3/projects/533bc6ed8ce1467c948b1b073e4fe19c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:50.703629 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058edb17-c466-4fc9-9708-207852282ff4 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:50.747028 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058edb17-c466-4fc9-9708-207852282ff4 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:50.954251 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb0dc2-0189-4b46-8638-978264c00298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:50.955423 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb0dc2-0189-4b46-8638-978264c00298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:50.956709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb0dc2-0189-4b46-8638-978264c00298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:50.956709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb0dc2-0189-4b46-8638-978264c00298 admin admin] PATH_INFO: `/v3/users/e0b67108eaa647efa23d526ac33eee46` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:50.958684 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb0dc2-0189-4b46-8638-978264c00298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b67108eaa647efa23d526ac33eee46)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:50.962015 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb0dc2-0189-4b46-8638-978264c00298 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:51.066404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-28fb0dc2-0189-4b46-8638-978264c00298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b67108eaa647efa23d526ac33eee46'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:51.080263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-28fb0dc2-0189-4b46-8638-978264c00298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b67108eaa647efa23d526ac33eee46'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:51.108712 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-28fb0dc2-0189-4b46-8638-978264c00298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b67108eaa647efa23d526ac33eee46'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:51.109865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-28fb0dc2-0189-4b46-8638-978264c00298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b67108eaa647efa23d526ac33eee46'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:51.110838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-28fb0dc2-0189-4b46-8638-978264c00298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b67108eaa647efa23d526ac33eee46'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:51.134680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1200/2381] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:33:50 2022] DELETE /identity/v3/users/e0b67108eaa647efa23d526ac33eee46 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:51.140876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91766c78-b960-4dec-8e17-d8872d2b2043 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:51.143426 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91766c78-b960-4dec-8e17-d8872d2b2043 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:51.144475 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91766c78-b960-4dec-8e17-d8872d2b2043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:51.188536 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-91766c78-b960-4dec-8e17-d8872d2b2043 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:51.191676 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-91766c78-b960-4dec-8e17-d8872d2b2043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:51.324258 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1182/2382] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:33:51.358135 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb0dc2-0189-4b46-8638-978264c00298 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:51.360250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-28fb0dc2-0189-4b46-8638-978264c00298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:51.435336 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:51.503487 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb0dc2-0189-4b46-8638-978264c00298 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:51.510788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19fe3f-b264-4692-9efb-65bb3280caef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:51.511839 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19fe3f-b264-4692-9efb-65bb3280caef service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:51.512286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19fe3f-b264-4692-9efb-65bb3280caef service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:51.512758 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19fe3f-b264-4692-9efb-65bb3280caef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:51.532876 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19fe3f-b264-4692-9efb-65bb3280caef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:51.535864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19fe3f-b264-4692-9efb-65bb3280caef service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:51.556418 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1201/2383] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:33:52.382569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91766c78-b960-4dec-8e17-d8872d2b2043 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:52.385476 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-91766c78-b960-4dec-8e17-d8872d2b2043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:52.413128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91766c78-b960-4dec-8e17-d8872d2b2043 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:52.425004 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:52.426233 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:52.426834 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:52.427394 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13 admin admin] PATH_INFO: `/v3/projects/57d71ac4439a4165b2f03d48577746be` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:52.430455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d71ac4439a4165b2f03d48577746be)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:52.435477 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:52.577073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d71ac4439a4165b2f03d48577746be', 'request_id': 'req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:52.608615 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d71ac4439a4165b2f03d48577746be', 'request_id': 'req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:52.627554 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d71ac4439a4165b2f03d48577746be', 'request_id': 'req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:52.648153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13 admin admin] The token cache is being invalidate because project 57d71ac4439a4165b2f03d48577746be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:33:52.649008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:52.650280 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:33:52.652805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1183/2384] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:33:52 2022] DELETE /identity/v3/projects/57d71ac4439a4165b2f03d48577746be => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:33:56.759595 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a4675-cc15-47d2-8b53-eb256e3b7435 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:56.760506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a4675-cc15-47d2-8b53-eb256e3b7435 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:56.760506 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a4675-cc15-47d2-8b53-eb256e3b7435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:56.809822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-297a4675-cc15-47d2-8b53-eb256e3b7435 None None] MFA Rules not processed for user `6bf35c256e554095b0561b8e41d68eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:33:56.811923 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-297a4675-cc15-47d2-8b53-eb256e3b7435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:56.945585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1202/2385] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:33:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:33:56.952593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:56.957418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:57.061190 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:57.120073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1466d-c8c5-46bc-a2c7-89cf0bac7f13 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:57.136663 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f3408-57f2-4425-94eb-1e4987d8b780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:57.137828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f3408-57f2-4425-94eb-1e4987d8b780 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:57.138235 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f3408-57f2-4425-94eb-1e4987d8b780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:57.138618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f3408-57f2-4425-94eb-1e4987d8b780 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:57.140414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f3408-57f2-4425-94eb-1e4987d8b780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:57.143632 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f3408-57f2-4425-94eb-1e4987d8b780 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:57.201432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1184/2386] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:33:56 2022] POST /identity/v3/projects => generated 383 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:33:57.215304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a4675-cc15-47d2-8b53-eb256e3b7435 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:57.260170 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a4675-cc15-47d2-8b53-eb256e3b7435 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:57.422565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97682689-62fd-496b-850c-fe710461eab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:57.423964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97682689-62fd-496b-850c-fe710461eab9 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:57.424465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97682689-62fd-496b-850c-fe710461eab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:57.425027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97682689-62fd-496b-850c-fe710461eab9 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:57.426322 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97682689-62fd-496b-850c-fe710461eab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:57.431264 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97682689-62fd-496b-850c-fe710461eab9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:57.488340 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1203/2387] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:33:57 2022] POST /identity/v3/users => generated 298 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:33:57.489765 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f3408-57f2-4425-94eb-1e4987d8b780 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:57.512893 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f3408-57f2-4425-94eb-1e4987d8b780 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:57.525332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f24812-4287-4efe-b2f5-029eee195948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:57.526423 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24812-4287-4efe-b2f5-029eee195948 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:57.526882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24812-4287-4efe-b2f5-029eee195948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:57.527340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24812-4287-4efe-b2f5-029eee195948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:57.528840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f24812-4287-4efe-b2f5-029eee195948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:57.531760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f24812-4287-4efe-b2f5-029eee195948 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:57.576000 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1185/2388] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:33:57.584329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97682689-62fd-496b-850c-fe710461eab9 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:57.609775 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97682689-62fd-496b-850c-fe710461eab9 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:57.618806 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307822f-1417-454a-b89f-03fa286dd1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:57.620442 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307822f-1417-454a-b89f-03fa286dd1a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:57.620442 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307822f-1417-454a-b89f-03fa286dd1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:57.620936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307822f-1417-454a-b89f-03fa286dd1a4 admin admin] PATH_INFO: `/v3/projects/d9d870557a4f4675a743ad86465e109d/users/de4df52bbf9c4a6ca14b4a6d0983327b/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:57.687146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307822f-1417-454a-b89f-03fa286dd1a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d870557a4f4675a743ad86465e109d, user_id=de4df52bbf9c4a6ca14b4a6d0983327b, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:57.690782 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307822f-1417-454a-b89f-03fa286dd1a4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:57.729423 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1204/2389] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:57 2022] PUT /identity/v3/projects/d9d870557a4f4675a743ad86465e109d/users/de4df52bbf9c4a6ca14b4a6d0983327b/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:33:57.736001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f24812-4287-4efe-b2f5-029eee195948 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:57.755638 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f24812-4287-4efe-b2f5-029eee195948 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:57.935952 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc25e44-c486-410e-a2d4-9e58481a694d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:57.937238 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc25e44-c486-410e-a2d4-9e58481a694d admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:57.937602 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc25e44-c486-410e-a2d4-9e58481a694d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:57.938099 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc25e44-c486-410e-a2d4-9e58481a694d admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:57.939784 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc25e44-c486-410e-a2d4-9e58481a694d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:57.944731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc25e44-c486-410e-a2d4-9e58481a694d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:57.965278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1186/2390] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:33:57.971607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307822f-1417-454a-b89f-03fa286dd1a4 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:58.002794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307822f-1417-454a-b89f-03fa286dd1a4 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:58.012240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c81c69-1c32-4d43-9437-2bd18bd8142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:58.019475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c81c69-1c32-4d43-9437-2bd18bd8142d admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:58.019862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c81c69-1c32-4d43-9437-2bd18bd8142d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:58.020578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c81c69-1c32-4d43-9437-2bd18bd8142d admin admin] PATH_INFO: `/v3/projects/d9d870557a4f4675a743ad86465e109d/users/de4df52bbf9c4a6ca14b4a6d0983327b/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:58.025507 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c81c69-1c32-4d43-9437-2bd18bd8142d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d870557a4f4675a743ad86465e109d, user_id=de4df52bbf9c4a6ca14b4a6d0983327b, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:58.029875 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c81c69-1c32-4d43-9437-2bd18bd8142d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:58.049925 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1205/2391] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:33:57 2022] PUT /identity/v3/projects/d9d870557a4f4675a743ad86465e109d/users/de4df52bbf9c4a6ca14b4a6d0983327b/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:07.852386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bb3cd-db18-4387-82c6-9c70cc762b86 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:07.854526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bb3cd-db18-4387-82c6-9c70cc762b86 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:07.854526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bb3cd-db18-4387-82c6-9c70cc762b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:07.953799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-aa9bb3cd-db18-4387-82c6-9c70cc762b86 None None] MFA Rules not processed for user `de4df52bbf9c4a6ca14b4a6d0983327b`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:07.967390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-aa9bb3cd-db18-4387-82c6-9c70cc762b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:08.042600 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:08.158249 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1187/2392] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:34:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:08.250311 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c81c69-1c32-4d43-9437-2bd18bd8142d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:08.253591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e6c81c69-1c32-4d43-9437-2bd18bd8142d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:08.411312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c81c69-1c32-4d43-9437-2bd18bd8142d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:08.418972 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dcdec-1262-4ed5-a5a6-2a49e5c3448a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47429aec6d8a4339b4ec0fb32b25e90b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:08.420066 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dcdec-1262-4ed5-a5a6-2a49e5c3448a service glance] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:08.420560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dcdec-1262-4ed5-a5a6-2a49e5c3448a service glance] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:08.421044 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dcdec-1262-4ed5-a5a6-2a49e5c3448a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:08.552726 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dcdec-1262-4ed5-a5a6-2a49e5c3448a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:08.557433 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dcdec-1262-4ed5-a5a6-2a49e5c3448a service glance] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:08.576526 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1206/2393] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:08.888688 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcc8ca-cd07-4456-9fed-ceb0f6ff2bab None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:08.890244 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcc8ca-cd07-4456-9fed-ceb0f6ff2bab None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:08.890244 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcc8ca-cd07-4456-9fed-ceb0f6ff2bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:08.929215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c3bcc8ca-cd07-4456-9fed-ceb0f6ff2bab None None] MFA Rules not processed for user `0327aa38835f41a7a82802f9cad2e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:08.930521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c3bcc8ca-cd07-4456-9fed-ceb0f6ff2bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:08.991641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:09.051113 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1188/2394] 10.222.0.52 () {58 vars in 1009 bytes} [Mon Aug 29 20:34:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:09.070325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dcdec-1262-4ed5-a5a6-2a49e5c3448a service glance] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:09.073021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c03dcdec-1262-4ed5-a5a6-2a49e5c3448a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:09.207950 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dcdec-1262-4ed5-a5a6-2a49e5c3448a service glance] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:09.218312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce080e-1205-42f7-890e-b83a57bce981 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9791ea73d46b191ad9fc146297565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:09.219421 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce080e-1205-42f7-890e-b83a57bce981 service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:09.219941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce080e-1205-42f7-890e-b83a57bce981 service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:09.220435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce080e-1205-42f7-890e-b83a57bce981 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:09.237652 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce080e-1205-42f7-890e-b83a57bce981 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:09.240970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce080e-1205-42f7-890e-b83a57bce981 service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:09.257899 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1207/2395] 10.222.0.52 () {60 vars in 1384 bytes} [Mon Aug 29 20:34:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 20:34:19.042302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=9 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:19.250637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=80 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:22.622134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140937a5-61dd-48e6-9701-3d5df56960f3 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:22.622947 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140937a5-61dd-48e6-9701-3d5df56960f3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:22.623088 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140937a5-61dd-48e6-9701-3d5df56960f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:22.651110 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-140937a5-61dd-48e6-9701-3d5df56960f3 None None] MFA Rules not processed for user `6bf35c256e554095b0561b8e41d68eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:22.652942 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-140937a5-61dd-48e6-9701-3d5df56960f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:22.664574 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1189/2396] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:34:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:34:24.904630 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce080e-1205-42f7-890e-b83a57bce981 service swift] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:24.909092 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d6ce080e-1205-42f7-890e-b83a57bce981 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:25.037735 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce080e-1205-42f7-890e-b83a57bce981 service swift] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:25.047718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc48eb4-3462-4c42-b92b-a23d764e11cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8295272eec349f8aa38e44c861faa47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:25.048744 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc48eb4-3462-4c42-b92b-a23d764e11cd service placement] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:25.049230 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc48eb4-3462-4c42-b92b-a23d764e11cd service placement] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:25.049750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc48eb4-3462-4c42-b92b-a23d764e11cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:25.053131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bbc48eb4-3462-4c42-b92b-a23d764e11cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:25.074914 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc48eb4-3462-4c42-b92b-a23d764e11cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:25.077967 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc48eb4-3462-4c42-b92b-a23d764e11cd service placement] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:25.095840 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1208/2397] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:25.995995 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec0d41-94b8-4128-b6dd-db51b40feefd None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:25.996832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec0d41-94b8-4128-b6dd-db51b40feefd None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:25.997020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec0d41-94b8-4128-b6dd-db51b40feefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:26.030281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-afec0d41-94b8-4128-b6dd-db51b40feefd None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:26.032343 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-afec0d41-94b8-4128-b6dd-db51b40feefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:26.133525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1190/2398] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Aug 29 20:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:26.166870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc48eb4-3462-4c42-b92b-a23d764e11cd service placement] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:26.169128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bbc48eb4-3462-4c42-b92b-a23d764e11cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:26.326031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc48eb4-3462-4c42-b92b-a23d764e11cd service placement] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:26.339574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd972f2-acf6-4081-acaf-13e6bbbbd722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:26.340848 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd972f2-acf6-4081-acaf-13e6bbbbd722 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:26.341642 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd972f2-acf6-4081-acaf-13e6bbbbd722 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:26.342173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd972f2-acf6-4081-acaf-13e6bbbbd722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:26.364835 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd972f2-acf6-4081-acaf-13e6bbbbd722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:26.368837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd972f2-acf6-4081-acaf-13e6bbbbd722 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:26.385426 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1209/2399] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:34:27.684368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7c9ac-94f2-4f0b-ad46-5152ee3bd68a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:27.685044 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7c9ac-94f2-4f0b-ad46-5152ee3bd68a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:27.685392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7c9ac-94f2-4f0b-ad46-5152ee3bd68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:27.757193 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-75c7c9ac-94f2-4f0b-ad46-5152ee3bd68a None None] MFA Rules not processed for user `0327aa38835f41a7a82802f9cad2e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:27.760084 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-75c7c9ac-94f2-4f0b-ad46-5152ee3bd68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:27.784243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1191/2400] 10.222.0.52 () {58 vars in 1009 bytes} [Mon Aug 29 20:34:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:27.810845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd972f2-acf6-4081-acaf-13e6bbbbd722 service nova] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:27.833695 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd972f2-acf6-4081-acaf-13e6bbbbd722 service nova] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:27.842386 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a152e17-4da5-492c-8582-f335e6ce6c58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9791ea73d46b191ad9fc146297565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:27.843292 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a152e17-4da5-492c-8582-f335e6ce6c58 service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:27.843632 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a152e17-4da5-492c-8582-f335e6ce6c58 service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:27.843971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a152e17-4da5-492c-8582-f335e6ce6c58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:27.859902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a152e17-4da5-492c-8582-f335e6ce6c58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:27.867869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a152e17-4da5-492c-8582-f335e6ce6c58 service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:27.877927 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1210/2401] 10.222.0.52 () {60 vars in 1384 bytes} [Mon Aug 29 20:34:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:34:37.736778 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=33 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:37.870782 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=72 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:40.837336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c1743-c0ac-4708-81ca-29bed120ed08 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:40.838350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c1743-c0ac-4708-81ca-29bed120ed08 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:40.839194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c1743-c0ac-4708-81ca-29bed120ed08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:40.882991 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-439c1743-c0ac-4708-81ca-29bed120ed08 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:40.885562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-439c1743-c0ac-4708-81ca-29bed120ed08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:40.902732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1192/2402] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Aug 29 20:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:41.285677 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a152e17-4da5-492c-8582-f335e6ce6c58 service swift] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:41.295232 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5a152e17-4da5-492c-8582-f335e6ce6c58 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:41.333917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a152e17-4da5-492c-8582-f335e6ce6c58 service swift] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:41.334206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ded94-6759-4b55-942c-392d61de24cf None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:41.334442 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ded94-6759-4b55-942c-392d61de24cf None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:41.335164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ded94-6759-4b55-942c-392d61de24cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:41.366682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1d4e1-885a-4d6f-96b4-e9092b825518 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:41.367526 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1d4e1-885a-4d6f-96b4-e9092b825518 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:41.367812 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1d4e1-885a-4d6f-96b4-e9092b825518 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:41.368130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1d4e1-885a-4d6f-96b4-e9092b825518 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:41.387445 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d00ded94-6759-4b55-942c-392d61de24cf None None] MFA Rules not processed for user `0327aa38835f41a7a82802f9cad2e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:41.388006 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1d4e1-885a-4d6f-96b4-e9092b825518 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:41.390950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d00ded94-6759-4b55-942c-392d61de24cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:41.391774 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1d4e1-885a-4d6f-96b4-e9092b825518 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:41.419329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1193/2403] 10.222.0.52 () {58 vars in 1009 bytes} [Mon Aug 29 20:34:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:41.420499 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1211/2404] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:41.473148 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ded94-6759-4b55-942c-392d61de24cf None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:41.502013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ded94-6759-4b55-942c-392d61de24cf None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:41.523569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748777ed-aa6e-4c2c-818c-f5c8a50efbdb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9791ea73d46b191ad9fc146297565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:41.524782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748777ed-aa6e-4c2c-818c-f5c8a50efbdb service swift] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:41.525578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748777ed-aa6e-4c2c-818c-f5c8a50efbdb service swift] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:41.526131 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748777ed-aa6e-4c2c-818c-f5c8a50efbdb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:41.545789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748777ed-aa6e-4c2c-818c-f5c8a50efbdb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:41.551192 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748777ed-aa6e-4c2c-818c-f5c8a50efbdb service swift] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:41.571774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1194/2405] 10.222.0.52 () {60 vars in 1384 bytes} [Mon Aug 29 20:34:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:34:46.076991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc856b-5ee4-4e1d-b91f-03dc220df76e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:46.078677 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc856b-5ee4-4e1d-b91f-03dc220df76e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:46.079331 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc856b-5ee4-4e1d-b91f-03dc220df76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:46.181218 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a8dc856b-5ee4-4e1d-b91f-03dc220df76e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:46.190123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a8dc856b-5ee4-4e1d-b91f-03dc220df76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:46.255742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1212/2406] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Aug 29 20:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:46.284844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748777ed-aa6e-4c2c-818c-f5c8a50efbdb service swift] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:46.329255 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748777ed-aa6e-4c2c-818c-f5c8a50efbdb service swift] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:46.345880 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18d80d-837e-49ea-9cf6-64086a5a0bb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:46.347759 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18d80d-837e-49ea-9cf6-64086a5a0bb0 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:46.348360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18d80d-837e-49ea-9cf6-64086a5a0bb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:46.348804 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18d80d-837e-49ea-9cf6-64086a5a0bb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:46.364058 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18d80d-837e-49ea-9cf6-64086a5a0bb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:46.366416 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18d80d-837e-49ea-9cf6-64086a5a0bb0 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:46.392709 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1195/2407] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:50.469567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d63a7-4108-4d2d-ace3-3487542bf3cb None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:50.470925 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d63a7-4108-4d2d-ace3-3487542bf3cb None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:50.471441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d63a7-4108-4d2d-ace3-3487542bf3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:50.558447 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-688d63a7-4108-4d2d-ace3-3487542bf3cb None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:50.563750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-688d63a7-4108-4d2d-ace3-3487542bf3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:50.603715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1213/2408] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Aug 29 20:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:34:50.667417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18d80d-837e-49ea-9cf6-64086a5a0bb0 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:50.693700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18d80d-837e-49ea-9cf6-64086a5a0bb0 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:50.704741 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dfa8d-55ce-49e4-ae4e-33455886d50a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:50.707292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dfa8d-55ce-49e4-ae4e-33455886d50a service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:50.708326 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dfa8d-55ce-49e4-ae4e-33455886d50a service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:50.709111 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dfa8d-55ce-49e4-ae4e-33455886d50a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:50.743285 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119dfa8d-55ce-49e4-ae4e-33455886d50a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:50.759545 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119dfa8d-55ce-49e4-ae4e-33455886d50a service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:50.775828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1196/2409] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:57.080887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd03816-9dcc-44cc-bedc-9069a813faa1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:57.086578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd03816-9dcc-44cc-bedc-9069a813faa1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:57.090167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd03816-9dcc-44cc-bedc-9069a813faa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:57.164690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5fd03816-9dcc-44cc-bedc-9069a813faa1 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:57.167140 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5fd03816-9dcc-44cc-bedc-9069a813faa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:57.183204 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1214/2410] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Aug 29 20:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:57.666197 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dfa8d-55ce-49e4-ae4e-33455886d50a service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:57.679692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dfa8d-55ce-49e4-ae4e-33455886d50a service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:57.686513 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3cc78-d98b-428e-a207-d10bf4bb2401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:57.687175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3cc78-d98b-428e-a207-d10bf4bb2401 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:57.687462 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3cc78-d98b-428e-a207-d10bf4bb2401 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:57.687728 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3cc78-d98b-428e-a207-d10bf4bb2401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:57.699613 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3cc78-d98b-428e-a207-d10bf4bb2401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:57.701760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3cc78-d98b-428e-a207-d10bf4bb2401 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:57.714826 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1197/2411] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:35:01.491659 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1879d-4f48-4881-b90b-98a3c76a3413 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:01.492302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1879d-4f48-4881-b90b-98a3c76a3413 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:01.492302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1879d-4f48-4881-b90b-98a3c76a3413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:01.521491 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c3c1879d-4f48-4881-b90b-98a3c76a3413 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:01.521491 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c3c1879d-4f48-4881-b90b-98a3c76a3413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:01.538577 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1215/2412] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Aug 29 20:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:01.576677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3cc78-d98b-428e-a207-d10bf4bb2401 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:01.597160 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3cc78-d98b-428e-a207-d10bf4bb2401 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:01.604678 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89504c92-9ca2-4c0c-bc80-faefa1c6901e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:01.605322 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89504c92-9ca2-4c0c-bc80-faefa1c6901e service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:01.605638 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89504c92-9ca2-4c0c-bc80-faefa1c6901e service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:01.605905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89504c92-9ca2-4c0c-bc80-faefa1c6901e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:01.618384 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89504c92-9ca2-4c0c-bc80-faefa1c6901e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:01.620376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89504c92-9ca2-4c0c-bc80-faefa1c6901e service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:01.632978 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1198/2413] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:35:05.284492 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305fcf6-6970-4083-b534-4b2e310286c1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:05.285601 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305fcf6-6970-4083-b534-4b2e310286c1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:05.285803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305fcf6-6970-4083-b534-4b2e310286c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:05.317050 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-8305fcf6-6970-4083-b534-4b2e310286c1 None None] MFA Rules not processed for user `960befc2f96b4565b9a99026d906f3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:05.318332 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8305fcf6-6970-4083-b534-4b2e310286c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:05.406730 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1216/2414] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:35:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:35:06.111121 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d92675-4385-4203-be32-ee4cbe505322 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:06.113336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d92675-4385-4203-be32-ee4cbe505322 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:06.113828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d92675-4385-4203-be32-ee4cbe505322 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:06.116211 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1199/2415] 10.222.0.52 () {54 vars in 921 bytes} [Mon Aug 29 20:35:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:35:06.125278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e4ded-a2e9-4c36-b9e5-f6b13a04f8ff None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:06.125872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e4ded-a2e9-4c36-b9e5-f6b13a04f8ff None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:06.126370 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e4ded-a2e9-4c36-b9e5-f6b13a04f8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:06.155374 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-398e4ded-a2e9-4c36-b9e5-f6b13a04f8ff None None] MFA Rules not processed for user `9c95d16fd4da4fa7987b893eae0b3ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:06.157239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-398e4ded-a2e9-4c36-b9e5-f6b13a04f8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:06.170552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1217/2416] 10.222.0.52 () {58 vars in 1018 bytes} [Mon Aug 29 20:35:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:06.211346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d92675-4385-4203-be32-ee4cbe505322 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:06.214222 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-35d92675-4385-4203-be32-ee4cbe505322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:06.253560 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d92675-4385-4203-be32-ee4cbe505322 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:06.261264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0be70-b7d3-4eab-9e17-9a1d4a6d6992 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47429aec6d8a4339b4ec0fb32b25e90b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:06.262143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0be70-b7d3-4eab-9e17-9a1d4a6d6992 service glance] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:06.262880 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0be70-b7d3-4eab-9e17-9a1d4a6d6992 service glance] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:06.263664 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0be70-b7d3-4eab-9e17-9a1d4a6d6992 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:06.294137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0be70-b7d3-4eab-9e17-9a1d4a6d6992 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:06.297069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0be70-b7d3-4eab-9e17-9a1d4a6d6992 service glance] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:06.321849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1200/2417] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:35:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:35:06.524410 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5dac0-0484-48d3-9277-b2ebff12c9ff None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:06.524938 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5dac0-0484-48d3-9277-b2ebff12c9ff None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:06.525327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5dac0-0484-48d3-9277-b2ebff12c9ff None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:06.527547 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1218/2418] 10.222.0.52 () {54 vars in 921 bytes} [Mon Aug 29 20:35:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:35:06.537919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc821a-062e-417a-968b-157617bc0ca8 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:06.539302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc821a-062e-417a-968b-157617bc0ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:06.539733 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc821a-062e-417a-968b-157617bc0ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:06.566794 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1ffc821a-062e-417a-968b-157617bc0ca8 None None] MFA Rules not processed for user `382b0ee3bd634cc8800f1769c91b7a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:06.568329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1ffc821a-062e-417a-968b-157617bc0ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:06.656319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1201/2419] 10.222.0.52 () {58 vars in 1018 bytes} [Mon Aug 29 20:35:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:35:06.670451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5dac0-0484-48d3-9277-b2ebff12c9ff None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:06.672581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-27d5dac0-0484-48d3-9277-b2ebff12c9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:06.699102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5dac0-0484-48d3-9277-b2ebff12c9ff None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:06.705128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86434d0-78fd-4630-a6a5-c8dc9aac8994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:06.706028 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86434d0-78fd-4630-a6a5-c8dc9aac8994 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:06.706486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86434d0-78fd-4630-a6a5-c8dc9aac8994 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:06.707207 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86434d0-78fd-4630-a6a5-c8dc9aac8994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:06.718160 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86434d0-78fd-4630-a6a5-c8dc9aac8994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:06.719698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86434d0-78fd-4630-a6a5-c8dc9aac8994 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:06.733122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1219/2420] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:35:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:35:06.872929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c39ee2-b60f-47c2-8cc0-cfbe7e7a3643 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:06.874023 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c39ee2-b60f-47c2-8cc0-cfbe7e7a3643 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:06.874701 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c39ee2-b60f-47c2-8cc0-cfbe7e7a3643 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:06.878708 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1202/2421] 10.222.0.52 () {54 vars in 921 bytes} [Mon Aug 29 20:35:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:35:06.885381 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bf839-754e-40ce-9fd2-6f617ebf2e15 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:06.885680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bf839-754e-40ce-9fd2-6f617ebf2e15 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:06.885920 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bf839-754e-40ce-9fd2-6f617ebf2e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:06.926576 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1d0bf839-754e-40ce-9fd2-6f617ebf2e15 None None] MFA Rules not processed for user `9c95d16fd4da4fa7987b893eae0b3ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:06.927945 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1d0bf839-754e-40ce-9fd2-6f617ebf2e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:06.955976 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c39ee2-b60f-47c2-8cc0-cfbe7e7a3643 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:06.960287 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1220/2422] 10.222.0.52 () {58 vars in 1018 bytes} [Mon Aug 29 20:35:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:06.960422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-05c39ee2-b60f-47c2-8cc0-cfbe7e7a3643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:06.971291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bf839-754e-40ce-9fd2-6f617ebf2e15 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:06.999029 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bf839-754e-40ce-9fd2-6f617ebf2e15 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:07.003804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b2031-0cb0-41a4-8e80-47ce156bd051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:07.004807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b2031-0cb0-41a4-8e80-47ce156bd051 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:07.006144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b2031-0cb0-41a4-8e80-47ce156bd051 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:07.006647 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b2031-0cb0-41a4-8e80-47ce156bd051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:07.020240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b2031-0cb0-41a4-8e80-47ce156bd051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:07.023131 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b2031-0cb0-41a4-8e80-47ce156bd051 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:07.040095 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1221/2423] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:35:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:35:07.065047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c39ee2-b60f-47c2-8cc0-cfbe7e7a3643 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:07.077654 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f022b-0731-445f-95d4-822b669b4dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:07.078694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f022b-0731-445f-95d4-822b669b4dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:07.079304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f022b-0731-445f-95d4-822b669b4dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:07.080256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f022b-0731-445f-95d4-822b669b4dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:07.105849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f022b-0731-445f-95d4-822b669b4dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:07.107352 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f022b-0731-445f-95d4-822b669b4dd9 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:07.133805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1203/2424] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:35:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:35:17.033567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=61 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:17.120788 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=71 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:18.524323 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0ae1d-0652-43f1-9167-4269ca0457b1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:18.525493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0ae1d-0652-43f1-9167-4269ca0457b1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:18.525600 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0ae1d-0652-43f1-9167-4269ca0457b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:18.558704 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-64e0ae1d-0652-43f1-9167-4269ca0457b1 None None] MFA Rules not processed for user `0327aa38835f41a7a82802f9cad2e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:18.561239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-64e0ae1d-0652-43f1-9167-4269ca0457b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:18.575164 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1222/2425] 10.222.0.52 () {58 vars in 1009 bytes} [Mon Aug 29 20:35:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:18.596041 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f022b-0731-445f-95d4-822b669b4dd9 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:18.619719 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f022b-0731-445f-95d4-822b669b4dd9 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:18.627709 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f1543-281d-4213-8ac3-e9e9cdecfc6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9791ea73d46b191ad9fc146297565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:18.629303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1543-281d-4213-8ac3-e9e9cdecfc6c service swift] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:18.630145 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1543-281d-4213-8ac3-e9e9cdecfc6c service swift] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:18.630889 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1543-281d-4213-8ac3-e9e9cdecfc6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:18.646216 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f1543-281d-4213-8ac3-e9e9cdecfc6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:18.648558 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f1543-281d-4213-8ac3-e9e9cdecfc6c service swift] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:18.669045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1204/2426] 10.222.0.52 () {60 vars in 1384 bytes} [Mon Aug 29 20:35:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:35:22.612031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de5306-0d92-4785-b284-daa47ee8620c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:22.613019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de5306-0d92-4785-b284-daa47ee8620c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:22.613019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de5306-0d92-4785-b284-daa47ee8620c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:22.635961 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-92de5306-0d92-4785-b284-daa47ee8620c None None] MFA Rules not processed for user `c68df8a70f884874b5ed7fea0e986c88`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:22.638050 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-92de5306-0d92-4785-b284-daa47ee8620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:22.762019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1223/2427] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:35:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:28.658453 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=6 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:32.717184 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=28 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:37.486831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48419aa3-a1d4-4070-89c4-0c5aa339d742 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:37.488151 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48419aa3-a1d4-4070-89c4-0c5aa339d742 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:37.489492 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48419aa3-a1d4-4070-89c4-0c5aa339d742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:37.515656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-48419aa3-a1d4-4070-89c4-0c5aa339d742 None None] MFA Rules not processed for user `46da39cde1ca40c7a84bb457f0e3bf77`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:37.517473 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-48419aa3-a1d4-4070-89c4-0c5aa339d742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:37.642551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1205/2428] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:35:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:39.839261 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f34f8-941d-4d45-acfc-a3e365c289a0 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:39.840142 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f34f8-941d-4d45-acfc-a3e365c289a0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:39.840309 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f34f8-941d-4d45-acfc-a3e365c289a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:39.866828 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6f2f34f8-941d-4d45-acfc-a3e365c289a0 None None] MFA Rules not processed for user `0327aa38835f41a7a82802f9cad2e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:39.869105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6f2f34f8-941d-4d45-acfc-a3e365c289a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:39.881597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1224/2429] 10.222.0.52 () {58 vars in 967 bytes} [Mon Aug 29 20:35:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:39.893351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48419aa3-a1d4-4070-89c4-0c5aa339d742 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:39.907331 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48419aa3-a1d4-4070-89c4-0c5aa339d742 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:39.914812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878bcf9-2132-48cc-ab17-fc1aaef58926 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9791ea73d46b191ad9fc146297565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:39.915886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878bcf9-2132-48cc-ab17-fc1aaef58926 service swift] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:39.916590 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878bcf9-2132-48cc-ab17-fc1aaef58926 service swift] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:39.916986 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878bcf9-2132-48cc-ab17-fc1aaef58926 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:39.927822 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878bcf9-2132-48cc-ab17-fc1aaef58926 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:39.929964 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878bcf9-2132-48cc-ab17-fc1aaef58926 service swift] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:39.940871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1206/2430] 10.222.0.52 () {60 vars in 1384 bytes} [Mon Aug 29 20:35:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 20:35:49.858494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:49.935783 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=31 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:57.573617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb031e53-8909-498e-bf8a-483ddf56b703 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:57.574173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb031e53-8909-498e-bf8a-483ddf56b703 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:57.574173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb031e53-8909-498e-bf8a-483ddf56b703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:57.595857 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-eb031e53-8909-498e-bf8a-483ddf56b703 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:57.597101 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-eb031e53-8909-498e-bf8a-483ddf56b703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:57.606487 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1225/2431] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Aug 29 20:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:35:57.631080 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878bcf9-2132-48cc-ab17-fc1aaef58926 service swift] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:57.644438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878bcf9-2132-48cc-ab17-fc1aaef58926 service swift] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:57.650598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31582718-c283-42ed-82eb-7bfcf56ccccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:57.651226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31582718-c283-42ed-82eb-7bfcf56ccccb service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:57.651502 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31582718-c283-42ed-82eb-7bfcf56ccccb service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:57.651953 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31582718-c283-42ed-82eb-7bfcf56ccccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:57.662097 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31582718-c283-42ed-82eb-7bfcf56ccccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:57.663821 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31582718-c283-42ed-82eb-7bfcf56ccccb service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:57.675754 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1207/2432] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:35:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:01.927865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125a814-5552-4747-a9b7-5ef8c87b4c95 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:01.928762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125a814-5552-4747-a9b7-5ef8c87b4c95 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:01.928762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125a814-5552-4747-a9b7-5ef8c87b4c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:01.951570 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-0125a814-5552-4747-a9b7-5ef8c87b4c95 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:01.952948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0125a814-5552-4747-a9b7-5ef8c87b4c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:01.962996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1226/2433] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Aug 29 20:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:36:01.998259 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31582718-c283-42ed-82eb-7bfcf56ccccb service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:02.011251 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31582718-c283-42ed-82eb-7bfcf56ccccb service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:02.017898 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23829db-e13a-4fbb-b4d1-98e1c2382332 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:02.018533 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23829db-e13a-4fbb-b4d1-98e1c2382332 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:02.018908 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23829db-e13a-4fbb-b4d1-98e1c2382332 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:02.019232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23829db-e13a-4fbb-b4d1-98e1c2382332 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:02.029119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23829db-e13a-4fbb-b4d1-98e1c2382332 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:02.030791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23829db-e13a-4fbb-b4d1-98e1c2382332 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:02.055642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1208/2434] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:05.005900 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbe641-757e-4c9d-8e62-33bc60521e85 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:05.006797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbe641-757e-4c9d-8e62-33bc60521e85 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:05.006797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbe641-757e-4c9d-8e62-33bc60521e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:05.030870 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-0fbbe641-757e-4c9d-8e62-33bc60521e85 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:05.032416 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0fbbe641-757e-4c9d-8e62-33bc60521e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:05.042832 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1227/2435] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Aug 29 20:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:05.067416 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23829db-e13a-4fbb-b4d1-98e1c2382332 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:05.080633 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23829db-e13a-4fbb-b4d1-98e1c2382332 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:05.087121 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bc152-cd6a-4ffb-a232-b343f93d3872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:05.087823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bc152-cd6a-4ffb-a232-b343f93d3872 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:05.088130 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bc152-cd6a-4ffb-a232-b343f93d3872 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:05.088500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bc152-cd6a-4ffb-a232-b343f93d3872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:05.099741 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bc152-cd6a-4ffb-a232-b343f93d3872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:05.101564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bc152-cd6a-4ffb-a232-b343f93d3872 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:05.114024 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1209/2436] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:08.230242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad816cd-e4b1-4edc-81ce-3d9dedd5a26d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:08.230881 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad816cd-e4b1-4edc-81ce-3d9dedd5a26d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:08.231138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad816cd-e4b1-4edc-81ce-3d9dedd5a26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:08.252896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3ad816cd-e4b1-4edc-81ce-3d9dedd5a26d None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:08.254178 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3ad816cd-e4b1-4edc-81ce-3d9dedd5a26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:08.262835 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1228/2437] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Aug 29 20:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:08.291227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bc152-cd6a-4ffb-a232-b343f93d3872 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:08.303914 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bc152-cd6a-4ffb-a232-b343f93d3872 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:08.310347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b6c6f-8613-49e4-ac17-fd01e80d8ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:08.310996 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b6c6f-8613-49e4-ac17-fd01e80d8ab7 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:08.311317 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b6c6f-8613-49e4-ac17-fd01e80d8ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:08.311594 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b6c6f-8613-49e4-ac17-fd01e80d8ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:08.322006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b6c6f-8613-49e4-ac17-fd01e80d8ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:08.323612 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b6c6f-8613-49e4-ac17-fd01e80d8ab7 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:08.334118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1210/2438] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:12.446074 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169de65-3a52-4bed-90f8-fa5912e25ce8 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:12.446717 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169de65-3a52-4bed-90f8-fa5912e25ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:12.446717 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169de65-3a52-4bed-90f8-fa5912e25ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:12.471842 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3169de65-3a52-4bed-90f8-fa5912e25ce8 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:12.473236 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3169de65-3a52-4bed-90f8-fa5912e25ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:12.485827 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1229/2439] 10.222.0.69 () {58 vars in 1016 bytes} [Mon Aug 29 20:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:12.512912 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b6c6f-8613-49e4-ac17-fd01e80d8ab7 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:12.524884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b6c6f-8613-49e4-ac17-fd01e80d8ab7 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:12.530994 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403387a-1d92-4ef9-a6e7-3d8da5c99da8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:12.531944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403387a-1d92-4ef9-a6e7-3d8da5c99da8 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:12.532374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403387a-1d92-4ef9-a6e7-3d8da5c99da8 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:12.532768 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403387a-1d92-4ef9-a6e7-3d8da5c99da8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:12.542217 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403387a-1d92-4ef9-a6e7-3d8da5c99da8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:12.543761 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403387a-1d92-4ef9-a6e7-3d8da5c99da8 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:12.558703 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1211/2440] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:16.589638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169de65-3a52-4bed-90f8-fa5912e25ce8 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:16.591332 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3169de65-3a52-4bed-90f8-fa5912e25ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:16.657100 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169de65-3a52-4bed-90f8-fa5912e25ce8 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:16.660769 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7774de-2291-409f-be4f-b673ca7161c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:16.661427 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7774de-2291-409f-be4f-b673ca7161c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:16.661767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7774de-2291-409f-be4f-b673ca7161c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:16.661976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7774de-2291-409f-be4f-b673ca7161c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:16.664022 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2f7774de-2291-409f-be4f-b673ca7161c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:16.678277 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7774de-2291-409f-be4f-b673ca7161c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:16.679741 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7774de-2291-409f-be4f-b673ca7161c2 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:16.692231 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1230/2441] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:19.386474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403387a-1d92-4ef9-a6e7-3d8da5c99da8 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:19.400933 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403387a-1d92-4ef9-a6e7-3d8da5c99da8 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:19.404711 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168abc23-bf7a-4567-ad9b-60727a5fcaeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:19.405411 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168abc23-bf7a-4567-ad9b-60727a5fcaeb service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:19.405670 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168abc23-bf7a-4567-ad9b-60727a5fcaeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:19.406008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168abc23-bf7a-4567-ad9b-60727a5fcaeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:19.408434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-168abc23-bf7a-4567-ad9b-60727a5fcaeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:19.423660 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168abc23-bf7a-4567-ad9b-60727a5fcaeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:19.425154 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168abc23-bf7a-4567-ad9b-60727a5fcaeb service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:19.439046 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1212/2442] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:26.686524 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=41 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:27.217696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7774de-2291-409f-be4f-b673ca7161c2 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:27.220266 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2f7774de-2291-409f-be4f-b673ca7161c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:27.237640 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7774de-2291-409f-be4f-b673ca7161c2 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:27.242602 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76602b-32bf-4a5f-ae76-66464f06719f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:27.243280 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76602b-32bf-4a5f-ae76-66464f06719f service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:27.243560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76602b-32bf-4a5f-ae76-66464f06719f service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:27.245025 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76602b-32bf-4a5f-ae76-66464f06719f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:27.246329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-be76602b-32bf-4a5f-ae76-66464f06719f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:27.268878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76602b-32bf-4a5f-ae76-66464f06719f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:27.270607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76602b-32bf-4a5f-ae76-66464f06719f service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:27.282306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1231/2443] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:27 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:29.432325 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=36 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:32.708394 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168abc23-bf7a-4567-ad9b-60727a5fcaeb service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:32.719721 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168abc23-bf7a-4567-ad9b-60727a5fcaeb service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:32.725493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c018975-0de3-43b9-b940-729f7869a1b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:32.726123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c018975-0de3-43b9-b940-729f7869a1b0 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:32.726383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c018975-0de3-43b9-b940-729f7869a1b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:32.726664 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c018975-0de3-43b9-b940-729f7869a1b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:32.728505 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0c018975-0de3-43b9-b940-729f7869a1b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:32.739979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c018975-0de3-43b9-b940-729f7869a1b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:32.741605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c018975-0de3-43b9-b940-729f7869a1b0 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:32.752409 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1213/2444] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:37.276656 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=6 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:42.747589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=6 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:44.610694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76602b-32bf-4a5f-ae76-66464f06719f service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:44.624181 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76602b-32bf-4a5f-ae76-66464f06719f service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:44.629680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bc798-229c-4e39-8bc2-c2648e168386 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8295272eec349f8aa38e44c861faa47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:44.630710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bc798-229c-4e39-8bc2-c2648e168386 service placement] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:44.630982 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bc798-229c-4e39-8bc2-c2648e168386 service placement] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:44.631412 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bc798-229c-4e39-8bc2-c2648e168386 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:44.634743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6e7bc798-229c-4e39-8bc2-c2648e168386 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:44.648997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bc798-229c-4e39-8bc2-c2648e168386 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:44.650887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bc798-229c-4e39-8bc2-c2648e168386 service placement] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:44.663758 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1232/2445] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:44.693303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c018975-0de3-43b9-b940-729f7869a1b0 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:44.695777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0c018975-0de3-43b9-b940-729f7869a1b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:44.718065 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c018975-0de3-43b9-b940-729f7869a1b0 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:44.723488 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01829a-f5b6-4675-8852-06453cfc01ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:44.724467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01829a-f5b6-4675-8852-06453cfc01ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:44.724764 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01829a-f5b6-4675-8852-06453cfc01ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:44.725033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01829a-f5b6-4675-8852-06453cfc01ba admin admin] PATH_INFO: `/v3/users/c68df8a70f884874b5ed7fea0e986c88` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:44.726264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01829a-f5b6-4675-8852-06453cfc01ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c68df8a70f884874b5ed7fea0e986c88)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:44.729437 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01829a-f5b6-4675-8852-06453cfc01ba admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:44.791537 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ff01829a-f5b6-4675-8852-06453cfc01ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c68df8a70f884874b5ed7fea0e986c88'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:36:44.808855 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ff01829a-f5b6-4675-8852-06453cfc01ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c68df8a70f884874b5ed7fea0e986c88'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:36:44.817569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ff01829a-f5b6-4675-8852-06453cfc01ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c68df8a70f884874b5ed7fea0e986c88'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:36:44.818458 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ff01829a-f5b6-4675-8852-06453cfc01ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c68df8a70f884874b5ed7fea0e986c88'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:36:44.827403 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ff01829a-f5b6-4675-8852-06453cfc01ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c68df8a70f884874b5ed7fea0e986c88'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:36:44.837486 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1214/2446] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:36:44 2022] DELETE /identity/v3/users/c68df8a70f884874b5ed7fea0e986c88 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:36:44.968089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a2ceb-0cfe-46ad-b703-d311d120aaa1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:44.968591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a2ceb-0cfe-46ad-b703-d311d120aaa1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:44.968920 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a2ceb-0cfe-46ad-b703-d311d120aaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:44.993291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-926a2ceb-0cfe-46ad-b703-d311d120aaa1 None None] MFA Rules not processed for user `3340cc123b0d4ff089889b133b32815e`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:44.994583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-926a2ceb-0cfe-46ad-b703-d311d120aaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:45.061979 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1233/2447] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:36:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:45.088366 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01829a-f5b6-4675-8852-06453cfc01ba admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:45.090127 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ff01829a-f5b6-4675-8852-06453cfc01ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:45.187498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01829a-f5b6-4675-8852-06453cfc01ba admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:45.192718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0788061-ec5b-44b7-b91d-3af86a650472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:45.193627 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0788061-ec5b-44b7-b91d-3af86a650472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:45.193907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0788061-ec5b-44b7-b91d-3af86a650472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:45.194447 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0788061-ec5b-44b7-b91d-3af86a650472 admin admin] PATH_INFO: `/v3/projects/16390dcaf6c14eaba9db7ce3e6d24615` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:45.195471 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0788061-ec5b-44b7-b91d-3af86a650472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16390dcaf6c14eaba9db7ce3e6d24615)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:45.197584 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0788061-ec5b-44b7-b91d-3af86a650472 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:45.255443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d0788061-ec5b-44b7-b91d-3af86a650472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16390dcaf6c14eaba9db7ce3e6d24615', 'request_id': 'req-d0788061-ec5b-44b7-b91d-3af86a650472'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:36:45.263755 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d0788061-ec5b-44b7-b91d-3af86a650472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16390dcaf6c14eaba9db7ce3e6d24615', 'request_id': 'req-d0788061-ec5b-44b7-b91d-3af86a650472'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:36:45.270891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d0788061-ec5b-44b7-b91d-3af86a650472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16390dcaf6c14eaba9db7ce3e6d24615', 'request_id': 'req-d0788061-ec5b-44b7-b91d-3af86a650472'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:36:45.283303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d0788061-ec5b-44b7-b91d-3af86a650472 admin admin] The token cache is being invalidate because project 16390dcaf6c14eaba9db7ce3e6d24615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:36:45.286347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d0788061-ec5b-44b7-b91d-3af86a650472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:36:45.286347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d0788061-ec5b-44b7-b91d-3af86a650472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:36:45.287151 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1215/2448] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:36:45 2022] DELETE /identity/v3/projects/16390dcaf6c14eaba9db7ce3e6d24615 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:36:45.297859 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86017502-8236-496c-8eea-0b9c94bf6597 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:45.298779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86017502-8236-496c-8eea-0b9c94bf6597 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:45.299305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86017502-8236-496c-8eea-0b9c94bf6597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:45.325163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-86017502-8236-496c-8eea-0b9c94bf6597 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:45.326615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-86017502-8236-496c-8eea-0b9c94bf6597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:45.407749 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1234/2449] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:45.415931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97474d6-493c-4692-8ab2-28ef1a066bb2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:45.416198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97474d6-493c-4692-8ab2-28ef1a066bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:45.416604 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97474d6-493c-4692-8ab2-28ef1a066bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:45.419241 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86017502-8236-496c-8eea-0b9c94bf6597 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:45.420706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-86017502-8236-496c-8eea-0b9c94bf6597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:45.437423 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:45.484923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e97474d6-493c-4692-8ab2-28ef1a066bb2 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:45.486914 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e97474d6-493c-4692-8ab2-28ef1a066bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:45.497104 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1216/2450] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:45.506101 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97474d6-493c-4692-8ab2-28ef1a066bb2 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:45.531721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86017502-8236-496c-8eea-0b9c94bf6597 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:45.531978 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97474d6-493c-4692-8ab2-28ef1a066bb2 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:45.542410 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1911727-d453-4312-b934-2280bad10114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:45.543067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911727-d453-4312-b934-2280bad10114 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:45.543328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911727-d453-4312-b934-2280bad10114 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:45.543811 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911727-d453-4312-b934-2280bad10114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:45.544934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9f1e5-1f59-4439-a858-525788c7e4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:45.545764 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9f1e5-1f59-4439-a858-525788c7e4ba admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:45.546041 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9f1e5-1f59-4439-a858-525788c7e4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:45.546306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9f1e5-1f59-4439-a858-525788c7e4ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:45.547438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9f1e5-1f59-4439-a858-525788c7e4ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:36:45.547438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9f1e5-1f59-4439-a858-525788c7e4ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:45.548896 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9f1e5-1f59-4439-a858-525788c7e4ba admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:45.551088 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d1911727-d453-4312-b934-2280bad10114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:45.567860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1217/2451] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:36:45.568920 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9f1e5-1f59-4439-a858-525788c7e4ba admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:45.569263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1911727-d453-4312-b934-2280bad10114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:45.571193 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1911727-d453-4312-b934-2280bad10114 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:45.581699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1235/2452] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:45.582872 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9f1e5-1f59-4439-a858-525788c7e4ba admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:45.587794 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480a173-889b-4f80-9daa-d896bbeb0d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:45.588406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480a173-889b-4f80-9daa-d896bbeb0d99 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:45.588834 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480a173-889b-4f80-9daa-d896bbeb0d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:45.590522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480a173-889b-4f80-9daa-d896bbeb0d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:45.590522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480a173-889b-4f80-9daa-d896bbeb0d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:45.592119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480a173-889b-4f80-9daa-d896bbeb0d99 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:45.630722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1218/2453] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:36:45 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:36:45.634724 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1911727-d453-4312-b934-2280bad10114 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:45.658954 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1911727-d453-4312-b934-2280bad10114 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:45.701182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:45.732750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455b276-c8a7-4a32-bcd9-b61be6b66027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:45.733546 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455b276-c8a7-4a32-bcd9-b61be6b66027 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:45.734471 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455b276-c8a7-4a32-bcd9-b61be6b66027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:45.734765 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455b276-c8a7-4a32-bcd9-b61be6b66027 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:45.735581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455b276-c8a7-4a32-bcd9-b61be6b66027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:45.738479 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455b276-c8a7-4a32-bcd9-b61be6b66027 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:45.778888 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1236/2454] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:36:45 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:36:45.782990 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480a173-889b-4f80-9daa-d896bbeb0d99 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:45.795758 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480a173-889b-4f80-9daa-d896bbeb0d99 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:45.801282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd376c-c8d0-4b16-850a-768c1b7dcd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:45.802014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd376c-c8d0-4b16-850a-768c1b7dcd75 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:45.802265 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd376c-c8d0-4b16-850a-768c1b7dcd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:45.802538 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd376c-c8d0-4b16-850a-768c1b7dcd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:45.803407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd376c-c8d0-4b16-850a-768c1b7dcd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:45.805729 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd376c-c8d0-4b16-850a-768c1b7dcd75 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:45.825476 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455b276-c8a7-4a32-bcd9-b61be6b66027 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:45.827720 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1219/2455] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:36:45.837440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455b276-c8a7-4a32-bcd9-b61be6b66027 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:45.845238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a98b1-a881-4aad-89e9-89f9577ff85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:45.846597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a98b1-a881-4aad-89e9-89f9577ff85b admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:45.846872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a98b1-a881-4aad-89e9-89f9577ff85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:45.847137 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a98b1-a881-4aad-89e9-89f9577ff85b admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:45.847791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a98b1-a881-4aad-89e9-89f9577ff85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:45.849621 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a98b1-a881-4aad-89e9-89f9577ff85b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:45.862017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1237/2456] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:36:45.866653 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd376c-c8d0-4b16-850a-768c1b7dcd75 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:45.877745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd376c-c8d0-4b16-850a-768c1b7dcd75 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:45.884338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fd61d-627d-4943-872e-395c6e23e1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:45.885021 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fd61d-627d-4943-872e-395c6e23e1e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:45.885394 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fd61d-627d-4943-872e-395c6e23e1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:45.885760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fd61d-627d-4943-872e-395c6e23e1e6 admin admin] PATH_INFO: `/v3/projects/9567d2d0114e41e6b344083212e9806b/users/92314357a96448648010e7db45cc7bc7/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:45.904714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fd61d-627d-4943-872e-395c6e23e1e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9567d2d0114e41e6b344083212e9806b, user_id=92314357a96448648010e7db45cc7bc7, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:45.907600 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fd61d-627d-4943-872e-395c6e23e1e6 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:45.939090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1220/2457] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:36:45 2022] PUT /identity/v3/projects/9567d2d0114e41e6b344083212e9806b/users/92314357a96448648010e7db45cc7bc7/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:36:45.943935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400f829-acd2-4c9e-90cc-639f63ddc63c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:45.944228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400f829-acd2-4c9e-90cc-639f63ddc63c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:45.944787 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400f829-acd2-4c9e-90cc-639f63ddc63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:45.968385 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7400f829-acd2-4c9e-90cc-639f63ddc63c None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:45.968781 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7400f829-acd2-4c9e-90cc-639f63ddc63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:46.089304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1238/2458] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:36:46.097042 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fd61d-627d-4943-872e-395c6e23e1e6 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:46.168045 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400f829-acd2-4c9e-90cc-639f63ddc63c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:46.170555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7400f829-acd2-4c9e-90cc-639f63ddc63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:46.192727 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fd61d-627d-4943-872e-395c6e23e1e6 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:46.196815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac31009-7109-4acd-8175-a1fa9892aacb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:46.197728 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac31009-7109-4acd-8175-a1fa9892aacb service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:46.198929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac31009-7109-4acd-8175-a1fa9892aacb service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:46.199528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac31009-7109-4acd-8175-a1fa9892aacb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:46.223504 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac31009-7109-4acd-8175-a1fa9892aacb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:46.224996 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac31009-7109-4acd-8175-a1fa9892aacb service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:46.253087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1221/2459] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:46.302385 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400f829-acd2-4c9e-90cc-639f63ddc63c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:46.313141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd116f-325b-40d6-b6d1-1081b18ed39d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8295272eec349f8aa38e44c861faa47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:46.314023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd116f-325b-40d6-b6d1-1081b18ed39d service placement] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:46.314376 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd116f-325b-40d6-b6d1-1081b18ed39d service placement] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:46.314724 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd116f-325b-40d6-b6d1-1081b18ed39d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:46.317751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-77bd116f-325b-40d6-b6d1-1081b18ed39d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:46.332362 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd116f-325b-40d6-b6d1-1081b18ed39d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:46.339050 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd116f-325b-40d6-b6d1-1081b18ed39d service placement] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:46.350779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1239/2460] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:36:47.403554 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac31009-7109-4acd-8175-a1fa9892aacb service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:47.405195 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bac31009-7109-4acd-8175-a1fa9892aacb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:47.423863 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac31009-7109-4acd-8175-a1fa9892aacb service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:47.431974 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa75dc-87bc-4866-9be0-0f3d181e4638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:47.434202 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa75dc-87bc-4866-9be0-0f3d181e4638 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:47.434803 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa75dc-87bc-4866-9be0-0f3d181e4638 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:47.435333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa75dc-87bc-4866-9be0-0f3d181e4638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:47.438624 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0baa75dc-87bc-4866-9be0-0f3d181e4638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:47.461460 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa75dc-87bc-4866-9be0-0f3d181e4638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:47.462943 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa75dc-87bc-4866-9be0-0f3d181e4638 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:47.487787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1222/2461] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:51.947680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecce281-ea4d-4d7a-85b9-6361fa759269 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:51.948673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecce281-ea4d-4d7a-85b9-6361fa759269 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:51.949242 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecce281-ea4d-4d7a-85b9-6361fa759269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:51.972888 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5ecce281-ea4d-4d7a-85b9-6361fa759269 None None] MFA Rules not processed for user `960befc2f96b4565b9a99026d906f3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:51.974641 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5ecce281-ea4d-4d7a-85b9-6361fa759269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:52.028426 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:52.058694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1240/2462] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:36:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:53.429129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa75dc-87bc-4866-9be0-0f3d181e4638 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:53.431875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0baa75dc-87bc-4866-9be0-0f3d181e4638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:53.456426 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecce281-ea4d-4d7a-85b9-6361fa759269 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:53.472328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecce281-ea4d-4d7a-85b9-6361fa759269 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:53.482756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3708d69-afa2-4b3a-b079-dcd6571a8edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:53.485650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3708d69-afa2-4b3a-b079-dcd6571a8edc service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:53.486309 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3708d69-afa2-4b3a-b079-dcd6571a8edc service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:53.487300 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3708d69-afa2-4b3a-b079-dcd6571a8edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:53.494113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b3708d69-afa2-4b3a-b079-dcd6571a8edc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:53.551059 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3708d69-afa2-4b3a-b079-dcd6571a8edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:53.555802 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3708d69-afa2-4b3a-b079-dcd6571a8edc service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:53.583548 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1241/2463] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:36:53.676720 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa75dc-87bc-4866-9be0-0f3d181e4638 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:53.684651 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba1152-b6a1-48c0-8fdd-725c560c8111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:53.685772 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba1152-b6a1-48c0-8fdd-725c560c8111 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:53.687081 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba1152-b6a1-48c0-8fdd-725c560c8111 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:53.687488 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba1152-b6a1-48c0-8fdd-725c560c8111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:53.690522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8dba1152-b6a1-48c0-8fdd-725c560c8111 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:53.710979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba1152-b6a1-48c0-8fdd-725c560c8111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:53.713779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba1152-b6a1-48c0-8fdd-725c560c8111 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:53.761663 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:53.777403 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1223/2464] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:55.639027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5547da5-34cf-4d6c-9c13-562a3b0aad04 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:55.639540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5547da5-34cf-4d6c-9c13-562a3b0aad04 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:55.639540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5547da5-34cf-4d6c-9c13-562a3b0aad04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:55.675488 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c5547da5-34cf-4d6c-9c13-562a3b0aad04 None None] MFA Rules not processed for user `92314357a96448648010e7db45cc7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:55.677063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c5547da5-34cf-4d6c-9c13-562a3b0aad04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:55.813988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1242/2465] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:36:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:55.820042 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba1152-b6a1-48c0-8fdd-725c560c8111 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:55.843315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba1152-b6a1-48c0-8fdd-725c560c8111 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:55.848796 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973097f-e2dc-4640-b3b9-06b3f4fb2cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:55.850038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973097f-e2dc-4640-b3b9-06b3f4fb2cbb admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:55.850483 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973097f-e2dc-4640-b3b9-06b3f4fb2cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:55.851035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973097f-e2dc-4640-b3b9-06b3f4fb2cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:55.851977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973097f-e2dc-4640-b3b9-06b3f4fb2cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:55.854127 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973097f-e2dc-4640-b3b9-06b3f4fb2cbb admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:55.936798 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1224/2466] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:36:55 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:36:55.941077 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5547da5-34cf-4d6c-9c13-562a3b0aad04 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:55.950053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973097f-e2dc-4640-b3b9-06b3f4fb2cbb admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:55.959424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5547da5-34cf-4d6c-9c13-562a3b0aad04 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:56.053694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535bbfd-b2a2-4830-ba81-d1e8bf2e9df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:56.054591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535bbfd-b2a2-4830-ba81-d1e8bf2e9df6 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:56.054874 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535bbfd-b2a2-4830-ba81-d1e8bf2e9df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:56.055138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535bbfd-b2a2-4830-ba81-d1e8bf2e9df6 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:56.055802 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535bbfd-b2a2-4830-ba81-d1e8bf2e9df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:56.058253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535bbfd-b2a2-4830-ba81-d1e8bf2e9df6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:56.090789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1243/2467] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:36:55 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:36:56.095910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973097f-e2dc-4640-b3b9-06b3f4fb2cbb admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:56.096991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535bbfd-b2a2-4830-ba81-d1e8bf2e9df6 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:56.103141 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217e6a9-3710-4519-9a5a-3a8f3f8346b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:56.103884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217e6a9-3710-4519-9a5a-3a8f3f8346b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:56.104269 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217e6a9-3710-4519-9a5a-3a8f3f8346b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:56.110061 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217e6a9-3710-4519-9a5a-3a8f3f8346b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:56.112304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535bbfd-b2a2-4830-ba81-d1e8bf2e9df6 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:56.112464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8217e6a9-3710-4519-9a5a-3a8f3f8346b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:56.121705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75878d94-315b-418c-8f8d-203c0db747a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:56.123127 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75878d94-315b-418c-8f8d-203c0db747a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:56.123953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75878d94-315b-418c-8f8d-203c0db747a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:56.124319 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75878d94-315b-418c-8f8d-203c0db747a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:56.125143 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75878d94-315b-418c-8f8d-203c0db747a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:56.127316 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75878d94-315b-418c-8f8d-203c0db747a2 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:56.131088 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217e6a9-3710-4519-9a5a-3a8f3f8346b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:56.133157 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217e6a9-3710-4519-9a5a-3a8f3f8346b3 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:56.147450 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1244/2468] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:36:56.148714 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75878d94-315b-418c-8f8d-203c0db747a2 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:56.163528 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1225/2469] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:56.181175 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75878d94-315b-418c-8f8d-203c0db747a2 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:56.198379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ebf9b-de64-4ccc-a1b8-f2a4f140c74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:56.201336 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ebf9b-de64-4ccc-a1b8-f2a4f140c74a admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:56.201777 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ebf9b-de64-4ccc-a1b8-f2a4f140c74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:56.203355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ebf9b-de64-4ccc-a1b8-f2a4f140c74a admin admin] PATH_INFO: `/v3/projects/5d4e83f71ba04a8abf99927c2f354954/users/1b25cf016c244b97ba7042b801b728fd/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:56.252336 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ebf9b-de64-4ccc-a1b8-f2a4f140c74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4e83f71ba04a8abf99927c2f354954, user_id=1b25cf016c244b97ba7042b801b728fd, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:56.255434 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ebf9b-de64-4ccc-a1b8-f2a4f140c74a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:56.285673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1245/2470] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:36:56 2022] PUT /identity/v3/projects/5d4e83f71ba04a8abf99927c2f354954/users/1b25cf016c244b97ba7042b801b728fd/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:36:56.287831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217e6a9-3710-4519-9a5a-3a8f3f8346b3 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:56.311470 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217e6a9-3710-4519-9a5a-3a8f3f8346b3 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:56.457436 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e105456-7ff1-4cb7-85f5-1aa8bfe5c997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:56.458446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e105456-7ff1-4cb7-85f5-1aa8bfe5c997 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:56.458904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e105456-7ff1-4cb7-85f5-1aa8bfe5c997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:56.459361 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e105456-7ff1-4cb7-85f5-1aa8bfe5c997 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:56.461215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e105456-7ff1-4cb7-85f5-1aa8bfe5c997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:56.463256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e105456-7ff1-4cb7-85f5-1aa8bfe5c997 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:56.489753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ebf9b-de64-4ccc-a1b8-f2a4f140c74a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:56.492027 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1226/2471] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:36:56.505617 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ebf9b-de64-4ccc-a1b8-f2a4f140c74a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:56.512026 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61f198-7d9d-4905-9c41-b14758934093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:56.512824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61f198-7d9d-4905-9c41-b14758934093 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:56.513268 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61f198-7d9d-4905-9c41-b14758934093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:56.513678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61f198-7d9d-4905-9c41-b14758934093 admin admin] PATH_INFO: `/v3/projects/5d4e83f71ba04a8abf99927c2f354954/users/1b25cf016c244b97ba7042b801b728fd/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:56.516583 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61f198-7d9d-4905-9c41-b14758934093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4e83f71ba04a8abf99927c2f354954, user_id=1b25cf016c244b97ba7042b801b728fd, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:56.519727 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61f198-7d9d-4905-9c41-b14758934093 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:56.536257 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1246/2472] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:36:56 2022] PUT /identity/v3/projects/5d4e83f71ba04a8abf99927c2f354954/users/1b25cf016c244b97ba7042b801b728fd/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:36:59.487029 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcf9ab-904a-4b51-ad79-06f5721c29bf None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:59.487881 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcf9ab-904a-4b51-ad79-06f5721c29bf None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:59.488161 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcf9ab-904a-4b51-ad79-06f5721c29bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:59.512642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-bddcf9ab-904a-4b51-ad79-06f5721c29bf None None] MFA Rules not processed for user `0327aa38835f41a7a82802f9cad2e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:59.514065 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bddcf9ab-904a-4b51-ad79-06f5721c29bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:59.616162 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1227/2473] 10.222.0.52 () {58 vars in 967 bytes} [Mon Aug 29 20:36:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:59.686778 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61f198-7d9d-4905-9c41-b14758934093 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:59.692842 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0a61f198-7d9d-4905-9c41-b14758934093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:59.711926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:59.884469 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61f198-7d9d-4905-9c41-b14758934093 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:59.903243 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777af96-e114-4ef2-af9a-421a3f216f98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9791ea73d46b191ad9fc146297565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:59.903942 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777af96-e114-4ef2-af9a-421a3f216f98 service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:59.904221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777af96-e114-4ef2-af9a-421a3f216f98 service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:59.904504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777af96-e114-4ef2-af9a-421a3f216f98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:59.930017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777af96-e114-4ef2-af9a-421a3f216f98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:59.931778 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777af96-e114-4ef2-af9a-421a3f216f98 service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:59.949527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1247/2474] 10.222.0.52 () {60 vars in 1384 bytes} [Mon Aug 29 20:36:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:37:02.393250 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcf9ab-904a-4b51-ad79-06f5721c29bf None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:02.395577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bddcf9ab-904a-4b51-ad79-06f5721c29bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:02.467534 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:02.584805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcf9ab-904a-4b51-ad79-06f5721c29bf None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:02.594254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf4d2f-50de-4f34-a7dd-3a5291e253bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:02.595223 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf4d2f-50de-4f34-a7dd-3a5291e253bc service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:02.595513 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf4d2f-50de-4f34-a7dd-3a5291e253bc service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:02.595790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf4d2f-50de-4f34-a7dd-3a5291e253bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:02.597961 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a5cf4d2f-50de-4f34-a7dd-3a5291e253bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:02.615087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf4d2f-50de-4f34-a7dd-3a5291e253bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:02.617122 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf4d2f-50de-4f34-a7dd-3a5291e253bc service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:02.643586 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1228/2475] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:37:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:37:05.383766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777af96-e114-4ef2-af9a-421a3f216f98 service swift] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:05.387756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2777af96-e114-4ef2-af9a-421a3f216f98 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:05.516243 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777af96-e114-4ef2-af9a-421a3f216f98 service swift] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:05.522591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f60c3-0951-495d-b21d-1209924ed6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:05.523869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f60c3-0951-495d-b21d-1209924ed6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:05.524390 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f60c3-0951-495d-b21d-1209924ed6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:05.524994 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f60c3-0951-495d-b21d-1209924ed6c1 admin admin] PATH_INFO: `/v3/users/46da39cde1ca40c7a84bb457f0e3bf77` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:05.526551 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f60c3-0951-495d-b21d-1209924ed6c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46da39cde1ca40c7a84bb457f0e3bf77)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:05.529081 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f60c3-0951-495d-b21d-1209924ed6c1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:05.621989 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-795f60c3-0951-495d-b21d-1209924ed6c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46da39cde1ca40c7a84bb457f0e3bf77'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:05.632613 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-795f60c3-0951-495d-b21d-1209924ed6c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46da39cde1ca40c7a84bb457f0e3bf77'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:05.661328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-795f60c3-0951-495d-b21d-1209924ed6c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46da39cde1ca40c7a84bb457f0e3bf77'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:05.662463 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-795f60c3-0951-495d-b21d-1209924ed6c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46da39cde1ca40c7a84bb457f0e3bf77'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:05.663284 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-795f60c3-0951-495d-b21d-1209924ed6c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46da39cde1ca40c7a84bb457f0e3bf77'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:05.700994 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1248/2476] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:37:05 2022] DELETE /identity/v3/users/46da39cde1ca40c7a84bb457f0e3bf77 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:37:06.207746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf4d2f-50de-4f34-a7dd-3a5291e253bc service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:06.244828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf4d2f-50de-4f34-a7dd-3a5291e253bc service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:06.407839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf018838-a2b0-4db1-a912-09dce091ac16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:06.408584 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf018838-a2b0-4db1-a912-09dce091ac16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:06.409057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf018838-a2b0-4db1-a912-09dce091ac16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:06.409327 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf018838-a2b0-4db1-a912-09dce091ac16 admin admin] PATH_INFO: `/v3/projects/a371dcc023964374ab5367cf29a7d580` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:06.411319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf018838-a2b0-4db1-a912-09dce091ac16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a371dcc023964374ab5367cf29a7d580)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:06.414077 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf018838-a2b0-4db1-a912-09dce091ac16 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:06.520670 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-bf018838-a2b0-4db1-a912-09dce091ac16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a371dcc023964374ab5367cf29a7d580', 'request_id': 'req-bf018838-a2b0-4db1-a912-09dce091ac16'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:06.555830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-bf018838-a2b0-4db1-a912-09dce091ac16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a371dcc023964374ab5367cf29a7d580', 'request_id': 'req-bf018838-a2b0-4db1-a912-09dce091ac16'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:06.569835 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-bf018838-a2b0-4db1-a912-09dce091ac16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a371dcc023964374ab5367cf29a7d580', 'request_id': 'req-bf018838-a2b0-4db1-a912-09dce091ac16'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:06.611320 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-bf018838-a2b0-4db1-a912-09dce091ac16 admin admin] The token cache is being invalidate because project a371dcc023964374ab5367cf29a7d580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:37:06.611610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-bf018838-a2b0-4db1-a912-09dce091ac16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:06.612575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-bf018838-a2b0-4db1-a912-09dce091ac16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:06.619773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1229/2477] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:37:06 2022] DELETE /identity/v3/projects/a371dcc023964374ab5367cf29a7d580 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:37:06.631827 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fba289-37f7-4865-bdf1-58d16c0750dc None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:06.632284 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fba289-37f7-4865-bdf1-58d16c0750dc None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:06.632284 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fba289-37f7-4865-bdf1-58d16c0750dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:06.676317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-87fba289-37f7-4865-bdf1-58d16c0750dc None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:37:06.677805 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-87fba289-37f7-4865-bdf1-58d16c0750dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:06.696357 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:06.800541 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1249/2478] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:37:06.813221 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b3e64-42c7-4853-94ca-e3fbdf181963 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:06.813548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b3e64-42c7-4853-94ca-e3fbdf181963 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:06.814018 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b3e64-42c7-4853-94ca-e3fbdf181963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:06.854180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-072b3e64-42c7-4853-94ca-e3fbdf181963 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:37:06.855518 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-072b3e64-42c7-4853-94ca-e3fbdf181963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:06.885508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1230/2479] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:37:06.886411 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fba289-37f7-4865-bdf1-58d16c0750dc None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:06.903051 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fba289-37f7-4865-bdf1-58d16c0750dc None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:06.914610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45144bcd-793e-4bcd-a9fd-49e042176111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:06.916482 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45144bcd-793e-4bcd-a9fd-49e042176111 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:06.917756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45144bcd-793e-4bcd-a9fd-49e042176111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:06.918266 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45144bcd-793e-4bcd-a9fd-49e042176111 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:06.919216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45144bcd-793e-4bcd-a9fd-49e042176111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:37:06.920674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45144bcd-793e-4bcd-a9fd-49e042176111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:06.922730 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45144bcd-793e-4bcd-a9fd-49e042176111 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:06.952175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b3e64-42c7-4853-94ca-e3fbdf181963 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:06.959169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1250/2480] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:37:06.963859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b3e64-42c7-4853-94ca-e3fbdf181963 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:06.970919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2377dd3-a1b0-4196-872d-f302bffa905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:06.971577 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2377dd3-a1b0-4196-872d-f302bffa905a admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:06.972220 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2377dd3-a1b0-4196-872d-f302bffa905a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:06.972657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2377dd3-a1b0-4196-872d-f302bffa905a admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:06.973568 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2377dd3-a1b0-4196-872d-f302bffa905a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:06.976629 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2377dd3-a1b0-4196-872d-f302bffa905a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:07.029936 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1231/2481] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:37:06 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:37:07.034792 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45144bcd-793e-4bcd-a9fd-49e042176111 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:07.058732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45144bcd-793e-4bcd-a9fd-49e042176111 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:07.274539 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f62c8c-3f8e-4f0d-8df3-3c32afeb8860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:07.275953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f62c8c-3f8e-4f0d-8df3-3c32afeb8860 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:07.278512 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f62c8c-3f8e-4f0d-8df3-3c32afeb8860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:07.278989 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f62c8c-3f8e-4f0d-8df3-3c32afeb8860 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:07.279767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f62c8c-3f8e-4f0d-8df3-3c32afeb8860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:07.282665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f62c8c-3f8e-4f0d-8df3-3c32afeb8860 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:07.326678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1251/2482] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:37:07 2022] POST /identity/v3/users => generated 286 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:37:07.330893 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2377dd3-a1b0-4196-872d-f302bffa905a admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:07.348360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2377dd3-a1b0-4196-872d-f302bffa905a admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:07.353972 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a342e3-cf5d-447f-9a93-9b60a8cde24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:07.355602 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a342e3-cf5d-447f-9a93-9b60a8cde24c admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:07.356068 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a342e3-cf5d-447f-9a93-9b60a8cde24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:07.356540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a342e3-cf5d-447f-9a93-9b60a8cde24c admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:07.357389 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a342e3-cf5d-447f-9a93-9b60a8cde24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:07.359271 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a342e3-cf5d-447f-9a93-9b60a8cde24c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:07.362177 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:07.375140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1232/2483] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:37:07.379797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f62c8c-3f8e-4f0d-8df3-3c32afeb8860 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:07.392808 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f62c8c-3f8e-4f0d-8df3-3c32afeb8860 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:07.399996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ed4aa-796b-4444-bc66-78fa9c0f8c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:07.400729 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ed4aa-796b-4444-bc66-78fa9c0f8c9c admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:07.401102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ed4aa-796b-4444-bc66-78fa9c0f8c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:07.401672 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ed4aa-796b-4444-bc66-78fa9c0f8c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:07.402733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ed4aa-796b-4444-bc66-78fa9c0f8c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:07.404887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ed4aa-796b-4444-bc66-78fa9c0f8c9c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:07.418626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1252/2484] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:37:07.423105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a342e3-cf5d-447f-9a93-9b60a8cde24c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:07.457551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a342e3-cf5d-447f-9a93-9b60a8cde24c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:07.463292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b64869-e0d7-4e7e-a880-332304376bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:07.464685 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b64869-e0d7-4e7e-a880-332304376bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:07.465191 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b64869-e0d7-4e7e-a880-332304376bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:07.465725 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b64869-e0d7-4e7e-a880-332304376bc0 admin admin] PATH_INFO: `/v3/projects/76e4fd65770747e4b9361a5b6015268b/users/fc7638f8acfa4782924319d2aba62958/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:07.467310 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ed4aa-796b-4444-bc66-78fa9c0f8c9c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:07.469425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c13ed4aa-796b-4444-bc66-78fa9c0f8c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:07.519842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b64869-e0d7-4e7e-a880-332304376bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e4fd65770747e4b9361a5b6015268b, user_id=fc7638f8acfa4782924319d2aba62958, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:07.523392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b64869-e0d7-4e7e-a880-332304376bc0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:07.561827 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1233/2485] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:37:07 2022] PUT /identity/v3/projects/76e4fd65770747e4b9361a5b6015268b/users/fc7638f8acfa4782924319d2aba62958/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:37:07.566553 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723d0f7-7d91-4e31-8414-5036ceefbd23 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:07.566931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723d0f7-7d91-4e31-8414-5036ceefbd23 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:07.568138 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723d0f7-7d91-4e31-8414-5036ceefbd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:07.610909 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3723d0f7-7d91-4e31-8414-5036ceefbd23 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:37:07.614803 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3723d0f7-7d91-4e31-8414-5036ceefbd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:07.663594 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ed4aa-796b-4444-bc66-78fa9c0f8c9c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:07.712715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:07.803119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1234/2486] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:37:07.809172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65514b-da89-44e6-8147-86665f3e3b13 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:07.809602 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65514b-da89-44e6-8147-86665f3e3b13 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:07.809880 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65514b-da89-44e6-8147-86665f3e3b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:07.871969 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2537241-70bb-465f-ae60-21b06587f549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:07.873733 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2537241-70bb-465f-ae60-21b06587f549 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:07.874481 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2537241-70bb-465f-ae60-21b06587f549 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:07.874999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2537241-70bb-465f-ae60-21b06587f549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:07.877330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a2537241-70bb-465f-ae60-21b06587f549 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:07.878285 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ee65514b-da89-44e6-8147-86665f3e3b13 None None] MFA Rules not processed for user `1b25cf016c244b97ba7042b801b728fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:37:07.879559 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ee65514b-da89-44e6-8147-86665f3e3b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:07.895570 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2537241-70bb-465f-ae60-21b06587f549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:07.899097 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2537241-70bb-465f-ae60-21b06587f549 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:07.932445 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1253/2487] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:37:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:37:07.933999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2537241-70bb-465f-ae60-21b06587f549 service nova] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:07.938445 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a2537241-70bb-465f-ae60-21b06587f549 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:07.999385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1235/2488] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:37:08.024329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65514b-da89-44e6-8147-86665f3e3b13 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:08.026074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ee65514b-da89-44e6-8147-86665f3e3b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:08.048129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2537241-70bb-465f-ae60-21b06587f549 service nova] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:08.054184 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34205681-df28-4e8c-8faf-b4bca10f9a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:08.055118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34205681-df28-4e8c-8faf-b4bca10f9a1a service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:08.055555 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34205681-df28-4e8c-8faf-b4bca10f9a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:08.056071 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34205681-df28-4e8c-8faf-b4bca10f9a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:08.066679 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65514b-da89-44e6-8147-86665f3e3b13 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:08.068173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34205681-df28-4e8c-8faf-b4bca10f9a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:08.070163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34205681-df28-4e8c-8faf-b4bca10f9a1a service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:08.072483 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d495c1-16c3-4d82-a721-65a364effaf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:08.073936 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d495c1-16c3-4d82-a721-65a364effaf5 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:08.074212 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d495c1-16c3-4d82-a721-65a364effaf5 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:08.074548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d495c1-16c3-4d82-a721-65a364effaf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:08.078516 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b2d495c1-16c3-4d82-a721-65a364effaf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:08.082695 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1254/2489] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:37:08.100496 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34205681-df28-4e8c-8faf-b4bca10f9a1a service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:08.102078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-34205681-df28-4e8c-8faf-b4bca10f9a1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:08.185575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d495c1-16c3-4d82-a721-65a364effaf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:08.196432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d495c1-16c3-4d82-a721-65a364effaf5 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:08.205144 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:08.227847 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34205681-df28-4e8c-8faf-b4bca10f9a1a service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:08.235354 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9242a-b1d8-404a-bc46-b9861baa2643 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8295272eec349f8aa38e44c861faa47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:08.236217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9242a-b1d8-404a-bc46-b9861baa2643 service placement] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:08.236650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9242a-b1d8-404a-bc46-b9861baa2643 service placement] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:08.237098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9242a-b1d8-404a-bc46-b9861baa2643 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:08.239772 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c1c9242a-b1d8-404a-bc46-b9861baa2643 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:08.255713 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1236/2490] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:37:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:37:08.256050 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9242a-b1d8-404a-bc46-b9861baa2643 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:08.258255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9242a-b1d8-404a-bc46-b9861baa2643 service placement] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:08.272904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1255/2491] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:37:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:37:09.957090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec69035-8e8e-4223-b136-78a14a632b30 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:09.958160 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec69035-8e8e-4223-b136-78a14a632b30 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:09.958583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec69035-8e8e-4223-b136-78a14a632b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:10.010368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6ec69035-8e8e-4223-b136-78a14a632b30 None None] MFA Rules not processed for user `92314357a96448648010e7db45cc7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:37:10.012081 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6ec69035-8e8e-4223-b136-78a14a632b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:10.039338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1237/2492] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:37:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:37:16.774069 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9242a-b1d8-404a-bc46-b9861baa2643 service placement] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:16.775678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c1c9242a-b1d8-404a-bc46-b9861baa2643 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:16.808386 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9242a-b1d8-404a-bc46-b9861baa2643 service placement] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:16.817093 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643dc60-84c6-4d1c-ae71-0690d44e1748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:16.817859 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643dc60-84c6-4d1c-ae71-0690d44e1748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:16.818147 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643dc60-84c6-4d1c-ae71-0690d44e1748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:16.818428 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643dc60-84c6-4d1c-ae71-0690d44e1748 admin admin] PATH_INFO: `/v3/users/6bf35c256e554095b0561b8e41d68eaf` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:16.819944 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643dc60-84c6-4d1c-ae71-0690d44e1748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf35c256e554095b0561b8e41d68eaf)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:16.822144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643dc60-84c6-4d1c-ae71-0690d44e1748 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:16.911136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:16.955752 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d643dc60-84c6-4d1c-ae71-0690d44e1748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf35c256e554095b0561b8e41d68eaf'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:16.998785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d643dc60-84c6-4d1c-ae71-0690d44e1748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf35c256e554095b0561b8e41d68eaf'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:17.039353 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d643dc60-84c6-4d1c-ae71-0690d44e1748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf35c256e554095b0561b8e41d68eaf'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:17.040036 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d643dc60-84c6-4d1c-ae71-0690d44e1748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf35c256e554095b0561b8e41d68eaf'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:17.041016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d643dc60-84c6-4d1c-ae71-0690d44e1748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf35c256e554095b0561b8e41d68eaf'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:17.090260 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1256/2493] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:37:16 2022] DELETE /identity/v3/users/6bf35c256e554095b0561b8e41d68eaf => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:37:17.415576 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec69035-8e8e-4223-b136-78a14a632b30 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:17.450509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec69035-8e8e-4223-b136-78a14a632b30 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:17.560031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21685050-0b78-4e22-b6dd-d69ab6bd4294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:17.560778 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21685050-0b78-4e22-b6dd-d69ab6bd4294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:17.561053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21685050-0b78-4e22-b6dd-d69ab6bd4294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:17.561322 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21685050-0b78-4e22-b6dd-d69ab6bd4294 admin admin] PATH_INFO: `/v3/projects/b94501f109b54ed780f8d76fe118e75a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:17.562833 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21685050-0b78-4e22-b6dd-d69ab6bd4294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b94501f109b54ed780f8d76fe118e75a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:17.566505 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21685050-0b78-4e22-b6dd-d69ab6bd4294 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:17.662026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-21685050-0b78-4e22-b6dd-d69ab6bd4294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b94501f109b54ed780f8d76fe118e75a', 'request_id': 'req-21685050-0b78-4e22-b6dd-d69ab6bd4294'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:17.675401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-21685050-0b78-4e22-b6dd-d69ab6bd4294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b94501f109b54ed780f8d76fe118e75a', 'request_id': 'req-21685050-0b78-4e22-b6dd-d69ab6bd4294'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:17.689926 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-21685050-0b78-4e22-b6dd-d69ab6bd4294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b94501f109b54ed780f8d76fe118e75a', 'request_id': 'req-21685050-0b78-4e22-b6dd-d69ab6bd4294'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:17.707938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-21685050-0b78-4e22-b6dd-d69ab6bd4294 admin admin] The token cache is being invalidate because project b94501f109b54ed780f8d76fe118e75a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:37:17.708210 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-21685050-0b78-4e22-b6dd-d69ab6bd4294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:17.709246 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-21685050-0b78-4e22-b6dd-d69ab6bd4294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:17.715193 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1238/2494] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:37:17 2022] DELETE /identity/v3/projects/b94501f109b54ed780f8d76fe118e75a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:37:17.717121 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643dc60-84c6-4d1c-ae71-0690d44e1748 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:17.720787 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d643dc60-84c6-4d1c-ae71-0690d44e1748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:17.746948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643dc60-84c6-4d1c-ae71-0690d44e1748 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:17.823969 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe943dad-0cbd-4f38-bb86-8c5f882ed24b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:17.824286 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe943dad-0cbd-4f38-bb86-8c5f882ed24b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:17.824590 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe943dad-0cbd-4f38-bb86-8c5f882ed24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:17.887067 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-fe943dad-0cbd-4f38-bb86-8c5f882ed24b None None] MFA Rules not processed for user `fc7638f8acfa4782924319d2aba62958`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:37:17.888656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fe943dad-0cbd-4f38-bb86-8c5f882ed24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:17.900573 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb38ec4-690f-4fdf-b742-a292e88b45fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:17.901479 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb38ec4-690f-4fdf-b742-a292e88b45fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:17.902468 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb38ec4-690f-4fdf-b742-a292e88b45fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:17.903504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb38ec4-690f-4fdf-b742-a292e88b45fc admin admin] PATH_INFO: `/v3/users/de4df52bbf9c4a6ca14b4a6d0983327b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:17.906997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb38ec4-690f-4fdf-b742-a292e88b45fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=de4df52bbf9c4a6ca14b4a6d0983327b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:17.910965 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb38ec4-690f-4fdf-b742-a292e88b45fc admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:17.985681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2cb38ec4-690f-4fdf-b742-a292e88b45fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de4df52bbf9c4a6ca14b4a6d0983327b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:18.000167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2cb38ec4-690f-4fdf-b742-a292e88b45fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de4df52bbf9c4a6ca14b4a6d0983327b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:18.033108 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2cb38ec4-690f-4fdf-b742-a292e88b45fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de4df52bbf9c4a6ca14b4a6d0983327b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:18.033959 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2cb38ec4-690f-4fdf-b742-a292e88b45fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de4df52bbf9c4a6ca14b4a6d0983327b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:18.039847 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2cb38ec4-690f-4fdf-b742-a292e88b45fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de4df52bbf9c4a6ca14b4a6d0983327b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:18.053854 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1239/2495] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:37:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:37:18.072538 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe943dad-0cbd-4f38-bb86-8c5f882ed24b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:18.074400 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fe943dad-0cbd-4f38-bb86-8c5f882ed24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:18.074915 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1257/2496] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:37:17 2022] DELETE /identity/v3/users/de4df52bbf9c4a6ca14b4a6d0983327b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:37:18.109465 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:18.227981 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe943dad-0cbd-4f38-bb86-8c5f882ed24b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:18.385003 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26cb8a-bd35-43e9-8b1c-78be1803f641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:18.385690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26cb8a-bd35-43e9-8b1c-78be1803f641 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:18.385971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26cb8a-bd35-43e9-8b1c-78be1803f641 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:18.386238 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26cb8a-bd35-43e9-8b1c-78be1803f641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:18.389421 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ff26cb8a-bd35-43e9-8b1c-78be1803f641 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:18.415884 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb38ec4-690f-4fdf-b742-a292e88b45fc admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:18.417646 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2cb38ec4-690f-4fdf-b742-a292e88b45fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:18.495097 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:18.570553 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26cb8a-bd35-43e9-8b1c-78be1803f641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:18.573056 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26cb8a-bd35-43e9-8b1c-78be1803f641 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:18.597516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb38ec4-690f-4fdf-b742-a292e88b45fc admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:18.599241 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1240/2497] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:37:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:37:18.606211 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf525b-4d1e-4d56-8235-7fa156052f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:18.606983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf525b-4d1e-4d56-8235-7fa156052f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:18.607328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf525b-4d1e-4d56-8235-7fa156052f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:18.607727 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf525b-4d1e-4d56-8235-7fa156052f45 admin admin] PATH_INFO: `/v3/projects/d9d870557a4f4675a743ad86465e109d` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:18.608971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf525b-4d1e-4d56-8235-7fa156052f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d870557a4f4675a743ad86465e109d)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:18.611233 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf525b-4d1e-4d56-8235-7fa156052f45 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:18.713886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-63cf525b-4d1e-4d56-8235-7fa156052f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d870557a4f4675a743ad86465e109d', 'request_id': 'req-63cf525b-4d1e-4d56-8235-7fa156052f45'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:18.734477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-63cf525b-4d1e-4d56-8235-7fa156052f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d870557a4f4675a743ad86465e109d', 'request_id': 'req-63cf525b-4d1e-4d56-8235-7fa156052f45'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:18.759190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-63cf525b-4d1e-4d56-8235-7fa156052f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d870557a4f4675a743ad86465e109d', 'request_id': 'req-63cf525b-4d1e-4d56-8235-7fa156052f45'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:18.788284 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-63cf525b-4d1e-4d56-8235-7fa156052f45 admin admin] The token cache is being invalidate because project d9d870557a4f4675a743ad86465e109d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:37:18.789330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-63cf525b-4d1e-4d56-8235-7fa156052f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:18.790347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-63cf525b-4d1e-4d56-8235-7fa156052f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:37:18.794660 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1258/2498] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:37:18 2022] DELETE /identity/v3/projects/d9d870557a4f4675a743ad86465e109d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:37:20.225427 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86822a0-4844-488f-975d-0842934a486e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:20.225986 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86822a0-4844-488f-975d-0842934a486e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:20.225986 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86822a0-4844-488f-975d-0842934a486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:20.247883 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c86822a0-4844-488f-975d-0842934a486e None None] MFA Rules not processed for user `fc7638f8acfa4782924319d2aba62958`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:37:20.249181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c86822a0-4844-488f-975d-0842934a486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:20.308309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:20.328004 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1241/2499] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:37:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:37:28.771754 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:30.319347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:38.464296 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf525b-4d1e-4d56-8235-7fa156052f45 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:38.467104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-63cf525b-4d1e-4d56-8235-7fa156052f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:38.537182 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf525b-4d1e-4d56-8235-7fa156052f45 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:38.541068 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe915b9-66ef-4c54-8b30-f440d76a8347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:38.541732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe915b9-66ef-4c54-8b30-f440d76a8347 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:38.542186 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe915b9-66ef-4c54-8b30-f440d76a8347 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:38.542460 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe915b9-66ef-4c54-8b30-f440d76a8347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:38.544626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6fe915b9-66ef-4c54-8b30-f440d76a8347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:38.628219 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe915b9-66ef-4c54-8b30-f440d76a8347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:38.629993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe915b9-66ef-4c54-8b30-f440d76a8347 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:38.642051 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1259/2500] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:37:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:37:48.636539 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=50 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:48.791353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86822a0-4844-488f-975d-0842934a486e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:48.793992 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c86822a0-4844-488f-975d-0842934a486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:48.880227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86822a0-4844-488f-975d-0842934a486e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:48.886609 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb606c9-f2a2-49d8-9eb6-c127fc380310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:48.887170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb606c9-f2a2-49d8-9eb6-c127fc380310 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:48.888495 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb606c9-f2a2-49d8-9eb6-c127fc380310 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:48.888495 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb606c9-f2a2-49d8-9eb6-c127fc380310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:48.890381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5bb606c9-f2a2-49d8-9eb6-c127fc380310 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:48.955785 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb606c9-f2a2-49d8-9eb6-c127fc380310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:48.957464 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb606c9-f2a2-49d8-9eb6-c127fc380310 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:48.967241 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1242/2501] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:37:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:37:58.962560 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=56 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:10.376375 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe915b9-66ef-4c54-8b30-f440d76a8347 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:10.386249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe915b9-66ef-4c54-8b30-f440d76a8347 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:10.390683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ded14e-1c8f-4abf-ba40-f7d169456192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:10.391294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ded14e-1c8f-4abf-ba40-f7d169456192 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:10.391566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ded14e-1c8f-4abf-ba40-f7d169456192 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:10.391871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ded14e-1c8f-4abf-ba40-f7d169456192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:10.393909 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f6ded14e-1c8f-4abf-ba40-f7d169456192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:10.463068 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ded14e-1c8f-4abf-ba40-f7d169456192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:10.464570 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ded14e-1c8f-4abf-ba40-f7d169456192 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:10.475481 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1260/2502] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:11.293879 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff5ea-9797-42d4-8c8a-67a81613a291 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:11.294490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff5ea-9797-42d4-8c8a-67a81613a291 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:11.294490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff5ea-9797-42d4-8c8a-67a81613a291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:11.320644 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5dfff5ea-9797-42d4-8c8a-67a81613a291 None None] MFA Rules not processed for user `0327aa38835f41a7a82802f9cad2e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:11.323160 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5dfff5ea-9797-42d4-8c8a-67a81613a291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:11.425854 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1243/2503] 10.222.0.52 () {58 vars in 1009 bytes} [Mon Aug 29 20:38:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:11.486850 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ded14e-1c8f-4abf-ba40-f7d169456192 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:11.489196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f6ded14e-1c8f-4abf-ba40-f7d169456192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:11.632113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ded14e-1c8f-4abf-ba40-f7d169456192 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:11.640638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c457166-d080-4be9-9917-d7738288284f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9791ea73d46b191ad9fc146297565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:11.641500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c457166-d080-4be9-9917-d7738288284f service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:11.641881 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c457166-d080-4be9-9917-d7738288284f service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:11.642251 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c457166-d080-4be9-9917-d7738288284f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:11.655809 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c457166-d080-4be9-9917-d7738288284f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:11.658836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c457166-d080-4be9-9917-d7738288284f service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:11.670901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1261/2504] 10.222.0.52 () {60 vars in 1384 bytes} [Mon Aug 29 20:38:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 20:38:16.162777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfff5ea-9797-42d4-8c8a-67a81613a291 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:16.165956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5dfff5ea-9797-42d4-8c8a-67a81613a291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:16.188044 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfff5ea-9797-42d4-8c8a-67a81613a291 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:16.195123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a8979-227a-4b46-ac31-9f80f44f9862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:16.196238 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a8979-227a-4b46-ac31-9f80f44f9862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:16.197007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a8979-227a-4b46-ac31-9f80f44f9862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:16.197940 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a8979-227a-4b46-ac31-9f80f44f9862 admin admin] PATH_INFO: `/v3/users/960befc2f96b4565b9a99026d906f3cc` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:16.200174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a8979-227a-4b46-ac31-9f80f44f9862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=960befc2f96b4565b9a99026d906f3cc)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:16.202840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a8979-227a-4b46-ac31-9f80f44f9862 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:16.288413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f32a8979-227a-4b46-ac31-9f80f44f9862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '960befc2f96b4565b9a99026d906f3cc'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:16.305034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f32a8979-227a-4b46-ac31-9f80f44f9862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '960befc2f96b4565b9a99026d906f3cc'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:16.317422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f32a8979-227a-4b46-ac31-9f80f44f9862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '960befc2f96b4565b9a99026d906f3cc'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:16.317422 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f32a8979-227a-4b46-ac31-9f80f44f9862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '960befc2f96b4565b9a99026d906f3cc'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:16.326499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f32a8979-227a-4b46-ac31-9f80f44f9862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '960befc2f96b4565b9a99026d906f3cc'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:16.333797 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1244/2505] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:16 2022] DELETE /identity/v3/users/960befc2f96b4565b9a99026d906f3cc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:38:16.570303 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c457166-d080-4be9-9917-d7738288284f service swift] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:16.615698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c457166-d080-4be9-9917-d7738288284f service swift] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:16.810006 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a9c40-30ad-44e3-836a-803f4ab55488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:16.815907 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a9c40-30ad-44e3-836a-803f4ab55488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:16.816644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a9c40-30ad-44e3-836a-803f4ab55488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:16.817129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a9c40-30ad-44e3-836a-803f4ab55488 admin admin] PATH_INFO: `/v3/projects/1cebbf6d9f2b419ea60f805241153b70` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:16.820205 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a9c40-30ad-44e3-836a-803f4ab55488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cebbf6d9f2b419ea60f805241153b70)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:16.822624 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a9c40-30ad-44e3-836a-803f4ab55488 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:16.881785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:16.915492 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-560a9c40-30ad-44e3-836a-803f4ab55488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cebbf6d9f2b419ea60f805241153b70', 'request_id': 'req-560a9c40-30ad-44e3-836a-803f4ab55488'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:16.926942 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-560a9c40-30ad-44e3-836a-803f4ab55488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cebbf6d9f2b419ea60f805241153b70', 'request_id': 'req-560a9c40-30ad-44e3-836a-803f4ab55488'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:16.940453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-560a9c40-30ad-44e3-836a-803f4ab55488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cebbf6d9f2b419ea60f805241153b70', 'request_id': 'req-560a9c40-30ad-44e3-836a-803f4ab55488'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:16.963393 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-560a9c40-30ad-44e3-836a-803f4ab55488 admin admin] The token cache is being invalidate because project 1cebbf6d9f2b419ea60f805241153b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:16.963858 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-560a9c40-30ad-44e3-836a-803f4ab55488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:16.968344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-560a9c40-30ad-44e3-836a-803f4ab55488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:16.968344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1262/2506] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:16 2022] DELETE /identity/v3/projects/1cebbf6d9f2b419ea60f805241153b70 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:16.974189 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3e9a5-92c2-49c2-b1c4-50bee0075da2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:16.974623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3e9a5-92c2-49c2-b1c4-50bee0075da2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:16.974751 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3e9a5-92c2-49c2-b1c4-50bee0075da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:17.003206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-98b3e9a5-92c2-49c2-b1c4-50bee0075da2 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:17.003206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-98b3e9a5-92c2-49c2-b1c4-50bee0075da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:17.105304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1245/2507] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:17.107027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319737bd-45ca-49d4-97f2-ba4c41707ecb None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:17.107314 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319737bd-45ca-49d4-97f2-ba4c41707ecb None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:17.107581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319737bd-45ca-49d4-97f2-ba4c41707ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:17.131633 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-319737bd-45ca-49d4-97f2-ba4c41707ecb None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:17.132883 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-319737bd-45ca-49d4-97f2-ba4c41707ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:17.151991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1263/2508] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:38:17.163175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3e9a5-92c2-49c2-b1c4-50bee0075da2 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:17.194829 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3e9a5-92c2-49c2-b1c4-50bee0075da2 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:17.203571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cbf1e-a20a-44ce-8475-73511b14776b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:17.204615 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cbf1e-a20a-44ce-8475-73511b14776b admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:17.205276 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cbf1e-a20a-44ce-8475-73511b14776b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:17.205791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cbf1e-a20a-44ce-8475-73511b14776b admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:17.207033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cbf1e-a20a-44ce-8475-73511b14776b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:38:17.207545 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cbf1e-a20a-44ce-8475-73511b14776b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:17.210628 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cbf1e-a20a-44ce-8475-73511b14776b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:17.236893 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1246/2509] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:38:17.245429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319737bd-45ca-49d4-97f2-ba4c41707ecb None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:17.266794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319737bd-45ca-49d4-97f2-ba4c41707ecb None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:17.280240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacc4ef-6ff9-48a3-91a9-d28e55adf682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:17.281458 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacc4ef-6ff9-48a3-91a9-d28e55adf682 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:17.282061 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacc4ef-6ff9-48a3-91a9-d28e55adf682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:17.282623 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacc4ef-6ff9-48a3-91a9-d28e55adf682 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:17.285041 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacc4ef-6ff9-48a3-91a9-d28e55adf682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:17.287832 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacc4ef-6ff9-48a3-91a9-d28e55adf682 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:17.364495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1264/2510] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:17 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:17.366936 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cbf1e-a20a-44ce-8475-73511b14776b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:17.377988 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:17.391365 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cbf1e-a20a-44ce-8475-73511b14776b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:17.481524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc6712-1d89-498f-962d-8e06718cfc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:17.482476 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc6712-1d89-498f-962d-8e06718cfc2c admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:17.483162 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc6712-1d89-498f-962d-8e06718cfc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:17.484175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc6712-1d89-498f-962d-8e06718cfc2c admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:17.485040 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc6712-1d89-498f-962d-8e06718cfc2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:17.488482 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc6712-1d89-498f-962d-8e06718cfc2c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:17.522317 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1247/2511] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:17 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:17.523112 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacc4ef-6ff9-48a3-91a9-d28e55adf682 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:17.537432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacc4ef-6ff9-48a3-91a9-d28e55adf682 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:17.546659 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17edea3-e95f-4a0f-aa69-548cfb7ad00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:17.547390 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17edea3-e95f-4a0f-aa69-548cfb7ad00d admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:17.547736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17edea3-e95f-4a0f-aa69-548cfb7ad00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:17.548072 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17edea3-e95f-4a0f-aa69-548cfb7ad00d admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:17.548799 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17edea3-e95f-4a0f-aa69-548cfb7ad00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:17.550518 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17edea3-e95f-4a0f-aa69-548cfb7ad00d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:17.563822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1265/2512] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:38:17.567582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc6712-1d89-498f-962d-8e06718cfc2c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:17.582209 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc6712-1d89-498f-962d-8e06718cfc2c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:17.590677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf54c5c-215a-4eaf-a4b9-0f4fe18f3d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:17.592236 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf54c5c-215a-4eaf-a4b9-0f4fe18f3d93 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:17.592802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf54c5c-215a-4eaf-a4b9-0f4fe18f3d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:17.593259 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf54c5c-215a-4eaf-a4b9-0f4fe18f3d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:17.594330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf54c5c-215a-4eaf-a4b9-0f4fe18f3d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:17.597744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf54c5c-215a-4eaf-a4b9-0f4fe18f3d93 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:17.622804 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1248/2513] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:17.624136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17edea3-e95f-4a0f-aa69-548cfb7ad00d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:17.646630 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17edea3-e95f-4a0f-aa69-548cfb7ad00d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:17.661237 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ed147-5d81-4729-8933-2379a15bdc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:17.662445 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ed147-5d81-4729-8933-2379a15bdc59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:17.663101 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ed147-5d81-4729-8933-2379a15bdc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:17.663979 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ed147-5d81-4729-8933-2379a15bdc59 admin admin] PATH_INFO: `/v3/projects/d0f4f4df65fd4fbc8352e6c10d2eb951/users/c7121dacae684136aa9cf203cb0d6698/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:17.704568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ed147-5d81-4729-8933-2379a15bdc59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f4f4df65fd4fbc8352e6c10d2eb951, user_id=c7121dacae684136aa9cf203cb0d6698, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:17.710400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ed147-5d81-4729-8933-2379a15bdc59 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:17.743366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1266/2514] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:17 2022] PUT /identity/v3/projects/d0f4f4df65fd4fbc8352e6c10d2eb951/users/c7121dacae684136aa9cf203cb0d6698/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:17.753919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799872db-dccb-42d6-8531-101a70f9e1d9 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:17.754378 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799872db-dccb-42d6-8531-101a70f9e1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:17.754656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799872db-dccb-42d6-8531-101a70f9e1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:17.792485 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-799872db-dccb-42d6-8531-101a70f9e1d9 None None] MFA Rules not processed for user `c7121dacae684136aa9cf203cb0d6698`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:17.794599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-799872db-dccb-42d6-8531-101a70f9e1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:17.896351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1249/2515] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:17.904671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ed147-5d81-4729-8933-2379a15bdc59 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:17.924145 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6b8ed147-5d81-4729-8933-2379a15bdc59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:18.048864 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ed147-5d81-4729-8933-2379a15bdc59 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:18.057945 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5889ab-06ad-40a4-8066-7134afa2091b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:18.058585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5889ab-06ad-40a4-8066-7134afa2091b service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:18.058868 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5889ab-06ad-40a4-8066-7134afa2091b service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:18.059125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5889ab-06ad-40a4-8066-7134afa2091b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:18.073690 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5889ab-06ad-40a4-8066-7134afa2091b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:18.075325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5889ab-06ad-40a4-8066-7134afa2091b service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:18.117565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1267/2516] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:23.483657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799872db-dccb-42d6-8531-101a70f9e1d9 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:23.580107 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799872db-dccb-42d6-8531-101a70f9e1d9 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:23.590015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b49ad-2f32-4f0e-a9a4-8f68ce103a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:23.590915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b49ad-2f32-4f0e-a9a4-8f68ce103a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:23.591197 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b49ad-2f32-4f0e-a9a4-8f68ce103a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:23.591484 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b49ad-2f32-4f0e-a9a4-8f68ce103a40 admin admin] PATH_INFO: `/v3/users/c7121dacae684136aa9cf203cb0d6698` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:23.592864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b49ad-2f32-4f0e-a9a4-8f68ce103a40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7121dacae684136aa9cf203cb0d6698)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:23.594940 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b49ad-2f32-4f0e-a9a4-8f68ce103a40 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:23.625895 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:23.696535 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-259b49ad-2f32-4f0e-a9a4-8f68ce103a40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7121dacae684136aa9cf203cb0d6698'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.728614 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-259b49ad-2f32-4f0e-a9a4-8f68ce103a40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7121dacae684136aa9cf203cb0d6698'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.741048 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-259b49ad-2f32-4f0e-a9a4-8f68ce103a40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7121dacae684136aa9cf203cb0d6698'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.742186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-259b49ad-2f32-4f0e-a9a4-8f68ce103a40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7121dacae684136aa9cf203cb0d6698'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.752896 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-259b49ad-2f32-4f0e-a9a4-8f68ce103a40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7121dacae684136aa9cf203cb0d6698'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.760912 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1250/2517] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:23 2022] DELETE /identity/v3/users/c7121dacae684136aa9cf203cb0d6698 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:23.766713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258159a-ee3c-40fa-a8d8-1a4eb9952c68 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:23.767205 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258159a-ee3c-40fa-a8d8-1a4eb9952c68 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:23.767982 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258159a-ee3c-40fa-a8d8-1a4eb9952c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:23.794651 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-0258159a-ee3c-40fa-a8d8-1a4eb9952c68 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:23.795911 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0258159a-ee3c-40fa-a8d8-1a4eb9952c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:23.834567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:23.871097 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1268/2518] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:38:23.885774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b49ad-2f32-4f0e-a9a4-8f68ce103a40 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:23.887656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-259b49ad-2f32-4f0e-a9a4-8f68ce103a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:23.964947 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b49ad-2f32-4f0e-a9a4-8f68ce103a40 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:23.968890 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77497ccf-d9f0-43e5-8b30-92b9bfffeb21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:23.969605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77497ccf-d9f0-43e5-8b30-92b9bfffeb21 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:23.969943 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77497ccf-d9f0-43e5-8b30-92b9bfffeb21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:23.970271 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77497ccf-d9f0-43e5-8b30-92b9bfffeb21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:23.980678 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77497ccf-d9f0-43e5-8b30-92b9bfffeb21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:23.982318 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77497ccf-d9f0-43e5-8b30-92b9bfffeb21 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:23.993085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1251/2519] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:24.308884 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258159a-ee3c-40fa-a8d8-1a4eb9952c68 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:24.311125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0258159a-ee3c-40fa-a8d8-1a4eb9952c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:24.329091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258159a-ee3c-40fa-a8d8-1a4eb9952c68 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.341727 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963006ed-d8f4-4e9c-9235-2c372d9a1dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.342408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963006ed-d8f4-4e9c-9235-2c372d9a1dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.342694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963006ed-d8f4-4e9c-9235-2c372d9a1dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.343027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963006ed-d8f4-4e9c-9235-2c372d9a1dc1 admin admin] PATH_INFO: `/v3/projects/d0f4f4df65fd4fbc8352e6c10d2eb951` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.344475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963006ed-d8f4-4e9c-9235-2c372d9a1dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f4f4df65fd4fbc8352e6c10d2eb951)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.346428 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963006ed-d8f4-4e9c-9235-2c372d9a1dc1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:24.416378 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-963006ed-d8f4-4e9c-9235-2c372d9a1dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f4f4df65fd4fbc8352e6c10d2eb951', 'request_id': 'req-963006ed-d8f4-4e9c-9235-2c372d9a1dc1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:24.423622 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-963006ed-d8f4-4e9c-9235-2c372d9a1dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f4f4df65fd4fbc8352e6c10d2eb951', 'request_id': 'req-963006ed-d8f4-4e9c-9235-2c372d9a1dc1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:24.434326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-963006ed-d8f4-4e9c-9235-2c372d9a1dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f4f4df65fd4fbc8352e6c10d2eb951', 'request_id': 'req-963006ed-d8f4-4e9c-9235-2c372d9a1dc1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:24.451409 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-963006ed-d8f4-4e9c-9235-2c372d9a1dc1 admin admin] The token cache is being invalidate because project d0f4f4df65fd4fbc8352e6c10d2eb951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:24.451710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-963006ed-d8f4-4e9c-9235-2c372d9a1dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:24.452418 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-963006ed-d8f4-4e9c-9235-2c372d9a1dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:24.453987 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1269/2520] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:24 2022] DELETE /identity/v3/projects/d0f4f4df65fd4fbc8352e6c10d2eb951 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:24.459319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcff8af-eb9e-472e-bb21-e1fdbcd943a0 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.459622 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcff8af-eb9e-472e-bb21-e1fdbcd943a0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.460181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcff8af-eb9e-472e-bb21-e1fdbcd943a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.483594 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-cdcff8af-eb9e-472e-bb21-e1fdbcd943a0 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:24.484726 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-cdcff8af-eb9e-472e-bb21-e1fdbcd943a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:24.566716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1252/2521] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:24.575828 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e2b27-a1ac-44e2-8dd0-f2084ea324cf None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.576108 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e2b27-a1ac-44e2-8dd0-f2084ea324cf None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.576392 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e2b27-a1ac-44e2-8dd0-f2084ea324cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.596893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6a9e2b27-a1ac-44e2-8dd0-f2084ea324cf None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:24.598143 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6a9e2b27-a1ac-44e2-8dd0-f2084ea324cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:24.606866 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1270/2522] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:24.611636 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcff8af-eb9e-472e-bb21-e1fdbcd943a0 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:24.621888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcff8af-eb9e-472e-bb21-e1fdbcd943a0 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.626823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb035a-ba3b-4048-8b5a-f13378fc6317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.627440 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb035a-ba3b-4048-8b5a-f13378fc6317 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.627721 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb035a-ba3b-4048-8b5a-f13378fc6317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.627992 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb035a-ba3b-4048-8b5a-f13378fc6317 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.628646 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb035a-ba3b-4048-8b5a-f13378fc6317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:38:24.628953 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb035a-ba3b-4048-8b5a-f13378fc6317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.630625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb035a-ba3b-4048-8b5a-f13378fc6317 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:24.643072 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1253/2523] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:38:24.647657 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e2b27-a1ac-44e2-8dd0-f2084ea324cf None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:24.657376 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e2b27-a1ac-44e2-8dd0-f2084ea324cf None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.662720 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355cac1-5e21-4432-a4f4-03b4b8c3c5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.663356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355cac1-5e21-4432-a4f4-03b4b8c3c5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.663614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355cac1-5e21-4432-a4f4-03b4b8c3c5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.663881 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355cac1-5e21-4432-a4f4-03b4b8c3c5d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.664529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355cac1-5e21-4432-a4f4-03b4b8c3c5d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.666631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355cac1-5e21-4432-a4f4-03b4b8c3c5d1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:24.697822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1271/2524] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:24 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:24.702182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb035a-ba3b-4048-8b5a-f13378fc6317 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:24.713272 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb035a-ba3b-4048-8b5a-f13378fc6317 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.734421 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:24.782609 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4c647-e9a5-489d-942f-ebb520e2544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.783340 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4c647-e9a5-489d-942f-ebb520e2544b admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.783624 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4c647-e9a5-489d-942f-ebb520e2544b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.783945 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4c647-e9a5-489d-942f-ebb520e2544b admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.784740 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4c647-e9a5-489d-942f-ebb520e2544b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.787095 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4c647-e9a5-489d-942f-ebb520e2544b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:24.828026 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1254/2525] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:24 2022] POST /identity/v3/users => generated 283 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:38:24.830611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355cac1-5e21-4432-a4f4-03b4b8c3c5d1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:24.841348 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355cac1-5e21-4432-a4f4-03b4b8c3c5d1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.846523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994c489-447d-4c99-90c8-771fc88d6ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.847141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994c489-447d-4c99-90c8-771fc88d6ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.847422 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994c489-447d-4c99-90c8-771fc88d6ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.847696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994c489-447d-4c99-90c8-771fc88d6ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.848351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994c489-447d-4c99-90c8-771fc88d6ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.850229 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994c489-447d-4c99-90c8-771fc88d6ce9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:24.861600 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1272/2526] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:24.865876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4c647-e9a5-489d-942f-ebb520e2544b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:24.876350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4c647-e9a5-489d-942f-ebb520e2544b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.881153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e1c48-11a5-4d42-8433-c58b26ac741a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.881787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e1c48-11a5-4d42-8433-c58b26ac741a admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.882067 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e1c48-11a5-4d42-8433-c58b26ac741a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.882345 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e1c48-11a5-4d42-8433-c58b26ac741a admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.882989 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e1c48-11a5-4d42-8433-c58b26ac741a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.884688 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e1c48-11a5-4d42-8433-c58b26ac741a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:24.896337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1255/2527] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:24.901194 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994c489-447d-4c99-90c8-771fc88d6ce9 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:24.911736 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994c489-447d-4c99-90c8-771fc88d6ce9 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.917101 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80145ca6-cff9-43aa-9685-e5bd54420640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.917806 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80145ca6-cff9-43aa-9685-e5bd54420640 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.918085 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80145ca6-cff9-43aa-9685-e5bd54420640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.918411 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80145ca6-cff9-43aa-9685-e5bd54420640 admin admin] PATH_INFO: `/v3/projects/985400f72b414eaf838b555c37a04d94/users/fd647da2f1814d1da2e4e936e875e7fd/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.935504 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80145ca6-cff9-43aa-9685-e5bd54420640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985400f72b414eaf838b555c37a04d94, user_id=fd647da2f1814d1da2e4e936e875e7fd, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.938293 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80145ca6-cff9-43aa-9685-e5bd54420640 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:24.954997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1273/2528] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:24 2022] PUT /identity/v3/projects/985400f72b414eaf838b555c37a04d94/users/fd647da2f1814d1da2e4e936e875e7fd/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:24.965640 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4a803-f578-45e0-b572-05d581650e54 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.966379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4a803-f578-45e0-b572-05d581650e54 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.966379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4a803-f578-45e0-b572-05d581650e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:25.000400 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5db4a803-f578-45e0-b572-05d581650e54 None None] MFA Rules not processed for user `fd647da2f1814d1da2e4e936e875e7fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:25.001923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5db4a803-f578-45e0-b572-05d581650e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:25.087739 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1256/2529] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:25.099568 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80145ca6-cff9-43aa-9685-e5bd54420640 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:25.101554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-80145ca6-cff9-43aa-9685-e5bd54420640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:25.169649 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80145ca6-cff9-43aa-9685-e5bd54420640 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:25.173894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c5329-127f-42f8-9d0b-db195a8788c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:25.174516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c5329-127f-42f8-9d0b-db195a8788c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:25.174793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c5329-127f-42f8-9d0b-db195a8788c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:25.175063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c5329-127f-42f8-9d0b-db195a8788c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:25.185016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c5329-127f-42f8-9d0b-db195a8788c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:25.186574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c5329-127f-42f8-9d0b-db195a8788c9 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:25.190766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:25.199670 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1274/2530] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:29.335488 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58a172-615c-4bd6-b56e-b66e2f4db092 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:29.336087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58a172-615c-4bd6-b56e-b66e2f4db092 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:29.336380 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58a172-615c-4bd6-b56e-b66e2f4db092 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:29.338546 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1257/2531] 10.222.0.52 () {54 vars in 921 bytes} [Mon Aug 29 20:38:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:38:29.346383 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17b81a-c5dd-48a3-8758-0b7121dea6e1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:29.346921 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17b81a-c5dd-48a3-8758-0b7121dea6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:29.347033 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17b81a-c5dd-48a3-8758-0b7121dea6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:29.370476 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ea17b81a-c5dd-48a3-8758-0b7121dea6e1 None None] MFA Rules not processed for user `9c95d16fd4da4fa7987b893eae0b3ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:29.371701 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ea17b81a-c5dd-48a3-8758-0b7121dea6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:29.463532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1275/2532] 10.222.0.52 () {58 vars in 1018 bytes} [Mon Aug 29 20:38:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:29.486126 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58a172-615c-4bd6-b56e-b66e2f4db092 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:29.488222 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4a58a172-615c-4bd6-b56e-b66e2f4db092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:29.569243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58a172-615c-4bd6-b56e-b66e2f4db092 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:29.574451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f330f-f5e3-40fa-9ac0-38af89e34d65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47429aec6d8a4339b4ec0fb32b25e90b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:29.575418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f330f-f5e3-40fa-9ac0-38af89e34d65 service glance] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:29.576762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f330f-f5e3-40fa-9ac0-38af89e34d65 service glance] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:29.577255 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f330f-f5e3-40fa-9ac0-38af89e34d65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:29.592410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f330f-f5e3-40fa-9ac0-38af89e34d65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:29.594264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f330f-f5e3-40fa-9ac0-38af89e34d65 service glance] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:29.607391 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1258/2533] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:29.710016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460e4f8-5303-47e7-aaa0-7383f503c415 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:29.710290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460e4f8-5303-47e7-aaa0-7383f503c415 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:29.710631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460e4f8-5303-47e7-aaa0-7383f503c415 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:29.712220 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1276/2534] 10.222.0.52 () {54 vars in 921 bytes} [Mon Aug 29 20:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:38:29.719164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ad240-bf28-427e-8ec2-a2ac31a4e5e1 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:29.719762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ad240-bf28-427e-8ec2-a2ac31a4e5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:29.720347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ad240-bf28-427e-8ec2-a2ac31a4e5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:29.743472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-236ad240-bf28-427e-8ec2-a2ac31a4e5e1 None None] MFA Rules not processed for user `382b0ee3bd634cc8800f1769c91b7a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:29.744781 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-236ad240-bf28-427e-8ec2-a2ac31a4e5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:29.796624 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:29.835728 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1259/2535] 10.222.0.52 () {58 vars in 1018 bytes} [Mon Aug 29 20:38:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:29.847732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460e4f8-5303-47e7-aaa0-7383f503c415 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:29.849702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0460e4f8-5303-47e7-aaa0-7383f503c415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:29.867529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460e4f8-5303-47e7-aaa0-7383f503c415 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:29.871487 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0181678-f392-46af-ac82-b7d7ab505330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:29.873070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0181678-f392-46af-ac82-b7d7ab505330 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:29.873351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0181678-f392-46af-ac82-b7d7ab505330 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:29.873653 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0181678-f392-46af-ac82-b7d7ab505330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:29.881960 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0181678-f392-46af-ac82-b7d7ab505330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:29.883544 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0181678-f392-46af-ac82-b7d7ab505330 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:29.893418 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1277/2536] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:38:32.853140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d900c-f6c4-4d60-a994-8a5c00908c6b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:32.853789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d900c-f6c4-4d60-a994-8a5c00908c6b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:32.853789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d900c-f6c4-4d60-a994-8a5c00908c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:32.876038 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-591d900c-f6c4-4d60-a994-8a5c00908c6b None None] MFA Rules not processed for user `0327aa38835f41a7a82802f9cad2e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:32.877659 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-591d900c-f6c4-4d60-a994-8a5c00908c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:32.964876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1260/2537] 10.222.0.52 () {58 vars in 1009 bytes} [Mon Aug 29 20:38:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:38:32.979243 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0181678-f392-46af-ac82-b7d7ab505330 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:32.981304 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b0181678-f392-46af-ac82-b7d7ab505330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:33.097392 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0181678-f392-46af-ac82-b7d7ab505330 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:33.106252 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043f9b7-5824-41e3-b306-bb821ce66739 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9791ea73d46b191ad9fc146297565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:33.107312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043f9b7-5824-41e3-b306-bb821ce66739 service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:33.107812 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043f9b7-5824-41e3-b306-bb821ce66739 service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:33.108287 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043f9b7-5824-41e3-b306-bb821ce66739 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:33.123405 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043f9b7-5824-41e3-b306-bb821ce66739 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:33.126574 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043f9b7-5824-41e3-b306-bb821ce66739 service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:33.142189 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1278/2538] 10.222.0.52 () {60 vars in 1384 bytes} [Mon Aug 29 20:38:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:38:34.575109 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d900c-f6c4-4d60-a994-8a5c00908c6b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:34.684568 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d900c-f6c4-4d60-a994-8a5c00908c6b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:34.690321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7753020-08a0-4a79-aa9e-ce3d3cc13c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:34.690845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7753020-08a0-4a79-aa9e-ce3d3cc13c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:34.691287 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7753020-08a0-4a79-aa9e-ce3d3cc13c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:34.691570 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7753020-08a0-4a79-aa9e-ce3d3cc13c7c admin admin] PATH_INFO: `/v3/users/fd647da2f1814d1da2e4e936e875e7fd` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:34.693057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7753020-08a0-4a79-aa9e-ce3d3cc13c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd647da2f1814d1da2e4e936e875e7fd)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:34.695418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7753020-08a0-4a79-aa9e-ce3d3cc13c7c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:34.789620 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f7753020-08a0-4a79-aa9e-ce3d3cc13c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd647da2f1814d1da2e4e936e875e7fd'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:34.821315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f7753020-08a0-4a79-aa9e-ce3d3cc13c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd647da2f1814d1da2e4e936e875e7fd'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:34.834657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f7753020-08a0-4a79-aa9e-ce3d3cc13c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd647da2f1814d1da2e4e936e875e7fd'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:34.835566 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f7753020-08a0-4a79-aa9e-ce3d3cc13c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd647da2f1814d1da2e4e936e875e7fd'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:34.879193 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f7753020-08a0-4a79-aa9e-ce3d3cc13c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd647da2f1814d1da2e4e936e875e7fd'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:34.908615 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1261/2539] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:34 2022] DELETE /identity/v3/users/fd647da2f1814d1da2e4e936e875e7fd => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:34.914389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0f9b0-367e-48a9-b20d-ba6fddefa9f3 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:34.917824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0f9b0-367e-48a9-b20d-ba6fddefa9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:34.918851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0f9b0-367e-48a9-b20d-ba6fddefa9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:34.977290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c3f0f9b0-367e-48a9-b20d-ba6fddefa9f3 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:34.979514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c3f0f9b0-367e-48a9-b20d-ba6fddefa9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:35.119815 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1279/2540] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:35.132496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7753020-08a0-4a79-aa9e-ce3d3cc13c7c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:35.134332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f7753020-08a0-4a79-aa9e-ce3d3cc13c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:35.157180 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:35.282335 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7753020-08a0-4a79-aa9e-ce3d3cc13c7c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:35.301935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1d942-0699-4ca0-86ab-0d37367a5b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:35.303282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1d942-0699-4ca0-86ab-0d37367a5b9a service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:35.303929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1d942-0699-4ca0-86ab-0d37367a5b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:35.304590 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1d942-0699-4ca0-86ab-0d37367a5b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:35.329591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1d942-0699-4ca0-86ab-0d37367a5b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:35.339620 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1d942-0699-4ca0-86ab-0d37367a5b9a service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:35.359479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1262/2541] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:36.074382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0f9b0-367e-48a9-b20d-ba6fddefa9f3 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:36.076979 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c3f0f9b0-367e-48a9-b20d-ba6fddefa9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:36.098449 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0f9b0-367e-48a9-b20d-ba6fddefa9f3 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:36.119600 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41496c71-d2f3-45c4-a403-35eaff277679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:36.121893 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41496c71-d2f3-45c4-a403-35eaff277679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:36.122403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41496c71-d2f3-45c4-a403-35eaff277679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:36.122933 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41496c71-d2f3-45c4-a403-35eaff277679 admin admin] PATH_INFO: `/v3/projects/985400f72b414eaf838b555c37a04d94` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:36.125128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41496c71-d2f3-45c4-a403-35eaff277679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=985400f72b414eaf838b555c37a04d94)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:36.130569 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41496c71-d2f3-45c4-a403-35eaff277679 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:36.133786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:36.304953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-41496c71-d2f3-45c4-a403-35eaff277679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985400f72b414eaf838b555c37a04d94', 'request_id': 'req-41496c71-d2f3-45c4-a403-35eaff277679'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:36.321820 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-41496c71-d2f3-45c4-a403-35eaff277679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985400f72b414eaf838b555c37a04d94', 'request_id': 'req-41496c71-d2f3-45c4-a403-35eaff277679'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:36.341440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-41496c71-d2f3-45c4-a403-35eaff277679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985400f72b414eaf838b555c37a04d94', 'request_id': 'req-41496c71-d2f3-45c4-a403-35eaff277679'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:36.380770 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-41496c71-d2f3-45c4-a403-35eaff277679 admin admin] The token cache is being invalidate because project 985400f72b414eaf838b555c37a04d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:36.381963 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-41496c71-d2f3-45c4-a403-35eaff277679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:36.383542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-41496c71-d2f3-45c4-a403-35eaff277679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:36.388645 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1280/2542] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:36 2022] DELETE /identity/v3/projects/985400f72b414eaf838b555c37a04d94 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:36.395346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca13ecd-9669-4855-942d-9e78f971c905 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:36.396621 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca13ecd-9669-4855-942d-9e78f971c905 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:36.396621 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca13ecd-9669-4855-942d-9e78f971c905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:36.475814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7ca13ecd-9669-4855-942d-9e78f971c905 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:36.478195 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7ca13ecd-9669-4855-942d-9e78f971c905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:36.681019 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1263/2543] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:36.695896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f064992-71f8-4bff-afa9-3f3a9e9be6d8 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:36.696407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f064992-71f8-4bff-afa9-3f3a9e9be6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:36.696932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f064992-71f8-4bff-afa9-3f3a9e9be6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:36.760126 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1f064992-71f8-4bff-afa9-3f3a9e9be6d8 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:36.762444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1f064992-71f8-4bff-afa9-3f3a9e9be6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:36.800895 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1281/2544] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:36.803263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca13ecd-9669-4855-942d-9e78f971c905 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:36.825234 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca13ecd-9669-4855-942d-9e78f971c905 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:36.832186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b3f3b-4e42-4dc9-af94-02b4543e77d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:36.833792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b3f3b-4e42-4dc9-af94-02b4543e77d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:36.834496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b3f3b-4e42-4dc9-af94-02b4543e77d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:36.835163 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b3f3b-4e42-4dc9-af94-02b4543e77d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:36.836903 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b3f3b-4e42-4dc9-af94-02b4543e77d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:38:36.838222 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b3f3b-4e42-4dc9-af94-02b4543e77d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:36.840601 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b3f3b-4e42-4dc9-af94-02b4543e77d2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:36.868146 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1264/2545] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:38:36.871302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f064992-71f8-4bff-afa9-3f3a9e9be6d8 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:36.887981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f064992-71f8-4bff-afa9-3f3a9e9be6d8 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:36.895976 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618e671-4492-423d-9ffa-dc5fedb0fd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:36.896747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618e671-4492-423d-9ffa-dc5fedb0fd3b admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:36.897216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618e671-4492-423d-9ffa-dc5fedb0fd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:36.897773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618e671-4492-423d-9ffa-dc5fedb0fd3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:36.899527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618e671-4492-423d-9ffa-dc5fedb0fd3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:36.903528 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618e671-4492-423d-9ffa-dc5fedb0fd3b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:36.990414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1282/2546] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:36 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:36.997410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b3f3b-4e42-4dc9-af94-02b4543e77d2 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:37.018229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b3f3b-4e42-4dc9-af94-02b4543e77d2 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:37.154094 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437ff52-df02-43c0-88af-e566fd4b0566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:37.155258 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437ff52-df02-43c0-88af-e566fd4b0566 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:37.155752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437ff52-df02-43c0-88af-e566fd4b0566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:37.156056 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437ff52-df02-43c0-88af-e566fd4b0566 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:37.156865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437ff52-df02-43c0-88af-e566fd4b0566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:37.159279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437ff52-df02-43c0-88af-e566fd4b0566 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:37.210791 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1265/2547] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:36 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:37.217312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618e671-4492-423d-9ffa-dc5fedb0fd3b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:37.240611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618e671-4492-423d-9ffa-dc5fedb0fd3b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:37.251434 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a020a1-2315-4f95-9dc4-cef2ef9af242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:37.253429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a020a1-2315-4f95-9dc4-cef2ef9af242 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:37.254711 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a020a1-2315-4f95-9dc4-cef2ef9af242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:37.255619 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a020a1-2315-4f95-9dc4-cef2ef9af242 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:37.257760 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a020a1-2315-4f95-9dc4-cef2ef9af242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:37.262260 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a020a1-2315-4f95-9dc4-cef2ef9af242 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:37.285917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1283/2548] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:38:37.292303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437ff52-df02-43c0-88af-e566fd4b0566 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:37.331374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437ff52-df02-43c0-88af-e566fd4b0566 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:37.340330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4a890-d323-446b-8f0d-8ca4fe447398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:37.341568 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a890-d323-446b-8f0d-8ca4fe447398 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:37.342154 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a890-d323-446b-8f0d-8ca4fe447398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:37.342693 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a890-d323-446b-8f0d-8ca4fe447398 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:37.343998 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4a890-d323-446b-8f0d-8ca4fe447398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:37.349106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4a890-d323-446b-8f0d-8ca4fe447398 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:37.390504 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1266/2549] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:37.391786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a020a1-2315-4f95-9dc4-cef2ef9af242 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:37.414509 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a020a1-2315-4f95-9dc4-cef2ef9af242 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:37.424149 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4301445-f5bb-4d02-9b68-a1068ff169fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:37.425886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4301445-f5bb-4d02-9b68-a1068ff169fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:37.426665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4301445-f5bb-4d02-9b68-a1068ff169fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:37.427380 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4301445-f5bb-4d02-9b68-a1068ff169fb admin admin] PATH_INFO: `/v3/projects/9de784d7ee81404b927568f1b53c30ff/users/e158649a755f4a0b9d89b1a2aedd8dd6/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:37.474644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4301445-f5bb-4d02-9b68-a1068ff169fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de784d7ee81404b927568f1b53c30ff, user_id=e158649a755f4a0b9d89b1a2aedd8dd6, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:37.481237 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4301445-f5bb-4d02-9b68-a1068ff169fb admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:37.517397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1284/2550] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:37 2022] PUT /identity/v3/projects/9de784d7ee81404b927568f1b53c30ff/users/e158649a755f4a0b9d89b1a2aedd8dd6/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:37.529226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ed136-013d-43a7-bb59-f059ba70ea11 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:37.533069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ed136-013d-43a7-bb59-f059ba70ea11 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:37.533644 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ed136-013d-43a7-bb59-f059ba70ea11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:37.594434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ee3ed136-013d-43a7-bb59-f059ba70ea11 None None] MFA Rules not processed for user `e158649a755f4a0b9d89b1a2aedd8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:37.596413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ee3ed136-013d-43a7-bb59-f059ba70ea11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:37.603696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:37.749428 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1267/2551] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:37.753586 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4301445-f5bb-4d02-9b68-a1068ff169fb admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:37.890129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4301445-f5bb-4d02-9b68-a1068ff169fb admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:37.907612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147e505-f539-455d-8bd4-e341563a7545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:37.909102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147e505-f539-455d-8bd4-e341563a7545 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:37.909898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147e505-f539-455d-8bd4-e341563a7545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:37.910638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147e505-f539-455d-8bd4-e341563a7545 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:37.912270 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147e505-f539-455d-8bd4-e341563a7545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:37.914984 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147e505-f539-455d-8bd4-e341563a7545 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:37.995509 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1285/2552] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:37 2022] POST /identity/v3/projects => generated 363 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:38.002206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ed136-013d-43a7-bb59-f059ba70ea11 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:38.025694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ed136-013d-43a7-bb59-f059ba70ea11 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:38.206843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1c0dd-7e1c-4ce0-9634-ba7004c4d537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:38.206843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1c0dd-7e1c-4ce0-9634-ba7004c4d537 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:38.206843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1c0dd-7e1c-4ce0-9634-ba7004c4d537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:38.206843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1c0dd-7e1c-4ce0-9634-ba7004c4d537 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:38.208428 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1c0dd-7e1c-4ce0-9634-ba7004c4d537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:38.213415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1c0dd-7e1c-4ce0-9634-ba7004c4d537 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:38.275654 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1268/2553] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:38 2022] POST /identity/v3/users => generated 288 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:38.277344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147e505-f539-455d-8bd4-e341563a7545 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:38.299354 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147e505-f539-455d-8bd4-e341563a7545 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:38.318382 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabcaf3-8605-4000-b572-b0417c2ba3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:38.319359 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabcaf3-8605-4000-b572-b0417c2ba3df admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:38.319960 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabcaf3-8605-4000-b572-b0417c2ba3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:38.320434 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabcaf3-8605-4000-b572-b0417c2ba3df admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:38.322170 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabcaf3-8605-4000-b572-b0417c2ba3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:38.325638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabcaf3-8605-4000-b572-b0417c2ba3df admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:38.350198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:38.372139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1c0dd-7e1c-4ce0-9634-ba7004c4d537 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:38.377502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1286/2554] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:38.384860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1c0dd-7e1c-4ce0-9634-ba7004c4d537 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:38.390948 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985b9ef-c794-49d4-a4f9-376bdafd507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:38.391951 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985b9ef-c794-49d4-a4f9-376bdafd507a admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:38.392385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985b9ef-c794-49d4-a4f9-376bdafd507a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:38.392709 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985b9ef-c794-49d4-a4f9-376bdafd507a admin admin] PATH_INFO: `/v3/projects/00a32087f1374b3ab9609de6a74feaed/users/82f1a8e4bb7a4065abf4dddad5cb2f7a/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:38.414711 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985b9ef-c794-49d4-a4f9-376bdafd507a admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a32087f1374b3ab9609de6a74feaed, user_id=82f1a8e4bb7a4065abf4dddad5cb2f7a, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:38.419519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985b9ef-c794-49d4-a4f9-376bdafd507a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:38.450515 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1269/2555] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:38 2022] PUT /identity/v3/projects/00a32087f1374b3ab9609de6a74feaed/users/82f1a8e4bb7a4065abf4dddad5cb2f7a/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:38.455286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabcaf3-8605-4000-b572-b0417c2ba3df admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:38.468352 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabcaf3-8605-4000-b572-b0417c2ba3df admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:38.559316 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291fc2d-d413-4039-a94e-2e5c0af8c906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:38.559620 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291fc2d-d413-4039-a94e-2e5c0af8c906 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:38.559904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291fc2d-d413-4039-a94e-2e5c0af8c906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:38.560175 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291fc2d-d413-4039-a94e-2e5c0af8c906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:38.560773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291fc2d-d413-4039-a94e-2e5c0af8c906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:38.562621 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291fc2d-d413-4039-a94e-2e5c0af8c906 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:38.577436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1287/2556] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:38:38.582080 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985b9ef-c794-49d4-a4f9-376bdafd507a admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:38.595618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985b9ef-c794-49d4-a4f9-376bdafd507a admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:38.602543 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b932a-3d1c-46a6-a7e0-07013554bff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:38.603376 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b932a-3d1c-46a6-a7e0-07013554bff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:38.603709 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b932a-3d1c-46a6-a7e0-07013554bff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:38.604064 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b932a-3d1c-46a6-a7e0-07013554bff4 admin admin] PATH_INFO: `/v3/projects/00a32087f1374b3ab9609de6a74feaed/users/82f1a8e4bb7a4065abf4dddad5cb2f7a/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:38.607200 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b932a-3d1c-46a6-a7e0-07013554bff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a32087f1374b3ab9609de6a74feaed, user_id=82f1a8e4bb7a4065abf4dddad5cb2f7a, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:38.612105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b932a-3d1c-46a6-a7e0-07013554bff4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:38.629405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1270/2557] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:38 2022] PUT /identity/v3/projects/00a32087f1374b3ab9609de6a74feaed/users/82f1a8e4bb7a4065abf4dddad5cb2f7a/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:38.647997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefd371-664b-478f-b29a-213d60fabc45 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:38.648507 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefd371-664b-478f-b29a-213d60fabc45 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:38.648878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefd371-664b-478f-b29a-213d60fabc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:38.713151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2aefd371-664b-478f-b29a-213d60fabc45 None None] MFA Rules not processed for user `82f1a8e4bb7a4065abf4dddad5cb2f7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:38.715280 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2aefd371-664b-478f-b29a-213d60fabc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:38.873728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1288/2558] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:38.884815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b932a-3d1c-46a6-a7e0-07013554bff4 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:38.887375 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bd6b932a-3d1c-46a6-a7e0-07013554bff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:38.999960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b932a-3d1c-46a6-a7e0-07013554bff4 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:39.004906 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95238da-6341-4642-b844-191e1fbd296f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:39.005978 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95238da-6341-4642-b844-191e1fbd296f service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:39.006798 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95238da-6341-4642-b844-191e1fbd296f service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:39.007179 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95238da-6341-4642-b844-191e1fbd296f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:39.022832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95238da-6341-4642-b844-191e1fbd296f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:39.026830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95238da-6341-4642-b844-191e1fbd296f service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:39.036375 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:39.056660 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1271/2559] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:39.882923 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefd371-664b-478f-b29a-213d60fabc45 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:40.006695 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefd371-664b-478f-b29a-213d60fabc45 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:40.015232 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcbd53-cd2d-4c69-b6b5-aa0b82328866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:40.016403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcbd53-cd2d-4c69-b6b5-aa0b82328866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:40.017017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcbd53-cd2d-4c69-b6b5-aa0b82328866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:40.017433 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcbd53-cd2d-4c69-b6b5-aa0b82328866 admin admin] PATH_INFO: `/v3/users/e158649a755f4a0b9d89b1a2aedd8dd6` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:40.019366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bcbd53-cd2d-4c69-b6b5-aa0b82328866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e158649a755f4a0b9d89b1a2aedd8dd6)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:40.021939 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bcbd53-cd2d-4c69-b6b5-aa0b82328866 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:40.061531 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:40.103235 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d6bcbd53-cd2d-4c69-b6b5-aa0b82328866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e158649a755f4a0b9d89b1a2aedd8dd6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:40.119593 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d6bcbd53-cd2d-4c69-b6b5-aa0b82328866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e158649a755f4a0b9d89b1a2aedd8dd6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:40.137663 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d6bcbd53-cd2d-4c69-b6b5-aa0b82328866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e158649a755f4a0b9d89b1a2aedd8dd6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:40.138566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d6bcbd53-cd2d-4c69-b6b5-aa0b82328866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e158649a755f4a0b9d89b1a2aedd8dd6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:40.139278 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d6bcbd53-cd2d-4c69-b6b5-aa0b82328866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e158649a755f4a0b9d89b1a2aedd8dd6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:40.159166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1289/2560] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:39 2022] DELETE /identity/v3/users/e158649a755f4a0b9d89b1a2aedd8dd6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:40.164570 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fff57-9b98-4b9e-9170-2453047ee2d1 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:40.165658 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fff57-9b98-4b9e-9170-2453047ee2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:40.165658 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fff57-9b98-4b9e-9170-2453047ee2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:40.212069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-cb9fff57-9b98-4b9e-9170-2453047ee2d1 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:40.214128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-cb9fff57-9b98-4b9e-9170-2453047ee2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:40.306006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1272/2561] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:40.318077 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcbd53-cd2d-4c69-b6b5-aa0b82328866 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:40.320014 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d6bcbd53-cd2d-4c69-b6b5-aa0b82328866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:40.418288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcbd53-cd2d-4c69-b6b5-aa0b82328866 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:40.423114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d284324-d4da-4054-997e-219b610352b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:40.423819 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d284324-d4da-4054-997e-219b610352b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:40.424143 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d284324-d4da-4054-997e-219b610352b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:40.424498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d284324-d4da-4054-997e-219b610352b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:40.437461 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d284324-d4da-4054-997e-219b610352b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:40.439613 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d284324-d4da-4054-997e-219b610352b3 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:40.452172 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1290/2562] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:41.054846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fff57-9b98-4b9e-9170-2453047ee2d1 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:41.058164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-cb9fff57-9b98-4b9e-9170-2453047ee2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:41.103231 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fff57-9b98-4b9e-9170-2453047ee2d1 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:41.112001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:41.112844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:41.113237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:41.113921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1 admin admin] PATH_INFO: `/v3/projects/9de784d7ee81404b927568f1b53c30ff` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:41.115068 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de784d7ee81404b927568f1b53c30ff)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:41.117279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:41.177607 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de784d7ee81404b927568f1b53c30ff', 'request_id': 'req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:41.187241 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de784d7ee81404b927568f1b53c30ff', 'request_id': 'req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:41.195819 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de784d7ee81404b927568f1b53c30ff', 'request_id': 'req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:41.212002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1 admin admin] The token cache is being invalidate because project 9de784d7ee81404b927568f1b53c30ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:41.212364 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:41.213234 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:41.215053 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1273/2563] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:41 2022] DELETE /identity/v3/projects/9de784d7ee81404b927568f1b53c30ff => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:41.219901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d284324-d4da-4054-997e-219b610352b3 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:41.231351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d284324-d4da-4054-997e-219b610352b3 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:41.319730 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d153f-c816-41d4-9941-fc3e16d135c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:41.320392 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d153f-c816-41d4-9941-fc3e16d135c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:41.320651 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d153f-c816-41d4-9941-fc3e16d135c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:41.320925 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d153f-c816-41d4-9941-fc3e16d135c9 admin admin] PATH_INFO: `/v3/users/82f1a8e4bb7a4065abf4dddad5cb2f7a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:41.322560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d153f-c816-41d4-9941-fc3e16d135c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f1a8e4bb7a4065abf4dddad5cb2f7a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:41.324589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d153f-c816-41d4-9941-fc3e16d135c9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:41.400900 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:41.403607 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2d6d153f-c816-41d4-9941-fc3e16d135c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f1a8e4bb7a4065abf4dddad5cb2f7a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:41.415441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2d6d153f-c816-41d4-9941-fc3e16d135c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f1a8e4bb7a4065abf4dddad5cb2f7a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:41.435394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2d6d153f-c816-41d4-9941-fc3e16d135c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f1a8e4bb7a4065abf4dddad5cb2f7a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:41.436125 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2d6d153f-c816-41d4-9941-fc3e16d135c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f1a8e4bb7a4065abf4dddad5cb2f7a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:41.436881 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2d6d153f-c816-41d4-9941-fc3e16d135c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f1a8e4bb7a4065abf4dddad5cb2f7a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:41.456645 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1291/2564] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:41 2022] DELETE /identity/v3/users/82f1a8e4bb7a4065abf4dddad5cb2f7a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:41.880718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:41.883116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:41.899683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462df0d5-c6aa-4bbc-be44-7b53eb63a3c1 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:41.995440 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeac879-2f95-44c8-aeb0-04ded33bc791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:41.996104 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeac879-2f95-44c8-aeb0-04ded33bc791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:41.996451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeac879-2f95-44c8-aeb0-04ded33bc791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:41.996828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeac879-2f95-44c8-aeb0-04ded33bc791 admin admin] PATH_INFO: `/v3/projects/00a32087f1374b3ab9609de6a74feaed` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:41.998334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeac879-2f95-44c8-aeb0-04ded33bc791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a32087f1374b3ab9609de6a74feaed)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:42.000631 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeac879-2f95-44c8-aeb0-04ded33bc791 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:42.045649 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:42.074900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4aeac879-2f95-44c8-aeb0-04ded33bc791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a32087f1374b3ab9609de6a74feaed', 'request_id': 'req-4aeac879-2f95-44c8-aeb0-04ded33bc791'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:42.084688 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4aeac879-2f95-44c8-aeb0-04ded33bc791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a32087f1374b3ab9609de6a74feaed', 'request_id': 'req-4aeac879-2f95-44c8-aeb0-04ded33bc791'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:42.093659 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4aeac879-2f95-44c8-aeb0-04ded33bc791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a32087f1374b3ab9609de6a74feaed', 'request_id': 'req-4aeac879-2f95-44c8-aeb0-04ded33bc791'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:42.111816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4aeac879-2f95-44c8-aeb0-04ded33bc791 admin admin] The token cache is being invalidate because project 00a32087f1374b3ab9609de6a74feaed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:42.112149 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4aeac879-2f95-44c8-aeb0-04ded33bc791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:42.113226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4aeac879-2f95-44c8-aeb0-04ded33bc791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:42.115158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1274/2565] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:41 2022] DELETE /identity/v3/projects/00a32087f1374b3ab9609de6a74feaed => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:42.121857 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782e443-fd9b-42aa-9dbb-4be89b505676 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:42.122423 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782e443-fd9b-42aa-9dbb-4be89b505676 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:42.123234 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782e443-fd9b-42aa-9dbb-4be89b505676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:42.148593 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7782e443-fd9b-42aa-9dbb-4be89b505676 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:42.150923 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7782e443-fd9b-42aa-9dbb-4be89b505676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:42.274542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1292/2566] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:42.284064 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234f19e-9acc-49d8-ad67-54fbfb4d531f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:42.284715 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234f19e-9acc-49d8-ad67-54fbfb4d531f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:42.284970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234f19e-9acc-49d8-ad67-54fbfb4d531f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:42.323090 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6234f19e-9acc-49d8-ad67-54fbfb4d531f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:42.324979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6234f19e-9acc-49d8-ad67-54fbfb4d531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:42.336748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1275/2567] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:42.342661 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782e443-fd9b-42aa-9dbb-4be89b505676 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:42.361707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782e443-fd9b-42aa-9dbb-4be89b505676 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:42.371444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151662e-1757-4f16-bcd2-2d582d4ae1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:42.372561 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151662e-1757-4f16-bcd2-2d582d4ae1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:42.373148 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151662e-1757-4f16-bcd2-2d582d4ae1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:42.373564 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151662e-1757-4f16-bcd2-2d582d4ae1e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:42.374853 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151662e-1757-4f16-bcd2-2d582d4ae1e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:38:42.375370 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151662e-1757-4f16-bcd2-2d582d4ae1e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:42.378700 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151662e-1757-4f16-bcd2-2d582d4ae1e6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:42.403750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1293/2568] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:38:42.408277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234f19e-9acc-49d8-ad67-54fbfb4d531f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:42.420208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234f19e-9acc-49d8-ad67-54fbfb4d531f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:42.428789 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8685ae8-328a-4e4d-ab91-bb1b04b2cb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:42.429835 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8685ae8-328a-4e4d-ab91-bb1b04b2cb34 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:42.430744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8685ae8-328a-4e4d-ab91-bb1b04b2cb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:42.431229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8685ae8-328a-4e4d-ab91-bb1b04b2cb34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:42.432303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8685ae8-328a-4e4d-ab91-bb1b04b2cb34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:42.436033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8685ae8-328a-4e4d-ab91-bb1b04b2cb34 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:42.495719 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1276/2569] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:42 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:42.497267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151662e-1757-4f16-bcd2-2d582d4ae1e6 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:42.512593 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151662e-1757-4f16-bcd2-2d582d4ae1e6 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:42.610753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3310b3-3079-44c4-824f-a4d4f091cd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:42.611654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3310b3-3079-44c4-824f-a4d4f091cd16 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:42.612092 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3310b3-3079-44c4-824f-a4d4f091cd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:42.612371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3310b3-3079-44c4-824f-a4d4f091cd16 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:42.613052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3310b3-3079-44c4-824f-a4d4f091cd16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:42.615342 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3310b3-3079-44c4-824f-a4d4f091cd16 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:42.648700 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1294/2570] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:42 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:42.650578 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8685ae8-328a-4e4d-ab91-bb1b04b2cb34 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:42.666498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8685ae8-328a-4e4d-ab91-bb1b04b2cb34 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:42.674074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1434c-63cc-4e82-ae32-8f0d83512e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:42.674459 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1434c-63cc-4e82-ae32-8f0d83512e1d admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:42.674806 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1434c-63cc-4e82-ae32-8f0d83512e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:42.674983 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1434c-63cc-4e82-ae32-8f0d83512e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:42.675883 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1434c-63cc-4e82-ae32-8f0d83512e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:42.678136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1434c-63cc-4e82-ae32-8f0d83512e1d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:42.693253 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1277/2571] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:42.697905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3310b3-3079-44c4-824f-a4d4f091cd16 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:42.710214 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3310b3-3079-44c4-824f-a4d4f091cd16 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:42.715559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af8e3e-5e22-4b4b-90a8-38c2dc044feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:42.716243 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af8e3e-5e22-4b4b-90a8-38c2dc044feb admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:42.716502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af8e3e-5e22-4b4b-90a8-38c2dc044feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:42.716790 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af8e3e-5e22-4b4b-90a8-38c2dc044feb admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:42.717473 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af8e3e-5e22-4b4b-90a8-38c2dc044feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:42.719261 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af8e3e-5e22-4b4b-90a8-38c2dc044feb admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:42.732527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1295/2572] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:42.737350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1434c-63cc-4e82-ae32-8f0d83512e1d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:42.749995 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1434c-63cc-4e82-ae32-8f0d83512e1d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:42.756737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995474e-b6d5-48cc-8bb1-d6a4fe3424c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:42.758278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995474e-b6d5-48cc-8bb1-d6a4fe3424c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:42.758278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995474e-b6d5-48cc-8bb1-d6a4fe3424c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:42.758625 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995474e-b6d5-48cc-8bb1-d6a4fe3424c9 admin admin] PATH_INFO: `/v3/projects/8901a362bd6143e0acf36c0c30373e76/users/baffcce203624347bacc8e96962e9625/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:42.779778 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995474e-b6d5-48cc-8bb1-d6a4fe3424c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8901a362bd6143e0acf36c0c30373e76, user_id=baffcce203624347bacc8e96962e9625, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:42.782921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995474e-b6d5-48cc-8bb1-d6a4fe3424c9 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:42.816095 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1278/2573] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:42 2022] PUT /identity/v3/projects/8901a362bd6143e0acf36c0c30373e76/users/baffcce203624347bacc8e96962e9625/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:42.819348 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb4705-f0ac-446d-9f30-f13d347a4966 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:42.819890 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb4705-f0ac-446d-9f30-f13d347a4966 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:42.820446 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb4705-f0ac-446d-9f30-f13d347a4966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:42.867672 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ecdb4705-f0ac-446d-9f30-f13d347a4966 None None] MFA Rules not processed for user `baffcce203624347bacc8e96962e9625`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:42.870447 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ecdb4705-f0ac-446d-9f30-f13d347a4966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:42.892681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:42.967101 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1296/2574] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:42.975027 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995474e-b6d5-48cc-8bb1-d6a4fe3424c9 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:43.081344 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995474e-b6d5-48cc-8bb1-d6a4fe3424c9 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:43.086980 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4fc3c-a5d3-45ca-aed8-9f6a76c3333c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:43.088011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4fc3c-a5d3-45ca-aed8-9f6a76c3333c admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:43.088369 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4fc3c-a5d3-45ca-aed8-9f6a76c3333c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:43.088684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4fc3c-a5d3-45ca-aed8-9f6a76c3333c admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:43.089616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4fc3c-a5d3-45ca-aed8-9f6a76c3333c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:43.091655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4fc3c-a5d3-45ca-aed8-9f6a76c3333c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:43.126069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1279/2575] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:42 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:43.131055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb4705-f0ac-446d-9f30-f13d347a4966 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:43.145244 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb4705-f0ac-446d-9f30-f13d347a4966 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:43.215700 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf89a3-0237-48dc-92c1-6cef03d6bf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:43.216954 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf89a3-0237-48dc-92c1-6cef03d6bf97 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:43.217793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf89a3-0237-48dc-92c1-6cef03d6bf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:43.218054 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf89a3-0237-48dc-92c1-6cef03d6bf97 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:43.218770 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf89a3-0237-48dc-92c1-6cef03d6bf97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:43.221106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf89a3-0237-48dc-92c1-6cef03d6bf97 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:43.250773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1297/2576] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:43 2022] POST /identity/v3/users => generated 295 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:38:43.257247 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4fc3c-a5d3-45ca-aed8-9f6a76c3333c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:43.278408 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4fc3c-a5d3-45ca-aed8-9f6a76c3333c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:43.287252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fcf64-8403-4333-af99-5bbf2f3fafa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:43.288296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fcf64-8403-4333-af99-5bbf2f3fafa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:43.288817 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fcf64-8403-4333-af99-5bbf2f3fafa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:43.289294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fcf64-8403-4333-af99-5bbf2f3fafa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:43.290621 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fcf64-8403-4333-af99-5bbf2f3fafa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:43.293801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fcf64-8403-4333-af99-5bbf2f3fafa7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:43.319806 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1280/2577] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:43.321935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf89a3-0237-48dc-92c1-6cef03d6bf97 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:43.337329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf89a3-0237-48dc-92c1-6cef03d6bf97 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:43.343467 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979d799-f4da-4e0d-aea4-544cdb18c558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:43.344503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979d799-f4da-4e0d-aea4-544cdb18c558 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:43.344825 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979d799-f4da-4e0d-aea4-544cdb18c558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:43.345098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979d799-f4da-4e0d-aea4-544cdb18c558 admin admin] PATH_INFO: `/v3/projects/bc389e1c1bfa4a3582f9c0070fbb287a/users/f0e6fb7891104caabfa23964a8563ed1/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:43.370217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979d799-f4da-4e0d-aea4-544cdb18c558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc389e1c1bfa4a3582f9c0070fbb287a, user_id=f0e6fb7891104caabfa23964a8563ed1, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:43.374723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979d799-f4da-4e0d-aea4-544cdb18c558 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:43.393910 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1298/2578] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:43 2022] PUT /identity/v3/projects/bc389e1c1bfa4a3582f9c0070fbb287a/users/f0e6fb7891104caabfa23964a8563ed1/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:43.399231 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fcf64-8403-4333-af99-5bbf2f3fafa7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:43.420325 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fcf64-8403-4333-af99-5bbf2f3fafa7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:43.471453 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:43.535524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0014c-116a-43f3-9a4f-7ab0aabd3e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:43.536792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0014c-116a-43f3-9a4f-7ab0aabd3e0e admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:43.537293 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0014c-116a-43f3-9a4f-7ab0aabd3e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:43.537949 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0014c-116a-43f3-9a4f-7ab0aabd3e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:43.539352 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0014c-116a-43f3-9a4f-7ab0aabd3e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:43.543097 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0014c-116a-43f3-9a4f-7ab0aabd3e0e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:43.561332 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1281/2579] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:43.570557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979d799-f4da-4e0d-aea4-544cdb18c558 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:43.591697 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979d799-f4da-4e0d-aea4-544cdb18c558 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:43.600058 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e21d6c-a36a-4e14-9733-86d7b6032822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:43.601317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e21d6c-a36a-4e14-9733-86d7b6032822 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:43.601847 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e21d6c-a36a-4e14-9733-86d7b6032822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:43.602347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e21d6c-a36a-4e14-9733-86d7b6032822 admin admin] PATH_INFO: `/v3/projects/bc389e1c1bfa4a3582f9c0070fbb287a/users/f0e6fb7891104caabfa23964a8563ed1/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:43.606073 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e21d6c-a36a-4e14-9733-86d7b6032822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc389e1c1bfa4a3582f9c0070fbb287a, user_id=f0e6fb7891104caabfa23964a8563ed1, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:43.608940 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e21d6c-a36a-4e14-9733-86d7b6032822 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:43.621313 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1299/2580] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:43 2022] PUT /identity/v3/projects/bc389e1c1bfa4a3582f9c0070fbb287a/users/f0e6fb7891104caabfa23964a8563ed1/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:38:43.633562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881a544-3d22-4959-ab49-ccfa2576097c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:43.633848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881a544-3d22-4959-ab49-ccfa2576097c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:43.634100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881a544-3d22-4959-ab49-ccfa2576097c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:43.668999 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c881a544-3d22-4959-ab49-ccfa2576097c None None] MFA Rules not processed for user `f0e6fb7891104caabfa23964a8563ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:43.670277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c881a544-3d22-4959-ab49-ccfa2576097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:43.778348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1282/2581] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:43.793794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e21d6c-a36a-4e14-9733-86d7b6032822 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:43.795795 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-65e21d6c-a36a-4e14-9733-86d7b6032822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:43.883123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e21d6c-a36a-4e14-9733-86d7b6032822 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:43.887253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff01cc-bcfb-4bdf-9ae0-78a8aad7c711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:43.887897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff01cc-bcfb-4bdf-9ae0-78a8aad7c711 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:43.888245 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff01cc-bcfb-4bdf-9ae0-78a8aad7c711 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:43.888629 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff01cc-bcfb-4bdf-9ae0-78a8aad7c711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:43.918451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:43.968766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff01cc-bcfb-4bdf-9ae0-78a8aad7c711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:43.970741 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff01cc-bcfb-4bdf-9ae0-78a8aad7c711 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:43.983351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1300/2582] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:45.516489 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881a544-3d22-4959-ab49-ccfa2576097c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:45.519525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c881a544-3d22-4959-ab49-ccfa2576097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:45.536052 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881a544-3d22-4959-ab49-ccfa2576097c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:45.540223 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc24cd-8130-4cfa-ae5d-bb3d219578f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:45.540915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc24cd-8130-4cfa-ae5d-bb3d219578f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:45.541230 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc24cd-8130-4cfa-ae5d-bb3d219578f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:45.541546 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc24cd-8130-4cfa-ae5d-bb3d219578f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:45.559768 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc24cd-8130-4cfa-ae5d-bb3d219578f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:45.561500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc24cd-8130-4cfa-ae5d-bb3d219578f2 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:45.574623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1283/2583] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:38:49.762802 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff01cc-bcfb-4bdf-9ae0-78a8aad7c711 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:49.896866 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff01cc-bcfb-4bdf-9ae0-78a8aad7c711 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:49.904890 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91006864-5c70-4216-b823-e31a55c389d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:49.906699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006864-5c70-4216-b823-e31a55c389d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:49.906699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006864-5c70-4216-b823-e31a55c389d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:49.907197 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006864-5c70-4216-b823-e31a55c389d1 admin admin] PATH_INFO: `/v3/users/baffcce203624347bacc8e96962e9625` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:49.909416 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91006864-5c70-4216-b823-e31a55c389d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baffcce203624347bacc8e96962e9625)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:49.913497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91006864-5c70-4216-b823-e31a55c389d1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:49.984416 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab3803-6638-445b-af48-ea99a9692923 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:49.988181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab3803-6638-445b-af48-ea99a9692923 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:49.988778 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab3803-6638-445b-af48-ea99a9692923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:50.014701 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-66ab3803-6638-445b-af48-ea99a9692923 None None] MFA Rules not processed for user `0327aa38835f41a7a82802f9cad2e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:50.016189 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-66ab3803-6638-445b-af48-ea99a9692923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:50.031706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-91006864-5c70-4216-b823-e31a55c389d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baffcce203624347bacc8e96962e9625'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:50.045121 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-91006864-5c70-4216-b823-e31a55c389d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baffcce203624347bacc8e96962e9625'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:50.066944 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-91006864-5c70-4216-b823-e31a55c389d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baffcce203624347bacc8e96962e9625'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:50.068561 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-91006864-5c70-4216-b823-e31a55c389d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baffcce203624347bacc8e96962e9625'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:50.070027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-91006864-5c70-4216-b823-e31a55c389d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baffcce203624347bacc8e96962e9625'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:50.093917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1301/2584] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:49 2022] DELETE /identity/v3/users/baffcce203624347bacc8e96962e9625 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:50.101340 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfc250-6f2f-46a2-a856-2ff01b910129 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:50.101879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfc250-6f2f-46a2-a856-2ff01b910129 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:50.102157 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1284/2585] 10.222.0.52 () {58 vars in 967 bytes} [Mon Aug 29 20:38:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:38:50.102523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfc250-6f2f-46a2-a856-2ff01b910129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:50.117349 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab3803-6638-445b-af48-ea99a9692923 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:50.118840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-66ab3803-6638-445b-af48-ea99a9692923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:50.137522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-eebfc250-6f2f-46a2-a856-2ff01b910129 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:50.139810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-eebfc250-6f2f-46a2-a856-2ff01b910129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:50.176375 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:50.216048 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:50.223028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab3803-6638-445b-af48-ea99a9692923 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:50.246657 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1302/2586] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:38:50.260037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfc250-6f2f-46a2-a856-2ff01b910129 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:50.262300 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-eebfc250-6f2f-46a2-a856-2ff01b910129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:50.335366 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720947a-cdbf-4f3e-a8f7-d95c0220429a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9791ea73d46b191ad9fc146297565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:50.336394 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720947a-cdbf-4f3e-a8f7-d95c0220429a service swift] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:50.336783 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720947a-cdbf-4f3e-a8f7-d95c0220429a service swift] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:50.337234 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720947a-cdbf-4f3e-a8f7-d95c0220429a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:50.339862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfc250-6f2f-46a2-a856-2ff01b910129 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:50.345803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945f167-97d1-4d03-b9a9-d1ccd0bbe91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:50.346765 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945f167-97d1-4d03-b9a9-d1ccd0bbe91d service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:50.347277 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945f167-97d1-4d03-b9a9-d1ccd0bbe91d service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:50.348665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945f167-97d1-4d03-b9a9-d1ccd0bbe91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:50.361640 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945f167-97d1-4d03-b9a9-d1ccd0bbe91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:50.363195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945f167-97d1-4d03-b9a9-d1ccd0bbe91d service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:50.376087 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1303/2587] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:38:50.437375 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720947a-cdbf-4f3e-a8f7-d95c0220429a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:50.439285 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720947a-cdbf-4f3e-a8f7-d95c0220429a service swift] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:50.450352 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1285/2588] 10.222.0.52 () {60 vars in 1384 bytes} [Mon Aug 29 20:38:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 20:38:50.753514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945f167-97d1-4d03-b9a9-d1ccd0bbe91d service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:50.755722 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5945f167-97d1-4d03-b9a9-d1ccd0bbe91d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:50.778973 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945f167-97d1-4d03-b9a9-d1ccd0bbe91d service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:50.801584 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594f670-8f89-4049-ae34-674a0adac657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:50.802947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594f670-8f89-4049-ae34-674a0adac657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:50.803715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594f670-8f89-4049-ae34-674a0adac657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:50.804793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594f670-8f89-4049-ae34-674a0adac657 admin admin] PATH_INFO: `/v3/projects/8901a362bd6143e0acf36c0c30373e76` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:50.807786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594f670-8f89-4049-ae34-674a0adac657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8901a362bd6143e0acf36c0c30373e76)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:50.811890 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594f670-8f89-4049-ae34-674a0adac657 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:50.904397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2594f670-8f89-4049-ae34-674a0adac657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8901a362bd6143e0acf36c0c30373e76', 'request_id': 'req-2594f670-8f89-4049-ae34-674a0adac657'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:50.916761 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2594f670-8f89-4049-ae34-674a0adac657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8901a362bd6143e0acf36c0c30373e76', 'request_id': 'req-2594f670-8f89-4049-ae34-674a0adac657'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:50.929786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2594f670-8f89-4049-ae34-674a0adac657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8901a362bd6143e0acf36c0c30373e76', 'request_id': 'req-2594f670-8f89-4049-ae34-674a0adac657'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:50.952344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2594f670-8f89-4049-ae34-674a0adac657 admin admin] The token cache is being invalidate because project 8901a362bd6143e0acf36c0c30373e76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:50.953479 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2594f670-8f89-4049-ae34-674a0adac657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:50.954325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2594f670-8f89-4049-ae34-674a0adac657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:50.960121 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1304/2589] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:50 2022] DELETE /identity/v3/projects/8901a362bd6143e0acf36c0c30373e76 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:50.961792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720947a-cdbf-4f3e-a8f7-d95c0220429a service swift] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:50.980365 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720947a-cdbf-4f3e-a8f7-d95c0220429a service swift] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:51.103839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ab9a0-4c49-4e2b-9fa2-5c8ad2fb1a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:51.104910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ab9a0-4c49-4e2b-9fa2-5c8ad2fb1a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:51.105353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ab9a0-4c49-4e2b-9fa2-5c8ad2fb1a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:51.105824 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ab9a0-4c49-4e2b-9fa2-5c8ad2fb1a15 admin admin] PATH_INFO: `/v3/users/f0e6fb7891104caabfa23964a8563ed1` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:51.107530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ab9a0-4c49-4e2b-9fa2-5c8ad2fb1a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e6fb7891104caabfa23964a8563ed1)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:51.109807 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ab9a0-4c49-4e2b-9fa2-5c8ad2fb1a15 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:51.144825 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:51.200042 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e93ab9a0-4c49-4e2b-9fa2-5c8ad2fb1a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e6fb7891104caabfa23964a8563ed1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:51.226845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e93ab9a0-4c49-4e2b-9fa2-5c8ad2fb1a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e6fb7891104caabfa23964a8563ed1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:51.248960 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e93ab9a0-4c49-4e2b-9fa2-5c8ad2fb1a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e6fb7891104caabfa23964a8563ed1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:51.250303 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e93ab9a0-4c49-4e2b-9fa2-5c8ad2fb1a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e6fb7891104caabfa23964a8563ed1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:51.266269 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e93ab9a0-4c49-4e2b-9fa2-5c8ad2fb1a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e6fb7891104caabfa23964a8563ed1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:51.275694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1286/2590] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:50 2022] DELETE /identity/v3/users/f0e6fb7891104caabfa23964a8563ed1 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:51.708694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594f670-8f89-4049-ae34-674a0adac657 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:51.712689 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2594f670-8f89-4049-ae34-674a0adac657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:51.731596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594f670-8f89-4049-ae34-674a0adac657 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:51.816925 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c91d29-cbec-4c71-af03-6666efae7c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:51.818550 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91d29-cbec-4c71-af03-6666efae7c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:51.818874 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91d29-cbec-4c71-af03-6666efae7c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:51.819353 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91d29-cbec-4c71-af03-6666efae7c1b admin admin] PATH_INFO: `/v3/projects/bc389e1c1bfa4a3582f9c0070fbb287a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:51.821187 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c91d29-cbec-4c71-af03-6666efae7c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc389e1c1bfa4a3582f9c0070fbb287a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:51.823873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c91d29-cbec-4c71-af03-6666efae7c1b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:51.839038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:51.893028 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a9c91d29-cbec-4c71-af03-6666efae7c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc389e1c1bfa4a3582f9c0070fbb287a', 'request_id': 'req-a9c91d29-cbec-4c71-af03-6666efae7c1b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:51.900045 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a9c91d29-cbec-4c71-af03-6666efae7c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc389e1c1bfa4a3582f9c0070fbb287a', 'request_id': 'req-a9c91d29-cbec-4c71-af03-6666efae7c1b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:51.909527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a9c91d29-cbec-4c71-af03-6666efae7c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc389e1c1bfa4a3582f9c0070fbb287a', 'request_id': 'req-a9c91d29-cbec-4c71-af03-6666efae7c1b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:51.930081 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a9c91d29-cbec-4c71-af03-6666efae7c1b admin admin] The token cache is being invalidate because project bc389e1c1bfa4a3582f9c0070fbb287a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:51.930523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a9c91d29-cbec-4c71-af03-6666efae7c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:51.931438 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a9c91d29-cbec-4c71-af03-6666efae7c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:51.933249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1305/2591] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:51 2022] DELETE /identity/v3/projects/bc389e1c1bfa4a3582f9c0070fbb287a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:38:51.939563 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61c5da-a042-43f5-bf08-97be9f14d73c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:51.939853 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61c5da-a042-43f5-bf08-97be9f14d73c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:51.940131 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61c5da-a042-43f5-bf08-97be9f14d73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:51.972874 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-8b61c5da-a042-43f5-bf08-97be9f14d73c None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:51.974812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8b61c5da-a042-43f5-bf08-97be9f14d73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:52.065431 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1287/2592] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:38:52.075582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac82d2-9331-435c-8632-e9f0507a1c71 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.075910 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac82d2-9331-435c-8632-e9f0507a1c71 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.076167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac82d2-9331-435c-8632-e9f0507a1c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.103578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f2ac82d2-9331-435c-8632-e9f0507a1c71 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:52.104820 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f2ac82d2-9331-435c-8632-e9f0507a1c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:52.112997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1306/2593] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:52.118103 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61c5da-a042-43f5-bf08-97be9f14d73c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:52.130241 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61c5da-a042-43f5-bf08-97be9f14d73c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:52.137025 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fe4cc-d9c2-46d4-b58f-1adcaeed1dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:52.138539 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fe4cc-d9c2-46d4-b58f-1adcaeed1dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.138956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fe4cc-d9c2-46d4-b58f-1adcaeed1dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.139257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fe4cc-d9c2-46d4-b58f-1adcaeed1dc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.140110 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fe4cc-d9c2-46d4-b58f-1adcaeed1dc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:38:52.140416 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fe4cc-d9c2-46d4-b58f-1adcaeed1dc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:52.142336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fe4cc-d9c2-46d4-b58f-1adcaeed1dc5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:52.161817 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1288/2594] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:38:52.167446 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac82d2-9331-435c-8632-e9f0507a1c71 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:52.184019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac82d2-9331-435c-8632-e9f0507a1c71 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:52.189927 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c64d6-3fee-4bac-b26a-efbe00c34f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:52.190554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c64d6-3fee-4bac-b26a-efbe00c34f69 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.190825 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c64d6-3fee-4bac-b26a-efbe00c34f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.191093 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c64d6-3fee-4bac-b26a-efbe00c34f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.191731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c64d6-3fee-4bac-b26a-efbe00c34f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:52.193670 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c64d6-3fee-4bac-b26a-efbe00c34f69 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:52.227933 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1307/2595] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:52 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:52.235939 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fe4cc-d9c2-46d4-b58f-1adcaeed1dc5 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:52.248511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fe4cc-d9c2-46d4-b58f-1adcaeed1dc5 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:52.317906 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae61823-2b80-4d27-9a60-3d70327a09b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:52.318594 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae61823-2b80-4d27-9a60-3d70327a09b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.318873 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae61823-2b80-4d27-9a60-3d70327a09b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.319179 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae61823-2b80-4d27-9a60-3d70327a09b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.319910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae61823-2b80-4d27-9a60-3d70327a09b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:52.322121 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae61823-2b80-4d27-9a60-3d70327a09b8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:52.349478 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1289/2596] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:52 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:52.354036 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c64d6-3fee-4bac-b26a-efbe00c34f69 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:52.366939 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c64d6-3fee-4bac-b26a-efbe00c34f69 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:52.374827 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10957629-9193-45d1-bdce-407570ed7cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:52.375457 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10957629-9193-45d1-bdce-407570ed7cae admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.375739 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10957629-9193-45d1-bdce-407570ed7cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.376007 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10957629-9193-45d1-bdce-407570ed7cae admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.376658 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10957629-9193-45d1-bdce-407570ed7cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:52.378455 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10957629-9193-45d1-bdce-407570ed7cae admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:52.391276 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1308/2597] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:52.400312 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae61823-2b80-4d27-9a60-3d70327a09b8 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:52.411153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae61823-2b80-4d27-9a60-3d70327a09b8 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:52.416754 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f63bb-578d-4062-b4b3-9b356127fb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:52.417412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f63bb-578d-4062-b4b3-9b356127fb9f admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.417698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f63bb-578d-4062-b4b3-9b356127fb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.417974 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f63bb-578d-4062-b4b3-9b356127fb9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.418627 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f63bb-578d-4062-b4b3-9b356127fb9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:52.420282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f63bb-578d-4062-b4b3-9b356127fb9f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:52.437876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1290/2598] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:38:52.439181 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10957629-9193-45d1-bdce-407570ed7cae admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:52.451398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10957629-9193-45d1-bdce-407570ed7cae admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:52.457419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0ac77-3a4a-44b0-bc41-fe3293565901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:52.458189 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0ac77-3a4a-44b0-bc41-fe3293565901 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.458535 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0ac77-3a4a-44b0-bc41-fe3293565901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.458989 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0ac77-3a4a-44b0-bc41-fe3293565901 admin admin] PATH_INFO: `/v3/projects/d6b646960b7043e78dcbc00766eb7c5b/users/1736ee032ede4e19b0c25b9fd2422d7d/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.615250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0ac77-3a4a-44b0-bc41-fe3293565901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b646960b7043e78dcbc00766eb7c5b, user_id=1736ee032ede4e19b0c25b9fd2422d7d, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:52.617936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0ac77-3a4a-44b0-bc41-fe3293565901 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:52.636365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1309/2599] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:52 2022] PUT /identity/v3/projects/d6b646960b7043e78dcbc00766eb7c5b/users/1736ee032ede4e19b0c25b9fd2422d7d/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:52.647205 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a04e4-ce3f-425c-ada9-1fc576e4d0a2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.647497 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a04e4-ce3f-425c-ada9-1fc576e4d0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.647778 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a04e4-ce3f-425c-ada9-1fc576e4d0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.663014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:52.684033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-459a04e4-ce3f-425c-ada9-1fc576e4d0a2 None None] MFA Rules not processed for user `1736ee032ede4e19b0c25b9fd2422d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:52.685292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-459a04e4-ce3f-425c-ada9-1fc576e4d0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:52.764586 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1291/2600] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:52.769503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0ac77-3a4a-44b0-bc41-fe3293565901 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:52.844553 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0ac77-3a4a-44b0-bc41-fe3293565901 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:52.849440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6487d-c7fe-4668-bb14-3ddce8d542e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:52.850098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6487d-c7fe-4668-bb14-3ddce8d542e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.850452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6487d-c7fe-4668-bb14-3ddce8d542e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.850725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6487d-c7fe-4668-bb14-3ddce8d542e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.851369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6487d-c7fe-4668-bb14-3ddce8d542e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:52.853508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6487d-c7fe-4668-bb14-3ddce8d542e9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:52.887244 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1310/2601] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:52 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:52.891552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a04e4-ce3f-425c-ada9-1fc576e4d0a2 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:52.903197 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a04e4-ce3f-425c-ada9-1fc576e4d0a2 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:52.968505 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb252dc-db08-4887-ab7a-cd6e4281af9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:52.969165 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb252dc-db08-4887-ab7a-cd6e4281af9a admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.969476 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb252dc-db08-4887-ab7a-cd6e4281af9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.969786 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb252dc-db08-4887-ab7a-cd6e4281af9a admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.970572 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb252dc-db08-4887-ab7a-cd6e4281af9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:52.972868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb252dc-db08-4887-ab7a-cd6e4281af9a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:52.996429 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1292/2602] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:52 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:53.002829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6487d-c7fe-4668-bb14-3ddce8d542e9 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:53.014639 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6487d-c7fe-4668-bb14-3ddce8d542e9 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:53.019406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e92bed-0da8-4813-8d69-bb3e1c787073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:53.020220 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e92bed-0da8-4813-8d69-bb3e1c787073 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:53.020559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e92bed-0da8-4813-8d69-bb3e1c787073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:53.020745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e92bed-0da8-4813-8d69-bb3e1c787073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:53.021898 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e92bed-0da8-4813-8d69-bb3e1c787073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:53.023882 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e92bed-0da8-4813-8d69-bb3e1c787073 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:53.035549 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1311/2603] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:53.040457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb252dc-db08-4887-ab7a-cd6e4281af9a admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:53.058396 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb252dc-db08-4887-ab7a-cd6e4281af9a admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:53.065970 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839dd93d-45b0-405f-a40f-11470450006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:53.067119 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dd93d-45b0-405f-a40f-11470450006e admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:53.067580 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dd93d-45b0-405f-a40f-11470450006e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:53.067936 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dd93d-45b0-405f-a40f-11470450006e admin admin] PATH_INFO: `/v3/projects/d818ef5c27ee4027bb3e6dc4c6be3e97/users/26f677e73133448c941ba2d8cc052cb1/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:53.089319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839dd93d-45b0-405f-a40f-11470450006e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d818ef5c27ee4027bb3e6dc4c6be3e97, user_id=26f677e73133448c941ba2d8cc052cb1, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:53.091237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839dd93d-45b0-405f-a40f-11470450006e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:53.107509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1293/2604] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:53 2022] PUT /identity/v3/projects/d818ef5c27ee4027bb3e6dc4c6be3e97/users/26f677e73133448c941ba2d8cc052cb1/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:53.111762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e92bed-0da8-4813-8d69-bb3e1c787073 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:53.122622 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e92bed-0da8-4813-8d69-bb3e1c787073 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:53.131356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:53.187172 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b289d05-d473-47d1-9b38-c972824d3dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:53.187695 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b289d05-d473-47d1-9b38-c972824d3dfb admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:53.187980 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b289d05-d473-47d1-9b38-c972824d3dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:53.188261 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b289d05-d473-47d1-9b38-c972824d3dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:53.188881 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b289d05-d473-47d1-9b38-c972824d3dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:53.190562 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b289d05-d473-47d1-9b38-c972824d3dfb admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:53.206966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1312/2605] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:53.217523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839dd93d-45b0-405f-a40f-11470450006e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:53.232884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839dd93d-45b0-405f-a40f-11470450006e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:53.239958 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b5624-9a64-4e73-9d59-01fed034494f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:53.241133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b5624-9a64-4e73-9d59-01fed034494f admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:53.241616 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b5624-9a64-4e73-9d59-01fed034494f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:53.241949 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b5624-9a64-4e73-9d59-01fed034494f admin admin] PATH_INFO: `/v3/projects/d818ef5c27ee4027bb3e6dc4c6be3e97/users/26f677e73133448c941ba2d8cc052cb1/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:53.245268 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b5624-9a64-4e73-9d59-01fed034494f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d818ef5c27ee4027bb3e6dc4c6be3e97, user_id=26f677e73133448c941ba2d8cc052cb1, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:53.250153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b5624-9a64-4e73-9d59-01fed034494f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:53.268125 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1294/2606] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:53 2022] PUT /identity/v3/projects/d818ef5c27ee4027bb3e6dc4c6be3e97/users/26f677e73133448c941ba2d8cc052cb1/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:53.282135 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2563c-e68a-41a9-a938-3c04c6d09a93 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:53.282435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2563c-e68a-41a9-a938-3c04c6d09a93 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:53.282707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2563c-e68a-41a9-a938-3c04c6d09a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:53.316225 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c0e2563c-e68a-41a9-a938-3c04c6d09a93 None None] MFA Rules not processed for user `26f677e73133448c941ba2d8cc052cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:53.317699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c0e2563c-e68a-41a9-a938-3c04c6d09a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:53.414742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1313/2607] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:38:53.428679 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b5624-9a64-4e73-9d59-01fed034494f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:53.430852 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d10b5624-9a64-4e73-9d59-01fed034494f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:53.523076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:53.529387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b5624-9a64-4e73-9d59-01fed034494f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:53.535159 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd9272-c799-4b24-91e3-edfdec92b0f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:53.535840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd9272-c799-4b24-91e3-edfdec92b0f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:53.536124 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd9272-c799-4b24-91e3-edfdec92b0f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:53.536394 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd9272-c799-4b24-91e3-edfdec92b0f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:53.547187 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd9272-c799-4b24-91e3-edfdec92b0f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:53.548709 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd9272-c799-4b24-91e3-edfdec92b0f6 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:53.565840 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1295/2608] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:53.684359 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2563c-e68a-41a9-a938-3c04c6d09a93 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:53.695665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2563c-e68a-41a9-a938-3c04c6d09a93 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:53.699670 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e58552-d702-442b-a443-4bc6007d5bfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:53.700366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e58552-d702-442b-a443-4bc6007d5bfd service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:53.700641 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e58552-d702-442b-a443-4bc6007d5bfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:53.700905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e58552-d702-442b-a443-4bc6007d5bfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:53.781162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e58552-d702-442b-a443-4bc6007d5bfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:53.783339 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e58552-d702-442b-a443-4bc6007d5bfd service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:53.794396 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1314/2609] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:58.944207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd9272-c799-4b24-91e3-edfdec92b0f6 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:59.035665 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd9272-c799-4b24-91e3-edfdec92b0f6 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:59.044497 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d9447-36c6-4219-b36b-e05314f2478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:59.045172 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9447-36c6-4219-b36b-e05314f2478c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:59.045479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9447-36c6-4219-b36b-e05314f2478c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:59.045807 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9447-36c6-4219-b36b-e05314f2478c admin admin] PATH_INFO: `/v3/users/1736ee032ede4e19b0c25b9fd2422d7d` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:59.047287 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d9447-36c6-4219-b36b-e05314f2478c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1736ee032ede4e19b0c25b9fd2422d7d)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:59.049511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d9447-36c6-4219-b36b-e05314f2478c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:59.119030 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e81d9447-36c6-4219-b36b-e05314f2478c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1736ee032ede4e19b0c25b9fd2422d7d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:59.133594 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e81d9447-36c6-4219-b36b-e05314f2478c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1736ee032ede4e19b0c25b9fd2422d7d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:59.142423 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e81d9447-36c6-4219-b36b-e05314f2478c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1736ee032ede4e19b0c25b9fd2422d7d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:59.143456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e81d9447-36c6-4219-b36b-e05314f2478c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1736ee032ede4e19b0c25b9fd2422d7d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:59.154499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e81d9447-36c6-4219-b36b-e05314f2478c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1736ee032ede4e19b0c25b9fd2422d7d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:59.163705 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1296/2610] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:58 2022] DELETE /identity/v3/users/1736ee032ede4e19b0c25b9fd2422d7d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:59.169539 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c96d-ec67-4f56-a962-98096ee5aa32 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:59.170368 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c96d-ec67-4f56-a962-98096ee5aa32 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:59.170368 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c96d-ec67-4f56-a962-98096ee5aa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:59.192137 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-29b2c96d-ec67-4f56-a962-98096ee5aa32 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:59.193395 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-29b2c96d-ec67-4f56-a962-98096ee5aa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:59.222462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:59.273112 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1315/2611] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:59.284828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d9447-36c6-4219-b36b-e05314f2478c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:59.286522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e81d9447-36c6-4219-b36b-e05314f2478c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:59.354014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d9447-36c6-4219-b36b-e05314f2478c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:59.357919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19bfed-1367-4547-870f-d4f84a3352f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:59.358587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19bfed-1367-4547-870f-d4f84a3352f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:59.358848 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19bfed-1367-4547-870f-d4f84a3352f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:59.359118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19bfed-1367-4547-870f-d4f84a3352f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:59.369597 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19bfed-1367-4547-870f-d4f84a3352f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:59.371095 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19bfed-1367-4547-870f-d4f84a3352f0 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:59.381549 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1297/2612] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:38:59.725637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2c96d-ec67-4f56-a962-98096ee5aa32 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:59.727431 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-29b2c96d-ec67-4f56-a962-98096ee5aa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:59.743330 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2c96d-ec67-4f56-a962-98096ee5aa32 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:59.752117 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00425c05-4be5-481f-9e05-f9ea422ef3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:59.753195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00425c05-4be5-481f-9e05-f9ea422ef3a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:59.753500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00425c05-4be5-481f-9e05-f9ea422ef3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:59.753823 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00425c05-4be5-481f-9e05-f9ea422ef3a2 admin admin] PATH_INFO: `/v3/projects/d6b646960b7043e78dcbc00766eb7c5b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:59.755164 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00425c05-4be5-481f-9e05-f9ea422ef3a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b646960b7043e78dcbc00766eb7c5b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:59.757637 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00425c05-4be5-481f-9e05-f9ea422ef3a2 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:59.835889 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-00425c05-4be5-481f-9e05-f9ea422ef3a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b646960b7043e78dcbc00766eb7c5b', 'request_id': 'req-00425c05-4be5-481f-9e05-f9ea422ef3a2'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:59.843360 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-00425c05-4be5-481f-9e05-f9ea422ef3a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b646960b7043e78dcbc00766eb7c5b', 'request_id': 'req-00425c05-4be5-481f-9e05-f9ea422ef3a2'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:59.853211 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-00425c05-4be5-481f-9e05-f9ea422ef3a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b646960b7043e78dcbc00766eb7c5b', 'request_id': 'req-00425c05-4be5-481f-9e05-f9ea422ef3a2'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:59.869105 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-00425c05-4be5-481f-9e05-f9ea422ef3a2 admin admin] The token cache is being invalidate because project d6b646960b7043e78dcbc00766eb7c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:59.869519 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-00425c05-4be5-481f-9e05-f9ea422ef3a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:59.870537 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-00425c05-4be5-481f-9e05-f9ea422ef3a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:59.872248 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1316/2613] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:59 2022] DELETE /identity/v3/projects/d6b646960b7043e78dcbc00766eb7c5b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:38:59.879496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19bfed-1367-4547-870f-d4f84a3352f0 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:59.893532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19bfed-1367-4547-870f-d4f84a3352f0 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:59.907318 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:59.973891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31747b-0a86-4a0b-afa7-3496c679ae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:59.974907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31747b-0a86-4a0b-afa7-3496c679ae87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:59.975348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31747b-0a86-4a0b-afa7-3496c679ae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:59.975656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31747b-0a86-4a0b-afa7-3496c679ae87 admin admin] PATH_INFO: `/v3/users/26f677e73133448c941ba2d8cc052cb1` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:59.977290 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31747b-0a86-4a0b-afa7-3496c679ae87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26f677e73133448c941ba2d8cc052cb1)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:59.980123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31747b-0a86-4a0b-afa7-3496c679ae87 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:00.041850 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ee31747b-0a86-4a0b-afa7-3496c679ae87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26f677e73133448c941ba2d8cc052cb1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:00.057240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ee31747b-0a86-4a0b-afa7-3496c679ae87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26f677e73133448c941ba2d8cc052cb1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:00.065127 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ee31747b-0a86-4a0b-afa7-3496c679ae87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26f677e73133448c941ba2d8cc052cb1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:00.065918 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ee31747b-0a86-4a0b-afa7-3496c679ae87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26f677e73133448c941ba2d8cc052cb1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:00.074256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ee31747b-0a86-4a0b-afa7-3496c679ae87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26f677e73133448c941ba2d8cc052cb1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:00.081574 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1298/2614] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:59 2022] DELETE /identity/v3/users/26f677e73133448c941ba2d8cc052cb1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:00.415042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00425c05-4be5-481f-9e05-f9ea422ef3a2 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:00.416831 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-00425c05-4be5-481f-9e05-f9ea422ef3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:00.431240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00425c05-4be5-481f-9e05-f9ea422ef3a2 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:00.504154 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4783cf-0da0-483d-b7f2-4eecd3bca1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:00.504890 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4783cf-0da0-483d-b7f2-4eecd3bca1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:00.505224 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4783cf-0da0-483d-b7f2-4eecd3bca1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:00.505476 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4783cf-0da0-483d-b7f2-4eecd3bca1f8 admin admin] PATH_INFO: `/v3/projects/d818ef5c27ee4027bb3e6dc4c6be3e97` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:00.506921 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4783cf-0da0-483d-b7f2-4eecd3bca1f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d818ef5c27ee4027bb3e6dc4c6be3e97)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:00.509234 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4783cf-0da0-483d-b7f2-4eecd3bca1f8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:00.572589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2a4783cf-0da0-483d-b7f2-4eecd3bca1f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd818ef5c27ee4027bb3e6dc4c6be3e97', 'request_id': 'req-2a4783cf-0da0-483d-b7f2-4eecd3bca1f8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:00.581221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2a4783cf-0da0-483d-b7f2-4eecd3bca1f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd818ef5c27ee4027bb3e6dc4c6be3e97', 'request_id': 'req-2a4783cf-0da0-483d-b7f2-4eecd3bca1f8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:00.584674 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:00.592227 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2a4783cf-0da0-483d-b7f2-4eecd3bca1f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd818ef5c27ee4027bb3e6dc4c6be3e97', 'request_id': 'req-2a4783cf-0da0-483d-b7f2-4eecd3bca1f8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:00.606556 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2a4783cf-0da0-483d-b7f2-4eecd3bca1f8 admin admin] The token cache is being invalidate because project d818ef5c27ee4027bb3e6dc4c6be3e97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:39:00.606777 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2a4783cf-0da0-483d-b7f2-4eecd3bca1f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:00.607743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2a4783cf-0da0-483d-b7f2-4eecd3bca1f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:00.609673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1317/2615] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:39:00 2022] DELETE /identity/v3/projects/d818ef5c27ee4027bb3e6dc4c6be3e97 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:00.615560 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b83ddb-0b88-4c1c-87b8-8397b941d485 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:00.615972 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b83ddb-0b88-4c1c-87b8-8397b941d485 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:00.616402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b83ddb-0b88-4c1c-87b8-8397b941d485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:00.640371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-73b83ddb-0b88-4c1c-87b8-8397b941d485 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:00.641837 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-73b83ddb-0b88-4c1c-87b8-8397b941d485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:00.722517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1299/2616] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:00.731822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f0bca-9ad9-4e41-9a44-e3babbe43f0b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:00.732147 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f0bca-9ad9-4e41-9a44-e3babbe43f0b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:00.732418 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f0bca-9ad9-4e41-9a44-e3babbe43f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:00.757222 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-089f0bca-9ad9-4e41-9a44-e3babbe43f0b None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:00.758666 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-089f0bca-9ad9-4e41-9a44-e3babbe43f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:00.768837 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1318/2617] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:00.773608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b83ddb-0b88-4c1c-87b8-8397b941d485 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:00.784622 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b83ddb-0b88-4c1c-87b8-8397b941d485 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:00.790546 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec6763-028b-4374-aa30-67693a0363af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:00.791196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec6763-028b-4374-aa30-67693a0363af admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:00.791472 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec6763-028b-4374-aa30-67693a0363af admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:00.791876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec6763-028b-4374-aa30-67693a0363af admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:00.792651 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec6763-028b-4374-aa30-67693a0363af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:39:00.793079 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec6763-028b-4374-aa30-67693a0363af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:00.794919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec6763-028b-4374-aa30-67693a0363af admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:00.810397 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1300/2618] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:39:00.815360 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f0bca-9ad9-4e41-9a44-e3babbe43f0b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:00.825840 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f0bca-9ad9-4e41-9a44-e3babbe43f0b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:00.831212 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110ba23-6d40-4f09-9c66-9ad7196f2a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:00.831844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110ba23-6d40-4f09-9c66-9ad7196f2a7a admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:00.832114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110ba23-6d40-4f09-9c66-9ad7196f2a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:00.832378 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110ba23-6d40-4f09-9c66-9ad7196f2a7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:00.833146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110ba23-6d40-4f09-9c66-9ad7196f2a7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:00.835167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110ba23-6d40-4f09-9c66-9ad7196f2a7a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:00.866190 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1319/2619] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:00 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:00.871786 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec6763-028b-4374-aa30-67693a0363af admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:00.884530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec6763-028b-4374-aa30-67693a0363af admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:00.904298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:00.964496 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4e5f6-05a2-4a57-aad6-c2dbffa5e505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:00.965591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4e5f6-05a2-4a57-aad6-c2dbffa5e505 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:00.966100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4e5f6-05a2-4a57-aad6-c2dbffa5e505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:00.966458 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4e5f6-05a2-4a57-aad6-c2dbffa5e505 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:00.967377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4e5f6-05a2-4a57-aad6-c2dbffa5e505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:00.969945 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4e5f6-05a2-4a57-aad6-c2dbffa5e505 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:00.998010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1301/2620] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:00 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:39:01.002882 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110ba23-6d40-4f09-9c66-9ad7196f2a7a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:01.018159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110ba23-6d40-4f09-9c66-9ad7196f2a7a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:01.026056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77002a14-5537-40e5-95fe-2d26c0d69dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:01.026845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77002a14-5537-40e5-95fe-2d26c0d69dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:01.027166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77002a14-5537-40e5-95fe-2d26c0d69dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:01.027537 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77002a14-5537-40e5-95fe-2d26c0d69dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:01.028567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77002a14-5537-40e5-95fe-2d26c0d69dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:01.031526 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77002a14-5537-40e5-95fe-2d26c0d69dd1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:01.051249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1320/2621] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:01.058864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4e5f6-05a2-4a57-aad6-c2dbffa5e505 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:01.074812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4e5f6-05a2-4a57-aad6-c2dbffa5e505 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:01.083157 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfebbe3-4d5b-4db1-a875-a2bd5541643a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:01.083782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfebbe3-4d5b-4db1-a875-a2bd5541643a admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:01.084182 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfebbe3-4d5b-4db1-a875-a2bd5541643a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:01.084490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfebbe3-4d5b-4db1-a875-a2bd5541643a admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:01.085261 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfebbe3-4d5b-4db1-a875-a2bd5541643a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:01.087425 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfebbe3-4d5b-4db1-a875-a2bd5541643a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:01.101240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1302/2622] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:01.108753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77002a14-5537-40e5-95fe-2d26c0d69dd1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:01.119936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77002a14-5537-40e5-95fe-2d26c0d69dd1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:01.124615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25bd7e-7e78-4d62-90ca-9f53007bb753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:01.125272 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25bd7e-7e78-4d62-90ca-9f53007bb753 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:01.125571 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25bd7e-7e78-4d62-90ca-9f53007bb753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:01.125836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25bd7e-7e78-4d62-90ca-9f53007bb753 admin admin] PATH_INFO: `/v3/projects/726bf5189db44c1083b38158840250d3/users/e830ed5e11ef4c79897d7c513ab8ad4e/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:01.141933 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25bd7e-7e78-4d62-90ca-9f53007bb753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726bf5189db44c1083b38158840250d3, user_id=e830ed5e11ef4c79897d7c513ab8ad4e, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:01.144614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25bd7e-7e78-4d62-90ca-9f53007bb753 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:01.160651 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1321/2623] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:01 2022] PUT /identity/v3/projects/726bf5189db44c1083b38158840250d3/users/e830ed5e11ef4c79897d7c513ab8ad4e/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:01.174021 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e11278-7ee1-4ca5-8e02-8bb117b37a76 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:01.174309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e11278-7ee1-4ca5-8e02-8bb117b37a76 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:01.174556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e11278-7ee1-4ca5-8e02-8bb117b37a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:01.211586 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-57e11278-7ee1-4ca5-8e02-8bb117b37a76 None None] MFA Rules not processed for user `e830ed5e11ef4c79897d7c513ab8ad4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:01.212837 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-57e11278-7ee1-4ca5-8e02-8bb117b37a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:01.301129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1303/2624] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:39:01.306775 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25bd7e-7e78-4d62-90ca-9f53007bb753 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:01.396957 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25bd7e-7e78-4d62-90ca-9f53007bb753 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:01.405256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4a41b-0524-4daa-aa5f-446172ccdceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:01.406247 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4a41b-0524-4daa-aa5f-446172ccdceb admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:01.406675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4a41b-0524-4daa-aa5f-446172ccdceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:01.407205 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4a41b-0524-4daa-aa5f-446172ccdceb admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:01.407999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4a41b-0524-4daa-aa5f-446172ccdceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:01.410929 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4a41b-0524-4daa-aa5f-446172ccdceb admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:01.443064 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1322/2625] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:01 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:01.447462 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e11278-7ee1-4ca5-8e02-8bb117b37a76 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:01.461347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e11278-7ee1-4ca5-8e02-8bb117b37a76 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:01.539687 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c16fe-6f76-468c-9676-e3de13e7d649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:01.540441 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c16fe-6f76-468c-9676-e3de13e7d649 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:01.540794 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c16fe-6f76-468c-9676-e3de13e7d649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:01.541055 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c16fe-6f76-468c-9676-e3de13e7d649 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:01.541907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c16fe-6f76-468c-9676-e3de13e7d649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:01.544074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c16fe-6f76-468c-9676-e3de13e7d649 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:01.575544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1304/2626] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:01 2022] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:39:01.580800 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4a41b-0524-4daa-aa5f-446172ccdceb admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:01.595396 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4a41b-0524-4daa-aa5f-446172ccdceb admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:01.600468 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21ae45-ca36-4602-b544-64eec3db2bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:01.601122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21ae45-ca36-4602-b544-64eec3db2bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:01.601575 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21ae45-ca36-4602-b544-64eec3db2bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:01.601918 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21ae45-ca36-4602-b544-64eec3db2bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:01.602767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21ae45-ca36-4602-b544-64eec3db2bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:01.604681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21ae45-ca36-4602-b544-64eec3db2bb2 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:01.617751 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1323/2627] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:01.623830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c16fe-6f76-468c-9676-e3de13e7d649 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:01.640331 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c16fe-6f76-468c-9676-e3de13e7d649 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:01.648569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c56445-5124-4f68-afdd-860eefb4feec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:01.649333 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c56445-5124-4f68-afdd-860eefb4feec admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:01.649679 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c56445-5124-4f68-afdd-860eefb4feec admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:01.649984 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c56445-5124-4f68-afdd-860eefb4feec admin admin] PATH_INFO: `/v3/projects/57d47a66a1264312a19cbc7c5cac77dc/users/3a06f70c43f54af980eba69fbc8c458c/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:01.672415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c56445-5124-4f68-afdd-860eefb4feec admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d47a66a1264312a19cbc7c5cac77dc, user_id=3a06f70c43f54af980eba69fbc8c458c, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:01.676259 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c56445-5124-4f68-afdd-860eefb4feec admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:01.680091 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:01.700070 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1305/2628] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:01 2022] PUT /identity/v3/projects/57d47a66a1264312a19cbc7c5cac77dc/users/3a06f70c43f54af980eba69fbc8c458c/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:01.706532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21ae45-ca36-4602-b544-64eec3db2bb2 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:01.718586 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21ae45-ca36-4602-b544-64eec3db2bb2 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:01.780163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:01.793502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee56ab7-cbd7-460a-bda4-f383d51e19ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:01.794259 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee56ab7-cbd7-460a-bda4-f383d51e19ac admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:01.794593 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee56ab7-cbd7-460a-bda4-f383d51e19ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:01.794991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee56ab7-cbd7-460a-bda4-f383d51e19ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:01.795750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee56ab7-cbd7-460a-bda4-f383d51e19ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:01.798070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee56ab7-cbd7-460a-bda4-f383d51e19ac admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:01.810832 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1324/2629] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:01.815296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c56445-5124-4f68-afdd-860eefb4feec admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:01.826703 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c56445-5124-4f68-afdd-860eefb4feec admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:01.832134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128cb46-b10c-4ce4-9189-59049613fbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:01.833027 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128cb46-b10c-4ce4-9189-59049613fbf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:01.833213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128cb46-b10c-4ce4-9189-59049613fbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:01.833514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128cb46-b10c-4ce4-9189-59049613fbf0 admin admin] PATH_INFO: `/v3/projects/57d47a66a1264312a19cbc7c5cac77dc/users/3a06f70c43f54af980eba69fbc8c458c/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:01.835598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128cb46-b10c-4ce4-9189-59049613fbf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d47a66a1264312a19cbc7c5cac77dc, user_id=3a06f70c43f54af980eba69fbc8c458c, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:01.838296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128cb46-b10c-4ce4-9189-59049613fbf0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:01.853522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1306/2630] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:01 2022] PUT /identity/v3/projects/57d47a66a1264312a19cbc7c5cac77dc/users/3a06f70c43f54af980eba69fbc8c458c/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:01.941529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb826e1-cf34-41ed-a137-b4930e8c466f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:01.941756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb826e1-cf34-41ed-a137-b4930e8c466f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:01.942160 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb826e1-cf34-41ed-a137-b4930e8c466f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:01.980331 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ebb826e1-cf34-41ed-a137-b4930e8c466f None None] MFA Rules not processed for user `3a06f70c43f54af980eba69fbc8c458c`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:01.982062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ebb826e1-cf34-41ed-a137-b4930e8c466f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:02.087094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1325/2631] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:02.108645 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128cb46-b10c-4ce4-9189-59049613fbf0 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:02.111580 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7128cb46-b10c-4ce4-9189-59049613fbf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:02.180157 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128cb46-b10c-4ce4-9189-59049613fbf0 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:02.184675 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67368b3-e37b-4498-8060-78707b63651d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:02.185341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67368b3-e37b-4498-8060-78707b63651d service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:02.185653 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67368b3-e37b-4498-8060-78707b63651d service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:02.185950 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67368b3-e37b-4498-8060-78707b63651d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:02.258384 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67368b3-e37b-4498-8060-78707b63651d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:02.260061 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67368b3-e37b-4498-8060-78707b63651d service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:02.274166 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1307/2632] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:06.711999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb826e1-cf34-41ed-a137-b4930e8c466f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:06.721281 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ebb826e1-cf34-41ed-a137-b4930e8c466f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:06.759950 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb826e1-cf34-41ed-a137-b4930e8c466f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:06.763845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49627f28-78e0-4ba7-809c-cb3815ad4375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:06.764464 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49627f28-78e0-4ba7-809c-cb3815ad4375 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:06.764741 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49627f28-78e0-4ba7-809c-cb3815ad4375 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:06.765285 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49627f28-78e0-4ba7-809c-cb3815ad4375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:06.801622 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49627f28-78e0-4ba7-809c-cb3815ad4375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:06.803189 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49627f28-78e0-4ba7-809c-cb3815ad4375 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:06.814702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1326/2633] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:39:11.844190 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67368b3-e37b-4498-8060-78707b63651d service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:11.955198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67368b3-e37b-4498-8060-78707b63651d service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:11.960232 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bed55-dca2-4c97-b627-08bc99617046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:11.961195 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bed55-dca2-4c97-b627-08bc99617046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:11.961504 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bed55-dca2-4c97-b627-08bc99617046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:11.961768 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bed55-dca2-4c97-b627-08bc99617046 admin admin] PATH_INFO: `/v3/users/e830ed5e11ef4c79897d7c513ab8ad4e` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:11.962945 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bed55-dca2-4c97-b627-08bc99617046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e830ed5e11ef4c79897d7c513ab8ad4e)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:11.964930 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bed55-dca2-4c97-b627-08bc99617046 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:11.966817 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:12.020456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-713bed55-dca2-4c97-b627-08bc99617046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e830ed5e11ef4c79897d7c513ab8ad4e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:12.032936 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-713bed55-dca2-4c97-b627-08bc99617046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e830ed5e11ef4c79897d7c513ab8ad4e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:12.041471 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-713bed55-dca2-4c97-b627-08bc99617046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e830ed5e11ef4c79897d7c513ab8ad4e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:12.042329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-713bed55-dca2-4c97-b627-08bc99617046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e830ed5e11ef4c79897d7c513ab8ad4e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:12.051299 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-713bed55-dca2-4c97-b627-08bc99617046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e830ed5e11ef4c79897d7c513ab8ad4e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:12.058490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1308/2634] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:39:11 2022] DELETE /identity/v3/users/e830ed5e11ef4c79897d7c513ab8ad4e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:39:12.063709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a325923-7d59-4e9c-b771-802fd1b77908 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:12.064305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a325923-7d59-4e9c-b771-802fd1b77908 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:12.064305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a325923-7d59-4e9c-b771-802fd1b77908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:12.114639 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7a325923-7d59-4e9c-b771-802fd1b77908 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:12.115766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7a325923-7d59-4e9c-b771-802fd1b77908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:12.170309 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:12.181351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1327/2635] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:12.192610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bed55-dca2-4c97-b627-08bc99617046 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:12.194039 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-713bed55-dca2-4c97-b627-08bc99617046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:12.265835 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bed55-dca2-4c97-b627-08bc99617046 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:12.269849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999af84-885f-43fe-9493-ce3d48a9adfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:12.270542 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999af84-885f-43fe-9493-ce3d48a9adfb service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:12.270822 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999af84-885f-43fe-9493-ce3d48a9adfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:12.271121 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999af84-885f-43fe-9493-ce3d48a9adfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:12.282732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999af84-885f-43fe-9493-ce3d48a9adfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:12.284288 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999af84-885f-43fe-9493-ce3d48a9adfb service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:12.298583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1309/2636] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:12.629390 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a325923-7d59-4e9c-b771-802fd1b77908 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:12.630720 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7a325923-7d59-4e9c-b771-802fd1b77908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:12.644437 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a325923-7d59-4e9c-b771-802fd1b77908 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:12.650808 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:12.651519 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:12.651913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:12.652027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4 admin admin] PATH_INFO: `/v3/projects/726bf5189db44c1083b38158840250d3` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:12.653295 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=726bf5189db44c1083b38158840250d3)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:12.655428 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:12.707902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726bf5189db44c1083b38158840250d3', 'request_id': 'req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:12.714722 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726bf5189db44c1083b38158840250d3', 'request_id': 'req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:12.724087 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726bf5189db44c1083b38158840250d3', 'request_id': 'req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:12.735339 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4 admin admin] The token cache is being invalidate because project 726bf5189db44c1083b38158840250d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:39:12.735655 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:12.736275 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:12.738029 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1328/2637] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:39:12 2022] DELETE /identity/v3/projects/726bf5189db44c1083b38158840250d3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:12.742434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999af84-885f-43fe-9493-ce3d48a9adfb service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:12.753336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999af84-885f-43fe-9493-ce3d48a9adfb service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:12.821466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5be1c-cda5-49b9-b00a-c4d8c6767dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:12.822176 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5be1c-cda5-49b9-b00a-c4d8c6767dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:12.822455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5be1c-cda5-49b9-b00a-c4d8c6767dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:12.822726 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5be1c-cda5-49b9-b00a-c4d8c6767dff admin admin] PATH_INFO: `/v3/users/3a06f70c43f54af980eba69fbc8c458c` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:12.823918 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5be1c-cda5-49b9-b00a-c4d8c6767dff admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a06f70c43f54af980eba69fbc8c458c)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:12.826056 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5be1c-cda5-49b9-b00a-c4d8c6767dff admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:12.850798 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:12.880684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-03d5be1c-cda5-49b9-b00a-c4d8c6767dff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a06f70c43f54af980eba69fbc8c458c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:12.893695 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-03d5be1c-cda5-49b9-b00a-c4d8c6767dff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a06f70c43f54af980eba69fbc8c458c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:12.901675 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-03d5be1c-cda5-49b9-b00a-c4d8c6767dff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a06f70c43f54af980eba69fbc8c458c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:12.902463 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-03d5be1c-cda5-49b9-b00a-c4d8c6767dff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a06f70c43f54af980eba69fbc8c458c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:12.911702 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-03d5be1c-cda5-49b9-b00a-c4d8c6767dff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a06f70c43f54af980eba69fbc8c458c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:12.918931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1310/2638] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:39:12 2022] DELETE /identity/v3/users/3a06f70c43f54af980eba69fbc8c458c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:13.227137 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:13.229019 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:13.244996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502a24c-ab63-4a12-ab53-2f99ca11e8a4 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:13.314205 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00355a-4853-4135-b50d-0b700e18955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:13.314862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00355a-4853-4135-b50d-0b700e18955e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:13.315134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00355a-4853-4135-b50d-0b700e18955e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:13.315426 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00355a-4853-4135-b50d-0b700e18955e admin admin] PATH_INFO: `/v3/projects/57d47a66a1264312a19cbc7c5cac77dc` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:13.317026 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00355a-4853-4135-b50d-0b700e18955e admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d47a66a1264312a19cbc7c5cac77dc)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:13.318991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00355a-4853-4135-b50d-0b700e18955e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:13.375123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-cc00355a-4853-4135-b50d-0b700e18955e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d47a66a1264312a19cbc7c5cac77dc', 'request_id': 'req-cc00355a-4853-4135-b50d-0b700e18955e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:13.382594 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-cc00355a-4853-4135-b50d-0b700e18955e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d47a66a1264312a19cbc7c5cac77dc', 'request_id': 'req-cc00355a-4853-4135-b50d-0b700e18955e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:13.393803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-cc00355a-4853-4135-b50d-0b700e18955e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d47a66a1264312a19cbc7c5cac77dc', 'request_id': 'req-cc00355a-4853-4135-b50d-0b700e18955e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:13.406691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-cc00355a-4853-4135-b50d-0b700e18955e admin admin] The token cache is being invalidate because project 57d47a66a1264312a19cbc7c5cac77dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:39:13.406947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-cc00355a-4853-4135-b50d-0b700e18955e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:13.407572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-cc00355a-4853-4135-b50d-0b700e18955e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:13.409115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1329/2639] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:39:13 2022] DELETE /identity/v3/projects/57d47a66a1264312a19cbc7c5cac77dc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:13.416331 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f17ba-7510-4eab-9b9e-8e5471c7fb49 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:13.416830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f17ba-7510-4eab-9b9e-8e5471c7fb49 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:13.417316 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f17ba-7510-4eab-9b9e-8e5471c7fb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:13.506222 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f45f17ba-7510-4eab-9b9e-8e5471c7fb49 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:13.508321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f45f17ba-7510-4eab-9b9e-8e5471c7fb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:13.574877 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1311/2640] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:13.583447 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895894cc-ba0e-4809-851d-a2aa80d2cd66 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:13.583745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895894cc-ba0e-4809-851d-a2aa80d2cd66 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:13.584021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895894cc-ba0e-4809-851d-a2aa80d2cd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:13.606092 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-895894cc-ba0e-4809-851d-a2aa80d2cd66 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:13.607470 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-895894cc-ba0e-4809-851d-a2aa80d2cd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:13.615515 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1330/2641] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:13.620081 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f17ba-7510-4eab-9b9e-8e5471c7fb49 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:13.632043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f17ba-7510-4eab-9b9e-8e5471c7fb49 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:13.636804 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8430fd-1f84-4835-9a93-f1a7b3f9af4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:13.637479 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8430fd-1f84-4835-9a93-f1a7b3f9af4b admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:13.637752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8430fd-1f84-4835-9a93-f1a7b3f9af4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:13.638017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8430fd-1f84-4835-9a93-f1a7b3f9af4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:13.638675 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8430fd-1f84-4835-9a93-f1a7b3f9af4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:39:13.638971 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8430fd-1f84-4835-9a93-f1a7b3f9af4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:13.640610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8430fd-1f84-4835-9a93-f1a7b3f9af4b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:13.653951 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1312/2642] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:39:13.659080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895894cc-ba0e-4809-851d-a2aa80d2cd66 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:13.665230 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:13.669378 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895894cc-ba0e-4809-851d-a2aa80d2cd66 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:13.675626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d47a1-cb6f-4f0c-988a-0509a0d29263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:13.677191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d47a1-cb6f-4f0c-988a-0509a0d29263 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:13.677672 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d47a1-cb6f-4f0c-988a-0509a0d29263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:13.677982 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d47a1-cb6f-4f0c-988a-0509a0d29263 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:13.679049 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d47a1-cb6f-4f0c-988a-0509a0d29263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:13.681469 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d47a1-cb6f-4f0c-988a-0509a0d29263 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:13.717394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1331/2643] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:13 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:13.722311 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8430fd-1f84-4835-9a93-f1a7b3f9af4b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:13.733215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8430fd-1f84-4835-9a93-f1a7b3f9af4b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:13.801501 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e171c4-74d4-4c30-8d18-9dcd341eabc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:13.802717 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e171c4-74d4-4c30-8d18-9dcd341eabc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:13.803540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e171c4-74d4-4c30-8d18-9dcd341eabc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:13.804027 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e171c4-74d4-4c30-8d18-9dcd341eabc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:13.805215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e171c4-74d4-4c30-8d18-9dcd341eabc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:13.808313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e171c4-74d4-4c30-8d18-9dcd341eabc7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:13.826714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:13.849803 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1313/2644] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:13 2022] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:13.854641 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d47a1-cb6f-4f0c-988a-0509a0d29263 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:13.866050 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d47a1-cb6f-4f0c-988a-0509a0d29263 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:13.871136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3591e8-9507-4cce-9a9d-90b960a96817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:13.871764 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3591e8-9507-4cce-9a9d-90b960a96817 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:13.872076 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3591e8-9507-4cce-9a9d-90b960a96817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:13.872343 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3591e8-9507-4cce-9a9d-90b960a96817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:13.872998 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3591e8-9507-4cce-9a9d-90b960a96817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:13.874684 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3591e8-9507-4cce-9a9d-90b960a96817 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:13.887408 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1332/2645] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:39:13.892040 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e171c4-74d4-4c30-8d18-9dcd341eabc7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:13.904105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e171c4-74d4-4c30-8d18-9dcd341eabc7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:13.909453 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32521b53-af05-49c9-af65-750ab029bed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:13.910004 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521b53-af05-49c9-af65-750ab029bed7 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:13.910285 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521b53-af05-49c9-af65-750ab029bed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:13.910546 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521b53-af05-49c9-af65-750ab029bed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:13.911204 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32521b53-af05-49c9-af65-750ab029bed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:13.912974 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32521b53-af05-49c9-af65-750ab029bed7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:13.925459 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1314/2646] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:13.930480 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3591e8-9507-4cce-9a9d-90b960a96817 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:13.941493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3591e8-9507-4cce-9a9d-90b960a96817 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:13.947844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1107eb0-5e79-4153-bdc8-f95810b71048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:13.948539 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1107eb0-5e79-4153-bdc8-f95810b71048 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:13.948834 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1107eb0-5e79-4153-bdc8-f95810b71048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:13.949075 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1107eb0-5e79-4153-bdc8-f95810b71048 admin admin] PATH_INFO: `/v3/projects/a5c03e78799f4fb6a852ca3e2df233f3/users/e20aaf2aef7546e0acc58bf15e50aa74/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:13.966985 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1107eb0-5e79-4153-bdc8-f95810b71048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c03e78799f4fb6a852ca3e2df233f3, user_id=e20aaf2aef7546e0acc58bf15e50aa74, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:13.969779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1107eb0-5e79-4153-bdc8-f95810b71048 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:13.986088 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1333/2647] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:13 2022] PUT /identity/v3/projects/a5c03e78799f4fb6a852ca3e2df233f3/users/e20aaf2aef7546e0acc58bf15e50aa74/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:13.997767 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4d645-9755-4cc0-83e2-552b53accbf4 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:13.998064 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4d645-9755-4cc0-83e2-552b53accbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:13.998338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4d645-9755-4cc0-83e2-552b53accbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:14.031108 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-85b4d645-9755-4cc0-83e2-552b53accbf4 None None] MFA Rules not processed for user `e20aaf2aef7546e0acc58bf15e50aa74`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:14.032341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-85b4d645-9755-4cc0-83e2-552b53accbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:14.110595 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1315/2648] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:14.124710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1107eb0-5e79-4153-bdc8-f95810b71048 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:14.126997 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a1107eb0-5e79-4153-bdc8-f95810b71048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:14.192740 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1107eb0-5e79-4153-bdc8-f95810b71048 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:14.196505 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb06806-ffd4-40c6-b8f0-6732923de282 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47429aec6d8a4339b4ec0fb32b25e90b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:14.197119 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb06806-ffd4-40c6-b8f0-6732923de282 service glance] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:14.197426 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb06806-ffd4-40c6-b8f0-6732923de282 service glance] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:14.197668 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb06806-ffd4-40c6-b8f0-6732923de282 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:14.207345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb06806-ffd4-40c6-b8f0-6732923de282 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:14.208886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb06806-ffd4-40c6-b8f0-6732923de282 service glance] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:14.218944 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1334/2649] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:24.107601 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:INSERT=1,keystone:SELECT=39 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:24.214333 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=48,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:29.638288 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86a4a-f673-4010-8163-effd83789adf None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:29.639315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86a4a-f673-4010-8163-effd83789adf None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:29.639742 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86a4a-f673-4010-8163-effd83789adf None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:29.641905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1316/2650] 10.222.0.52 () {54 vars in 961 bytes} [Mon Aug 29 20:39:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:39:29.655549 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47a6ae-ed27-49fa-970c-03ad678a354c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:29.656465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47a6ae-ed27-49fa-970c-03ad678a354c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:29.656761 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47a6ae-ed27-49fa-970c-03ad678a354c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:29.761699 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-fe47a6ae-ed27-49fa-970c-03ad678a354c None None] MFA Rules not processed for user `b8295272eec349f8aa38e44c861faa47`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:29.763240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fe47a6ae-ed27-49fa-970c-03ad678a354c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:29.880405 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1335/2651] 10.222.0.52 () {58 vars in 1058 bytes} [Mon Aug 29 20:39:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:29.889171 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c86a4a-f673-4010-8163-effd83789adf None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:29.916304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c86a4a-f673-4010-8163-effd83789adf None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:29.925327 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332f8a3-af00-429f-bdd4-2e7b289302ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8295272eec349f8aa38e44c861faa47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:29.926012 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332f8a3-af00-429f-bdd4-2e7b289302ed service placement] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:29.926292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332f8a3-af00-429f-bdd4-2e7b289302ed service placement] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:29.926592 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332f8a3-af00-429f-bdd4-2e7b289302ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:29.928799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e332f8a3-af00-429f-bdd4-2e7b289302ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:29.943774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332f8a3-af00-429f-bdd4-2e7b289302ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:29.945448 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332f8a3-af00-429f-bdd4-2e7b289302ed service placement] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:29.958178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1317/2652] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:30.000277 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47a6ae-ed27-49fa-970c-03ad678a354c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:30.134428 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47a6ae-ed27-49fa-970c-03ad678a354c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:30.146738 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125061d2-1ff3-4a24-89f1-2f97c4b1365c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:30.147822 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125061d2-1ff3-4a24-89f1-2f97c4b1365c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:30.148255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125061d2-1ff3-4a24-89f1-2f97c4b1365c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:30.148804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125061d2-1ff3-4a24-89f1-2f97c4b1365c admin admin] PATH_INFO: `/v3/users/e20aaf2aef7546e0acc58bf15e50aa74` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:30.150752 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125061d2-1ff3-4a24-89f1-2f97c4b1365c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e20aaf2aef7546e0acc58bf15e50aa74)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:30.153351 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125061d2-1ff3-4a24-89f1-2f97c4b1365c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:30.236122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-125061d2-1ff3-4a24-89f1-2f97c4b1365c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e20aaf2aef7546e0acc58bf15e50aa74'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:30.246087 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-125061d2-1ff3-4a24-89f1-2f97c4b1365c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e20aaf2aef7546e0acc58bf15e50aa74'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:30.248967 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:30.267317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-125061d2-1ff3-4a24-89f1-2f97c4b1365c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e20aaf2aef7546e0acc58bf15e50aa74'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:30.268542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-125061d2-1ff3-4a24-89f1-2f97c4b1365c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e20aaf2aef7546e0acc58bf15e50aa74'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:30.269530 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-125061d2-1ff3-4a24-89f1-2f97c4b1365c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e20aaf2aef7546e0acc58bf15e50aa74'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:30.298288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1336/2653] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:39:29 2022] DELETE /identity/v3/users/e20aaf2aef7546e0acc58bf15e50aa74 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:39:30.304069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4c384-3a12-4301-9b7b-2227d5a35c53 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:30.304069 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4c384-3a12-4301-9b7b-2227d5a35c53 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:30.304430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4c384-3a12-4301-9b7b-2227d5a35c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:30.326515 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-04e4c384-3a12-4301-9b7b-2227d5a35c53 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:30.328129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-04e4c384-3a12-4301-9b7b-2227d5a35c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:30.422198 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1318/2654] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:30.433398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125061d2-1ff3-4a24-89f1-2f97c4b1365c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:30.436256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-125061d2-1ff3-4a24-89f1-2f97c4b1365c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:30.541159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125061d2-1ff3-4a24-89f1-2f97c4b1365c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:30.547042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7b7f5-fa93-4375-b97e-50c57cb83992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:30.548109 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7b7f5-fa93-4375-b97e-50c57cb83992 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:30.548649 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7b7f5-fa93-4375-b97e-50c57cb83992 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:30.549315 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7b7f5-fa93-4375-b97e-50c57cb83992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:30.561765 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7b7f5-fa93-4375-b97e-50c57cb83992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:30.563285 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7b7f5-fa93-4375-b97e-50c57cb83992 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:30.580693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1337/2655] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:31.122858 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4c384-3a12-4301-9b7b-2227d5a35c53 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:31.125063 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-04e4c384-3a12-4301-9b7b-2227d5a35c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:31.139145 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4c384-3a12-4301-9b7b-2227d5a35c53 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:31.146131 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652259d-44c7-4f9f-8df3-ceab7a7c8ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:31.146961 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652259d-44c7-4f9f-8df3-ceab7a7c8ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:31.147448 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652259d-44c7-4f9f-8df3-ceab7a7c8ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:31.147894 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652259d-44c7-4f9f-8df3-ceab7a7c8ac0 admin admin] PATH_INFO: `/v3/projects/a5c03e78799f4fb6a852ca3e2df233f3` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:31.149568 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652259d-44c7-4f9f-8df3-ceab7a7c8ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5c03e78799f4fb6a852ca3e2df233f3)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:31.151602 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652259d-44c7-4f9f-8df3-ceab7a7c8ac0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:31.242391 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3652259d-44c7-4f9f-8df3-ceab7a7c8ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5c03e78799f4fb6a852ca3e2df233f3', 'request_id': 'req-3652259d-44c7-4f9f-8df3-ceab7a7c8ac0'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:31.264039 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3652259d-44c7-4f9f-8df3-ceab7a7c8ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5c03e78799f4fb6a852ca3e2df233f3', 'request_id': 'req-3652259d-44c7-4f9f-8df3-ceab7a7c8ac0'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:31.273786 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3652259d-44c7-4f9f-8df3-ceab7a7c8ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5c03e78799f4fb6a852ca3e2df233f3', 'request_id': 'req-3652259d-44c7-4f9f-8df3-ceab7a7c8ac0'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:31.290940 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3652259d-44c7-4f9f-8df3-ceab7a7c8ac0 admin admin] The token cache is being invalidate because project a5c03e78799f4fb6a852ca3e2df233f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:39:31.291384 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3652259d-44c7-4f9f-8df3-ceab7a7c8ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:31.292206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3652259d-44c7-4f9f-8df3-ceab7a7c8ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:31.294297 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1319/2656] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:39:31 2022] DELETE /identity/v3/projects/a5c03e78799f4fb6a852ca3e2df233f3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:39:31.306166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103fd2e-e99d-41b8-accc-bfeab1381549 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:31.306166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103fd2e-e99d-41b8-accc-bfeab1381549 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:31.306166 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103fd2e-e99d-41b8-accc-bfeab1381549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:31.337686 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2103fd2e-e99d-41b8-accc-bfeab1381549 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:31.339723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2103fd2e-e99d-41b8-accc-bfeab1381549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:31.485413 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1338/2657] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:31.493778 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db8327-f24f-4000-b1e1-680a9c8417bf None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:31.494062 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db8327-f24f-4000-b1e1-680a9c8417bf None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:31.494353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db8327-f24f-4000-b1e1-680a9c8417bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:31.522946 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-48db8327-f24f-4000-b1e1-680a9c8417bf None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:31.525243 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-48db8327-f24f-4000-b1e1-680a9c8417bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:31.543430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1320/2658] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:39:31.549183 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103fd2e-e99d-41b8-accc-bfeab1381549 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:31.560871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103fd2e-e99d-41b8-accc-bfeab1381549 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:31.566117 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da86e2c-eca1-482f-8392-6f53003ef555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:31.566757 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da86e2c-eca1-482f-8392-6f53003ef555 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:31.567065 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da86e2c-eca1-482f-8392-6f53003ef555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:31.567396 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da86e2c-eca1-482f-8392-6f53003ef555 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:31.568109 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da86e2c-eca1-482f-8392-6f53003ef555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:39:31.568441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da86e2c-eca1-482f-8392-6f53003ef555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:31.570175 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da86e2c-eca1-482f-8392-6f53003ef555 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:31.583759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1339/2659] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:39:31.589497 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db8327-f24f-4000-b1e1-680a9c8417bf None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:31.602371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db8327-f24f-4000-b1e1-680a9c8417bf None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:31.609873 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9231043-90ef-4e8b-aa53-63d62254d405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:31.610475 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9231043-90ef-4e8b-aa53-63d62254d405 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:31.610777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9231043-90ef-4e8b-aa53-63d62254d405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:31.611049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9231043-90ef-4e8b-aa53-63d62254d405 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:31.611747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9231043-90ef-4e8b-aa53-63d62254d405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:31.613891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9231043-90ef-4e8b-aa53-63d62254d405 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:31.654917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1321/2660] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:31 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:39:31.660185 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da86e2c-eca1-482f-8392-6f53003ef555 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:31.679869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da86e2c-eca1-482f-8392-6f53003ef555 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:31.764312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:31.796770 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e042350-6272-4bbe-8308-ed58f915e9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:31.797836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e042350-6272-4bbe-8308-ed58f915e9a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:31.798317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e042350-6272-4bbe-8308-ed58f915e9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:31.798797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e042350-6272-4bbe-8308-ed58f915e9a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:31.799961 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e042350-6272-4bbe-8308-ed58f915e9a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:31.804299 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e042350-6272-4bbe-8308-ed58f915e9a8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:31.846380 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1340/2661] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:31 2022] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:39:31.851961 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9231043-90ef-4e8b-aa53-63d62254d405 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:31.868869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9231043-90ef-4e8b-aa53-63d62254d405 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:31.876965 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252ee80-ad9b-4af5-a356-d7a8c4bbb3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:31.878420 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252ee80-ad9b-4af5-a356-d7a8c4bbb3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:31.879011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252ee80-ad9b-4af5-a356-d7a8c4bbb3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:31.879548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252ee80-ad9b-4af5-a356-d7a8c4bbb3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:31.880800 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252ee80-ad9b-4af5-a356-d7a8c4bbb3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:31.884385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252ee80-ad9b-4af5-a356-d7a8c4bbb3f8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:31.910487 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1322/2662] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:31.916196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e042350-6272-4bbe-8308-ed58f915e9a8 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:31.937565 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e042350-6272-4bbe-8308-ed58f915e9a8 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:31.946701 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6818d-9f2d-4f82-bfe2-0dc635dfa784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:31.948152 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6818d-9f2d-4f82-bfe2-0dc635dfa784 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:31.948903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6818d-9f2d-4f82-bfe2-0dc635dfa784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:31.949095 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6818d-9f2d-4f82-bfe2-0dc635dfa784 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:31.950355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6818d-9f2d-4f82-bfe2-0dc635dfa784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:31.953629 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6818d-9f2d-4f82-bfe2-0dc635dfa784 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:31.975437 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1341/2663] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:39:31.981113 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252ee80-ad9b-4af5-a356-d7a8c4bbb3f8 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:31.992777 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252ee80-ad9b-4af5-a356-d7a8c4bbb3f8 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:32.000926 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98545b1-21cd-4a30-a152-4c039c368843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:32.001824 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98545b1-21cd-4a30-a152-4c039c368843 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:32.002173 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98545b1-21cd-4a30-a152-4c039c368843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:32.002447 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98545b1-21cd-4a30-a152-4c039c368843 admin admin] PATH_INFO: `/v3/projects/f762db002ce844989bafccc47aced2df/users/33757e7e126640d9b6f680fc74129171/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:32.020508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98545b1-21cd-4a30-a152-4c039c368843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f762db002ce844989bafccc47aced2df, user_id=33757e7e126640d9b6f680fc74129171, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:32.023286 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98545b1-21cd-4a30-a152-4c039c368843 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:32.041647 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1323/2664] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:31 2022] PUT /identity/v3/projects/f762db002ce844989bafccc47aced2df/users/33757e7e126640d9b6f680fc74129171/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:39:32.055286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37a801-6bba-47bb-ae8c-bfa54fd94260 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:32.055286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37a801-6bba-47bb-ae8c-bfa54fd94260 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:32.055286 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37a801-6bba-47bb-ae8c-bfa54fd94260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:32.086477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3d37a801-6bba-47bb-ae8c-bfa54fd94260 None None] MFA Rules not processed for user `33757e7e126640d9b6f680fc74129171`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:32.087734 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3d37a801-6bba-47bb-ae8c-bfa54fd94260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:32.187502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1342/2665] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:32.203812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98545b1-21cd-4a30-a152-4c039c368843 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:32.206351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b98545b1-21cd-4a30-a152-4c039c368843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:32.219360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:32.375075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98545b1-21cd-4a30-a152-4c039c368843 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:32.384518 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f70883-b9a3-4d64-9538-5410d2e00b2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:32.385641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f70883-b9a3-4d64-9538-5410d2e00b2b service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:32.386157 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f70883-b9a3-4d64-9538-5410d2e00b2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:32.386345 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f70883-b9a3-4d64-9538-5410d2e00b2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:32.407321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f70883-b9a3-4d64-9538-5410d2e00b2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:32.412225 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f70883-b9a3-4d64-9538-5410d2e00b2b service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:32.425440 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1324/2666] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:39:35.102200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37a801-6bba-47bb-ae8c-bfa54fd94260 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:35.103877 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3d37a801-6bba-47bb-ae8c-bfa54fd94260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:35.183245 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37a801-6bba-47bb-ae8c-bfa54fd94260 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:35.187315 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb5556-2e48-4686-ad9d-ad6d563e7dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:35.188001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb5556-2e48-4686-ad9d-ad6d563e7dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:35.188338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb5556-2e48-4686-ad9d-ad6d563e7dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:35.188664 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb5556-2e48-4686-ad9d-ad6d563e7dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:35.191244 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-12fb5556-2e48-4686-ad9d-ad6d563e7dc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:35.288134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb5556-2e48-4686-ad9d-ad6d563e7dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:35.289964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb5556-2e48-4686-ad9d-ad6d563e7dc5 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:35.306160 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1343/2667] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:39.698907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f70883-b9a3-4d64-9538-5410d2e00b2b service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:39.701076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-08f70883-b9a3-4d64-9538-5410d2e00b2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:39.720714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f70883-b9a3-4d64-9538-5410d2e00b2b service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:39.730311 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947f4c1-52a8-49cb-bb30-e272a178ad0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:39.731108 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947f4c1-52a8-49cb-bb30-e272a178ad0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:39.731385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947f4c1-52a8-49cb-bb30-e272a178ad0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:39.731654 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947f4c1-52a8-49cb-bb30-e272a178ad0a admin admin] PATH_INFO: `/v3/users/3340cc123b0d4ff089889b133b32815e` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:39.732965 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947f4c1-52a8-49cb-bb30-e272a178ad0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3340cc123b0d4ff089889b133b32815e)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:39.734938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947f4c1-52a8-49cb-bb30-e272a178ad0a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:39.796767 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c947f4c1-52a8-49cb-bb30-e272a178ad0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3340cc123b0d4ff089889b133b32815e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:39.820483 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c947f4c1-52a8-49cb-bb30-e272a178ad0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3340cc123b0d4ff089889b133b32815e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:39.835585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c947f4c1-52a8-49cb-bb30-e272a178ad0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3340cc123b0d4ff089889b133b32815e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:39.836793 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c947f4c1-52a8-49cb-bb30-e272a178ad0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3340cc123b0d4ff089889b133b32815e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:39.860287 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c947f4c1-52a8-49cb-bb30-e272a178ad0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3340cc123b0d4ff089889b133b32815e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:39.868302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1325/2668] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:39:39 2022] DELETE /identity/v3/users/3340cc123b0d4ff089889b133b32815e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:40.116960 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb5556-2e48-4686-ad9d-ad6d563e7dc5 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:40.125716 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:40.146768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb5556-2e48-4686-ad9d-ad6d563e7dc5 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:40.257154 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec94e6-fa34-43b5-8d43-8ab59af68741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:40.258238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec94e6-fa34-43b5-8d43-8ab59af68741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:40.258609 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec94e6-fa34-43b5-8d43-8ab59af68741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:40.258999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec94e6-fa34-43b5-8d43-8ab59af68741 admin admin] PATH_INFO: `/v3/projects/9906f5bb9cbe468bae0cdbf351832c3a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:40.260680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec94e6-fa34-43b5-8d43-8ab59af68741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9906f5bb9cbe468bae0cdbf351832c3a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:40.262910 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec94e6-fa34-43b5-8d43-8ab59af68741 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:40.328210 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-15ec94e6-fa34-43b5-8d43-8ab59af68741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9906f5bb9cbe468bae0cdbf351832c3a', 'request_id': 'req-15ec94e6-fa34-43b5-8d43-8ab59af68741'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:40.337018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-15ec94e6-fa34-43b5-8d43-8ab59af68741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9906f5bb9cbe468bae0cdbf351832c3a', 'request_id': 'req-15ec94e6-fa34-43b5-8d43-8ab59af68741'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:40.347863 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-15ec94e6-fa34-43b5-8d43-8ab59af68741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9906f5bb9cbe468bae0cdbf351832c3a', 'request_id': 'req-15ec94e6-fa34-43b5-8d43-8ab59af68741'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:40.364955 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-15ec94e6-fa34-43b5-8d43-8ab59af68741 admin admin] The token cache is being invalidate because project 9906f5bb9cbe468bae0cdbf351832c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:39:40.365313 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-15ec94e6-fa34-43b5-8d43-8ab59af68741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:40.366094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-15ec94e6-fa34-43b5-8d43-8ab59af68741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:40.368044 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1344/2669] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:39:40 2022] DELETE /identity/v3/projects/9906f5bb9cbe468bae0cdbf351832c3a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:40.375017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4574d0-17a0-4cea-9ffa-0098b122da36 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:40.375704 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4574d0-17a0-4cea-9ffa-0098b122da36 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:40.376034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4574d0-17a0-4cea-9ffa-0098b122da36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:40.403251 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6a4574d0-17a0-4cea-9ffa-0098b122da36 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:40.405569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6a4574d0-17a0-4cea-9ffa-0098b122da36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:40.491091 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1326/2670] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:40.499730 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ff567-54b4-4a0a-900c-b0b6f152f46f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:40.500118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ff567-54b4-4a0a-900c-b0b6f152f46f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:40.500443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ff567-54b4-4a0a-900c-b0b6f152f46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:40.524355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2c5ff567-54b4-4a0a-900c-b0b6f152f46f None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:40.526211 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2c5ff567-54b4-4a0a-900c-b0b6f152f46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:40.537003 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1345/2671] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:40.542050 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4574d0-17a0-4cea-9ffa-0098b122da36 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:40.547586 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:40.556938 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4574d0-17a0-4cea-9ffa-0098b122da36 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:40.565240 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd8b03-36a9-4d6f-bb7a-2768f61211e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:40.566311 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd8b03-36a9-4d6f-bb7a-2768f61211e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:40.566816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd8b03-36a9-4d6f-bb7a-2768f61211e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:40.567297 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd8b03-36a9-4d6f-bb7a-2768f61211e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:40.568530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd8b03-36a9-4d6f-bb7a-2768f61211e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:39:40.569076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd8b03-36a9-4d6f-bb7a-2768f61211e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:40.572050 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd8b03-36a9-4d6f-bb7a-2768f61211e8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:40.596065 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1327/2672] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:39:40.597590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ff567-54b4-4a0a-900c-b0b6f152f46f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:40.611659 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ff567-54b4-4a0a-900c-b0b6f152f46f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:40.618518 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587b148-6fb7-4177-b138-0699c2f2683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:40.619421 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587b148-6fb7-4177-b138-0699c2f2683e admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:40.619817 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587b148-6fb7-4177-b138-0699c2f2683e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:40.620197 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587b148-6fb7-4177-b138-0699c2f2683e admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:40.621204 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587b148-6fb7-4177-b138-0699c2f2683e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:40.624458 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587b148-6fb7-4177-b138-0699c2f2683e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:40.667812 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1346/2673] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:40 2022] POST /identity/v3/projects => generated 403 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:39:40.674009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd8b03-36a9-4d6f-bb7a-2768f61211e8 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:40.691380 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd8b03-36a9-4d6f-bb7a-2768f61211e8 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:40.775762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98127c78-662f-4297-81d1-a68ba72fd9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:40.776830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98127c78-662f-4297-81d1-a68ba72fd9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:40.777330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98127c78-662f-4297-81d1-a68ba72fd9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:40.777868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98127c78-662f-4297-81d1-a68ba72fd9f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:40.779064 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98127c78-662f-4297-81d1-a68ba72fd9f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:40.782680 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98127c78-662f-4297-81d1-a68ba72fd9f7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:40.813283 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1328/2674] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:40 2022] POST /identity/v3/users => generated 302 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:40.817518 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587b148-6fb7-4177-b138-0699c2f2683e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:40.832336 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587b148-6fb7-4177-b138-0699c2f2683e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:40.839992 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45593af-81a4-4427-a3c2-c291bd6d564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:40.840732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45593af-81a4-4427-a3c2-c291bd6d564c admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:40.841151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45593af-81a4-4427-a3c2-c291bd6d564c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:40.841537 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45593af-81a4-4427-a3c2-c291bd6d564c admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:40.842234 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45593af-81a4-4427-a3c2-c291bd6d564c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:40.843908 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45593af-81a4-4427-a3c2-c291bd6d564c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:40.855849 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1347/2675] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:40.860629 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98127c78-662f-4297-81d1-a68ba72fd9f7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:40.871790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98127c78-662f-4297-81d1-a68ba72fd9f7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:40.876979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bcba8-a0fb-4867-a143-2f71dd2eda96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:40.877639 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bcba8-a0fb-4867-a143-2f71dd2eda96 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:40.877918 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bcba8-a0fb-4867-a143-2f71dd2eda96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:40.878189 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bcba8-a0fb-4867-a143-2f71dd2eda96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:40.878857 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bcba8-a0fb-4867-a143-2f71dd2eda96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:40.880611 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bcba8-a0fb-4867-a143-2f71dd2eda96 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:40.894229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1329/2676] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:40.899730 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45593af-81a4-4427-a3c2-c291bd6d564c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:40.913940 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45593af-81a4-4427-a3c2-c291bd6d564c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:40.919360 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3402a9-70d3-46e5-9e8b-14238c33160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:40.921296 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3402a9-70d3-46e5-9e8b-14238c33160b admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:40.921296 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3402a9-70d3-46e5-9e8b-14238c33160b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:40.921296 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3402a9-70d3-46e5-9e8b-14238c33160b admin admin] PATH_INFO: `/v3/projects/bdb5763874a44ab9a9dba4827d01dda1/users/b2f4b82f86ff4191ad4260f3e2673f2c/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:40.941425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3402a9-70d3-46e5-9e8b-14238c33160b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb5763874a44ab9a9dba4827d01dda1, user_id=b2f4b82f86ff4191ad4260f3e2673f2c, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:40.944356 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3402a9-70d3-46e5-9e8b-14238c33160b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:40.961692 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1348/2677] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:40 2022] PUT /identity/v3/projects/bdb5763874a44ab9a9dba4827d01dda1/users/b2f4b82f86ff4191ad4260f3e2673f2c/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:40.980133 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ecd0e-8deb-4569-a406-8fef1df5ca8d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:40.980543 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ecd0e-8deb-4569-a406-8fef1df5ca8d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:40.980927 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ecd0e-8deb-4569-a406-8fef1df5ca8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:41.022392 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-735ecd0e-8deb-4569-a406-8fef1df5ca8d None None] MFA Rules not processed for user `b2f4b82f86ff4191ad4260f3e2673f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:41.023644 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-735ecd0e-8deb-4569-a406-8fef1df5ca8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:41.127089 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1330/2678] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:40 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:41.132339 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3402a9-70d3-46e5-9e8b-14238c33160b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:41.178912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:41.222174 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3402a9-70d3-46e5-9e8b-14238c33160b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:41.228851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313b1dd-0002-4d01-9242-7deebcc84cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:41.230067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313b1dd-0002-4d01-9242-7deebcc84cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:41.230650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313b1dd-0002-4d01-9242-7deebcc84cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:41.231231 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313b1dd-0002-4d01-9242-7deebcc84cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:41.232484 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313b1dd-0002-4d01-9242-7deebcc84cb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:41.236217 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313b1dd-0002-4d01-9242-7deebcc84cb0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:41.294686 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1349/2679] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:41 2022] POST /identity/v3/projects => generated 403 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:41.300005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ecd0e-8deb-4569-a406-8fef1df5ca8d None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:41.319202 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ecd0e-8deb-4569-a406-8fef1df5ca8d None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:41.411836 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:41.423353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0e4f9-59ae-43be-8db7-ed256611d926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:41.424336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0e4f9-59ae-43be-8db7-ed256611d926 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:41.424727 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0e4f9-59ae-43be-8db7-ed256611d926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:41.425081 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0e4f9-59ae-43be-8db7-ed256611d926 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:41.426075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0e4f9-59ae-43be-8db7-ed256611d926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:41.430258 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0e4f9-59ae-43be-8db7-ed256611d926 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:41.463103 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1331/2680] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:41 2022] POST /identity/v3/users => generated 308 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:41.467500 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313b1dd-0002-4d01-9242-7deebcc84cb0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:41.479721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313b1dd-0002-4d01-9242-7deebcc84cb0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:41.485430 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d07c4-2b3a-410d-8612-f1964c8a67cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:41.486209 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d07c4-2b3a-410d-8612-f1964c8a67cb admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:41.486488 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d07c4-2b3a-410d-8612-f1964c8a67cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:41.486762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d07c4-2b3a-410d-8612-f1964c8a67cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:41.487608 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d07c4-2b3a-410d-8612-f1964c8a67cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:41.489686 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d07c4-2b3a-410d-8612-f1964c8a67cb admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:41.506986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1350/2681] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:39:41.519020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0e4f9-59ae-43be-8db7-ed256611d926 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:41.533325 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0e4f9-59ae-43be-8db7-ed256611d926 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:41.541651 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdf22b-bf8a-4c92-8e16-325d2b6126d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:41.542693 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdf22b-bf8a-4c92-8e16-325d2b6126d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:41.543830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdf22b-bf8a-4c92-8e16-325d2b6126d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:41.543830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdf22b-bf8a-4c92-8e16-325d2b6126d4 admin admin] PATH_INFO: `/v3/projects/030a4290257348c09a8d432f15444823/users/97e495e16097411dbec9ae58d5b26bd0/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:41.566336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdf22b-bf8a-4c92-8e16-325d2b6126d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=030a4290257348c09a8d432f15444823, user_id=97e495e16097411dbec9ae58d5b26bd0, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:41.569100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdf22b-bf8a-4c92-8e16-325d2b6126d4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:41.586046 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1332/2682] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:41 2022] PUT /identity/v3/projects/030a4290257348c09a8d432f15444823/users/97e495e16097411dbec9ae58d5b26bd0/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:39:41.592109 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d07c4-2b3a-410d-8612-f1964c8a67cb admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:41.606325 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d07c4-2b3a-410d-8612-f1964c8a67cb admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:41.695256 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bf89a-e6cc-41e6-b59c-53b61bd4322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:41.696032 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bf89a-e6cc-41e6-b59c-53b61bd4322d admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:41.696414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bf89a-e6cc-41e6-b59c-53b61bd4322d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:41.696758 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bf89a-e6cc-41e6-b59c-53b61bd4322d admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:41.697582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bf89a-e6cc-41e6-b59c-53b61bd4322d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:41.700916 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bf89a-e6cc-41e6-b59c-53b61bd4322d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:41.717850 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1351/2683] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:41.723057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdf22b-bf8a-4c92-8e16-325d2b6126d4 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:41.737107 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdf22b-bf8a-4c92-8e16-325d2b6126d4 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:41.742553 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53c9d8-8484-4507-8ec0-f148342f62e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:41.743338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53c9d8-8484-4507-8ec0-f148342f62e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:41.743612 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53c9d8-8484-4507-8ec0-f148342f62e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:41.743891 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53c9d8-8484-4507-8ec0-f148342f62e5 admin admin] PATH_INFO: `/v3/projects/030a4290257348c09a8d432f15444823/users/97e495e16097411dbec9ae58d5b26bd0/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:41.746071 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53c9d8-8484-4507-8ec0-f148342f62e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=030a4290257348c09a8d432f15444823, user_id=97e495e16097411dbec9ae58d5b26bd0, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:41.749082 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53c9d8-8484-4507-8ec0-f148342f62e5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:41.762142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1333/2684] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:41 2022] PUT /identity/v3/projects/030a4290257348c09a8d432f15444823/users/97e495e16097411dbec9ae58d5b26bd0/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:41.777432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5027b-d8cf-48a4-8c52-f1f3fb46ffc6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:41.777725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5027b-d8cf-48a4-8c52-f1f3fb46ffc6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:41.778001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5027b-d8cf-48a4-8c52-f1f3fb46ffc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:41.816692 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-59c5027b-d8cf-48a4-8c52-f1f3fb46ffc6 None None] MFA Rules not processed for user `97e495e16097411dbec9ae58d5b26bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:41.818435 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-59c5027b-d8cf-48a4-8c52-f1f3fb46ffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:41.903048 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1352/2685] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:41 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:41.917434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53c9d8-8484-4507-8ec0-f148342f62e5 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:41.919745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bb53c9d8-8484-4507-8ec0-f148342f62e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:41.991061 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53c9d8-8484-4507-8ec0-f148342f62e5 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:41.996138 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35f39d-dc35-44fa-952f-ead8e3a1b1e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:41.996918 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35f39d-dc35-44fa-952f-ead8e3a1b1e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:41.997208 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35f39d-dc35-44fa-952f-ead8e3a1b1e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:41.997511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35f39d-dc35-44fa-952f-ead8e3a1b1e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:42.011517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35f39d-dc35-44fa-952f-ead8e3a1b1e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:42.013253 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35f39d-dc35-44fa-952f-ead8e3a1b1e8 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:42.027622 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1334/2686] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:41 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:42.215846 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5027b-d8cf-48a4-8c52-f1f3fb46ffc6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:42.251723 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:42.315873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5027b-d8cf-48a4-8c52-f1f3fb46ffc6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:42.322133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975ebfd-c4bb-4755-9b8e-c7e15394a034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:42.323042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975ebfd-c4bb-4755-9b8e-c7e15394a034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:42.323432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975ebfd-c4bb-4755-9b8e-c7e15394a034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:42.323709 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975ebfd-c4bb-4755-9b8e-c7e15394a034 admin admin] PATH_INFO: `/v3/users/b2f4b82f86ff4191ad4260f3e2673f2c` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:42.325417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975ebfd-c4bb-4755-9b8e-c7e15394a034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f4b82f86ff4191ad4260f3e2673f2c)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:42.327692 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975ebfd-c4bb-4755-9b8e-c7e15394a034 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:42.395241 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e975ebfd-c4bb-4755-9b8e-c7e15394a034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f4b82f86ff4191ad4260f3e2673f2c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:42.416533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e975ebfd-c4bb-4755-9b8e-c7e15394a034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f4b82f86ff4191ad4260f3e2673f2c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:42.452785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e975ebfd-c4bb-4755-9b8e-c7e15394a034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f4b82f86ff4191ad4260f3e2673f2c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:42.453682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e975ebfd-c4bb-4755-9b8e-c7e15394a034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f4b82f86ff4191ad4260f3e2673f2c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:42.454339 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e975ebfd-c4bb-4755-9b8e-c7e15394a034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f4b82f86ff4191ad4260f3e2673f2c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:42.471366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1353/2687] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:39:42 2022] DELETE /identity/v3/users/b2f4b82f86ff4191ad4260f3e2673f2c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:42.477596 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4589a-9910-41b0-999d-8059e945098a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:42.477596 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4589a-9910-41b0-999d-8059e945098a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:42.477596 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4589a-9910-41b0-999d-8059e945098a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:42.499667 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d7f4589a-9910-41b0-999d-8059e945098a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:42.501979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d7f4589a-9910-41b0-999d-8059e945098a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:42.601327 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1335/2688] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:39:42.613779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975ebfd-c4bb-4755-9b8e-c7e15394a034 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:42.616030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e975ebfd-c4bb-4755-9b8e-c7e15394a034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:42.694437 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975ebfd-c4bb-4755-9b8e-c7e15394a034 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:42.699341 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02643e1-47a8-495d-984e-f5eb4480c08e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:42.700100 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02643e1-47a8-495d-984e-f5eb4480c08e service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:42.701098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02643e1-47a8-495d-984e-f5eb4480c08e service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:42.701403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02643e1-47a8-495d-984e-f5eb4480c08e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:42.712722 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02643e1-47a8-495d-984e-f5eb4480c08e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:42.714988 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02643e1-47a8-495d-984e-f5eb4480c08e service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:42.732979 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1354/2689] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:43.094828 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4589a-9910-41b0-999d-8059e945098a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:43.096529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d7f4589a-9910-41b0-999d-8059e945098a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:43.109227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4589a-9910-41b0-999d-8059e945098a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:43.114986 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba48b8-247e-40f8-a75a-a3e42d052385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:43.115648 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba48b8-247e-40f8-a75a-a3e42d052385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:43.115923 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba48b8-247e-40f8-a75a-a3e42d052385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:43.116187 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba48b8-247e-40f8-a75a-a3e42d052385 admin admin] PATH_INFO: `/v3/projects/bdb5763874a44ab9a9dba4827d01dda1` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:43.117457 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba48b8-247e-40f8-a75a-a3e42d052385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb5763874a44ab9a9dba4827d01dda1)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:43.120215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba48b8-247e-40f8-a75a-a3e42d052385 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:43.185125 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:43.186525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0dba48b8-247e-40f8-a75a-a3e42d052385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb5763874a44ab9a9dba4827d01dda1', 'request_id': 'req-0dba48b8-247e-40f8-a75a-a3e42d052385'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.195018 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0dba48b8-247e-40f8-a75a-a3e42d052385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb5763874a44ab9a9dba4827d01dda1', 'request_id': 'req-0dba48b8-247e-40f8-a75a-a3e42d052385'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.203116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0dba48b8-247e-40f8-a75a-a3e42d052385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb5763874a44ab9a9dba4827d01dda1', 'request_id': 'req-0dba48b8-247e-40f8-a75a-a3e42d052385'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.215571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0dba48b8-247e-40f8-a75a-a3e42d052385 admin admin] The token cache is being invalidate because project bdb5763874a44ab9a9dba4827d01dda1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:39:43.215854 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0dba48b8-247e-40f8-a75a-a3e42d052385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.216551 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0dba48b8-247e-40f8-a75a-a3e42d052385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.218088 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1336/2690] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:39:43 2022] DELETE /identity/v3/projects/bdb5763874a44ab9a9dba4827d01dda1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:43.222416 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02643e1-47a8-495d-984e-f5eb4480c08e service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:43.232728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02643e1-47a8-495d-984e-f5eb4480c08e service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:43.302955 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:43.320274 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edc0a6-a29d-43b7-8a4d-b88618b70d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:43.320905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edc0a6-a29d-43b7-8a4d-b88618b70d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:43.321178 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edc0a6-a29d-43b7-8a4d-b88618b70d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:43.321491 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edc0a6-a29d-43b7-8a4d-b88618b70d7b admin admin] PATH_INFO: `/v3/users/97e495e16097411dbec9ae58d5b26bd0` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:43.322706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edc0a6-a29d-43b7-8a4d-b88618b70d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e495e16097411dbec9ae58d5b26bd0)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:43.324597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edc0a6-a29d-43b7-8a4d-b88618b70d7b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:43.378935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-91edc0a6-a29d-43b7-8a4d-b88618b70d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e495e16097411dbec9ae58d5b26bd0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.389039 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-91edc0a6-a29d-43b7-8a4d-b88618b70d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e495e16097411dbec9ae58d5b26bd0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.402359 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-91edc0a6-a29d-43b7-8a4d-b88618b70d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e495e16097411dbec9ae58d5b26bd0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.403087 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-91edc0a6-a29d-43b7-8a4d-b88618b70d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e495e16097411dbec9ae58d5b26bd0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.403719 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-91edc0a6-a29d-43b7-8a4d-b88618b70d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e495e16097411dbec9ae58d5b26bd0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.416466 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1355/2691] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:39:43 2022] DELETE /identity/v3/users/97e495e16097411dbec9ae58d5b26bd0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:43.611918 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba48b8-247e-40f8-a75a-a3e42d052385 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:43.613485 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0dba48b8-247e-40f8-a75a-a3e42d052385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:43.626473 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba48b8-247e-40f8-a75a-a3e42d052385 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:43.688611 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cedc03-7f5a-4891-850f-87401514519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:43.689285 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cedc03-7f5a-4891-850f-87401514519a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:43.689609 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cedc03-7f5a-4891-850f-87401514519a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:43.689879 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cedc03-7f5a-4891-850f-87401514519a admin admin] PATH_INFO: `/v3/users/33757e7e126640d9b6f680fc74129171` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:43.691244 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cedc03-7f5a-4891-850f-87401514519a admin admin] RBAC: Authorizing `identity:delete_user(user_id=33757e7e126640d9b6f680fc74129171)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:43.693103 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cedc03-7f5a-4891-850f-87401514519a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:43.705802 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edc0a6-a29d-43b7-8a4d-b88618b70d7b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:43.707634 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-91edc0a6-a29d-43b7-8a4d-b88618b70d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:43.721267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edc0a6-a29d-43b7-8a4d-b88618b70d7b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:43.726431 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eded653-3e1c-4967-84c3-7c583e89b7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:43.727155 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eded653-3e1c-4967-84c3-7c583e89b7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:43.727550 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eded653-3e1c-4967-84c3-7c583e89b7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:43.727865 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eded653-3e1c-4967-84c3-7c583e89b7b3 admin admin] PATH_INFO: `/v3/projects/030a4290257348c09a8d432f15444823` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:43.729137 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eded653-3e1c-4967-84c3-7c583e89b7b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=030a4290257348c09a8d432f15444823)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:43.731524 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eded653-3e1c-4967-84c3-7c583e89b7b3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:43.760487 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-11cedc03-7f5a-4891-850f-87401514519a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33757e7e126640d9b6f680fc74129171'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.773845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-11cedc03-7f5a-4891-850f-87401514519a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33757e7e126640d9b6f680fc74129171'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.781437 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-11cedc03-7f5a-4891-850f-87401514519a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33757e7e126640d9b6f680fc74129171'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.782186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-11cedc03-7f5a-4891-850f-87401514519a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33757e7e126640d9b6f680fc74129171'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.789878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5eded653-3e1c-4967-84c3-7c583e89b7b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '030a4290257348c09a8d432f15444823', 'request_id': 'req-5eded653-3e1c-4967-84c3-7c583e89b7b3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.795781 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-11cedc03-7f5a-4891-850f-87401514519a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33757e7e126640d9b6f680fc74129171'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.797924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5eded653-3e1c-4967-84c3-7c583e89b7b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '030a4290257348c09a8d432f15444823', 'request_id': 'req-5eded653-3e1c-4967-84c3-7c583e89b7b3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.806061 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1337/2692] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:39:43 2022] DELETE /identity/v3/users/33757e7e126640d9b6f680fc74129171 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:43.806980 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5eded653-3e1c-4967-84c3-7c583e89b7b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '030a4290257348c09a8d432f15444823', 'request_id': 'req-5eded653-3e1c-4967-84c3-7c583e89b7b3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.811527 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97714ce-4bba-477e-86bf-29fe8f2710c5 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:43.811999 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97714ce-4bba-477e-86bf-29fe8f2710c5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:43.812421 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97714ce-4bba-477e-86bf-29fe8f2710c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:43.819082 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5eded653-3e1c-4967-84c3-7c583e89b7b3 admin admin] The token cache is being invalidate because project 030a4290257348c09a8d432f15444823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:39:43.819535 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5eded653-3e1c-4967-84c3-7c583e89b7b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.820653 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5eded653-3e1c-4967-84c3-7c583e89b7b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:43.822922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1356/2693] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:39:43 2022] DELETE /identity/v3/projects/030a4290257348c09a8d432f15444823 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:39:43.830290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b087cc5-aef8-46a4-9398-1e7b069eda62 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:43.830290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b087cc5-aef8-46a4-9398-1e7b069eda62 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:43.830290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b087cc5-aef8-46a4-9398-1e7b069eda62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:43.838514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b97714ce-4bba-477e-86bf-29fe8f2710c5 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:43.841009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b97714ce-4bba-477e-86bf-29fe8f2710c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:43.850862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6b087cc5-aef8-46a4-9398-1e7b069eda62 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:43.852099 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6b087cc5-aef8-46a4-9398-1e7b069eda62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:43.896989 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:43.903453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:43.916919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1338/2694] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:43.927701 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97714ce-4bba-477e-86bf-29fe8f2710c5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:43.928038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1357/2695] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:39:43.929126 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b97714ce-4bba-477e-86bf-29fe8f2710c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:43.935718 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec9bba-8eba-4a6d-9af4-36a8031abbdc None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:43.936031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec9bba-8eba-4a6d-9af4-36a8031abbdc None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:43.936319 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec9bba-8eba-4a6d-9af4-36a8031abbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:43.957078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a1ec9bba-8eba-4a6d-9af4-36a8031abbdc None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:43.958379 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a1ec9bba-8eba-4a6d-9af4-36a8031abbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:43.966650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1358/2696] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:39:43.970991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec9bba-8eba-4a6d-9af4-36a8031abbdc None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:43.981686 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec9bba-8eba-4a6d-9af4-36a8031abbdc None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:43.987391 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541edb43-0492-4c87-8983-8b13517817e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:43.988021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541edb43-0492-4c87-8983-8b13517817e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:43.988294 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541edb43-0492-4c87-8983-8b13517817e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:43.988558 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541edb43-0492-4c87-8983-8b13517817e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:43.989212 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541edb43-0492-4c87-8983-8b13517817e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:39:43.989576 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541edb43-0492-4c87-8983-8b13517817e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:43.991195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541edb43-0492-4c87-8983-8b13517817e1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:43.992972 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97714ce-4bba-477e-86bf-29fe8f2710c5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:43.997561 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f1d66-7997-49fa-ac56-99cbea0f9d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:43.998183 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f1d66-7997-49fa-ac56-99cbea0f9d48 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:43.998943 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f1d66-7997-49fa-ac56-99cbea0f9d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:43.998943 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f1d66-7997-49fa-ac56-99cbea0f9d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:44.004315 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1359/2697] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:39:44.008589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541edb43-0492-4c87-8983-8b13517817e1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:44.009259 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f1d66-7997-49fa-ac56-99cbea0f9d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:44.010746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f1d66-7997-49fa-ac56-99cbea0f9d48 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:44.018790 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541edb43-0492-4c87-8983-8b13517817e1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:44.022943 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1339/2698] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:39:44.026321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd18c6a-e18d-45f2-a9c3-445022d3b74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:44.026949 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18c6a-e18d-45f2-a9c3-445022d3b74b admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:44.027230 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18c6a-e18d-45f2-a9c3-445022d3b74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:44.027498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18c6a-e18d-45f2-a9c3-445022d3b74b admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:44.028144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd18c6a-e18d-45f2-a9c3-445022d3b74b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:44.030126 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd18c6a-e18d-45f2-a9c3-445022d3b74b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:44.070667 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1360/2699] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:44 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:39:44.075016 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f1d66-7997-49fa-ac56-99cbea0f9d48 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:44.086130 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f1d66-7997-49fa-ac56-99cbea0f9d48 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:44.154331 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eabe43-ba76-4bf1-993e-8d6614ac7ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:44.154979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eabe43-ba76-4bf1-993e-8d6614ac7ebd admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:44.155227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eabe43-ba76-4bf1-993e-8d6614ac7ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:44.155492 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eabe43-ba76-4bf1-993e-8d6614ac7ebd admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:44.156256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eabe43-ba76-4bf1-993e-8d6614ac7ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:44.158166 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eabe43-ba76-4bf1-993e-8d6614ac7ebd admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:44.184541 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1340/2700] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:44 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:39:44.189224 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd18c6a-e18d-45f2-a9c3-445022d3b74b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:44.201288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd18c6a-e18d-45f2-a9c3-445022d3b74b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:44.208975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d4b13-bb05-4284-9693-3bd68c1a75f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:44.209759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d4b13-bb05-4284-9693-3bd68c1a75f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:44.210005 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d4b13-bb05-4284-9693-3bd68c1a75f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:44.210180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d4b13-bb05-4284-9693-3bd68c1a75f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:44.210823 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d4b13-bb05-4284-9693-3bd68c1a75f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:44.212563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d4b13-bb05-4284-9693-3bd68c1a75f2 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:44.223438 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1361/2701] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:44.228040 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eabe43-ba76-4bf1-993e-8d6614ac7ebd admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:44.240469 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eabe43-ba76-4bf1-993e-8d6614ac7ebd admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:44.246932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d8725-bb43-4b41-8bb4-e0e0319e9246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:44.247663 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d8725-bb43-4b41-8bb4-e0e0319e9246 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:44.248139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d8725-bb43-4b41-8bb4-e0e0319e9246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:44.248380 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d8725-bb43-4b41-8bb4-e0e0319e9246 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:44.249166 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d8725-bb43-4b41-8bb4-e0e0319e9246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:44.251218 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d8725-bb43-4b41-8bb4-e0e0319e9246 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:44.265011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1341/2702] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:44.270219 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d4b13-bb05-4284-9693-3bd68c1a75f2 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:44.283138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d4b13-bb05-4284-9693-3bd68c1a75f2 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:44.290180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613656b0-deae-4861-b080-4a4bce942f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:44.291065 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613656b0-deae-4861-b080-4a4bce942f07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:44.291367 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613656b0-deae-4861-b080-4a4bce942f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:44.291686 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613656b0-deae-4861-b080-4a4bce942f07 admin admin] PATH_INFO: `/v3/projects/072e607eedc34895a40028d2995d1709/users/de2af0546bb449e5b9bc1d7dbc094206/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:44.310419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613656b0-deae-4861-b080-4a4bce942f07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=072e607eedc34895a40028d2995d1709, user_id=de2af0546bb449e5b9bc1d7dbc094206, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:44.313101 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613656b0-deae-4861-b080-4a4bce942f07 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:44.329405 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1362/2703] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:44 2022] PUT /identity/v3/projects/072e607eedc34895a40028d2995d1709/users/de2af0546bb449e5b9bc1d7dbc094206/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:44.343381 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f59bed-cb59-437b-a3b1-a20d8238df5c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:44.343879 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f59bed-cb59-437b-a3b1-a20d8238df5c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:44.344224 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f59bed-cb59-437b-a3b1-a20d8238df5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:44.360224 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613656b0-deae-4861-b080-4a4bce942f07 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:44.363290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-613656b0-deae-4861-b080-4a4bce942f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:44.382273 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-a1f59bed-cb59-437b-a3b1-a20d8238df5c None None] MFA Rules not processed for user `de2af0546bb449e5b9bc1d7dbc094206`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:44.383825 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a1f59bed-cb59-437b-a3b1-a20d8238df5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:44.438181 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613656b0-deae-4861-b080-4a4bce942f07 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:44.443370 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18e3cd-e62e-4051-9af4-fccfac78303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:44.444020 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18e3cd-e62e-4051-9af4-fccfac78303e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:44.444287 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18e3cd-e62e-4051-9af4-fccfac78303e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:44.444619 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18e3cd-e62e-4051-9af4-fccfac78303e admin admin] PATH_INFO: `/v3/projects/f762db002ce844989bafccc47aced2df` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:44.446355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18e3cd-e62e-4051-9af4-fccfac78303e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f762db002ce844989bafccc47aced2df)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:44.448527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18e3cd-e62e-4051-9af4-fccfac78303e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:44.455227 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1342/2704] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:44.459915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f59bed-cb59-437b-a3b1-a20d8238df5c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:44.471228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f59bed-cb59-437b-a3b1-a20d8238df5c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:44.476530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e09c9a-a15d-4564-952c-f2c1d53075aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:44.477141 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e09c9a-a15d-4564-952c-f2c1d53075aa admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:44.477547 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e09c9a-a15d-4564-952c-f2c1d53075aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:44.477818 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e09c9a-a15d-4564-952c-f2c1d53075aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:44.478459 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e09c9a-a15d-4564-952c-f2c1d53075aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:44.480679 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e09c9a-a15d-4564-952c-f2c1d53075aa admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:44.486214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:44.512052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-de18e3cd-e62e-4051-9af4-fccfac78303e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f762db002ce844989bafccc47aced2df', 'request_id': 'req-de18e3cd-e62e-4051-9af4-fccfac78303e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:44.519057 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-de18e3cd-e62e-4051-9af4-fccfac78303e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f762db002ce844989bafccc47aced2df', 'request_id': 'req-de18e3cd-e62e-4051-9af4-fccfac78303e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:44.522555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1343/2705] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:44 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:39:44.525348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e09c9a-a15d-4564-952c-f2c1d53075aa admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:44.528284 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-de18e3cd-e62e-4051-9af4-fccfac78303e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f762db002ce844989bafccc47aced2df', 'request_id': 'req-de18e3cd-e62e-4051-9af4-fccfac78303e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:44.539604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-de18e3cd-e62e-4051-9af4-fccfac78303e admin admin] The token cache is being invalidate because project f762db002ce844989bafccc47aced2df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:39:44.539896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-de18e3cd-e62e-4051-9af4-fccfac78303e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:44.540823 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-de18e3cd-e62e-4051-9af4-fccfac78303e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:44.542436 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1363/2706] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:39:44 2022] DELETE /identity/v3/projects/f762db002ce844989bafccc47aced2df => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:44.604023 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e09c9a-a15d-4564-952c-f2c1d53075aa admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:44.610762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432570fe-5766-4c1c-b84b-ff9d54f66b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:44.611628 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432570fe-5766-4c1c-b84b-ff9d54f66b8a admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:44.611989 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432570fe-5766-4c1c-b84b-ff9d54f66b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:44.612264 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432570fe-5766-4c1c-b84b-ff9d54f66b8a admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:44.613165 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432570fe-5766-4c1c-b84b-ff9d54f66b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:44.615292 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432570fe-5766-4c1c-b84b-ff9d54f66b8a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:44.646832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1344/2707] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:44 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:44.648982 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18e3cd-e62e-4051-9af4-fccfac78303e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:44.651290 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-de18e3cd-e62e-4051-9af4-fccfac78303e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:44.658698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:44.751333 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18e3cd-e62e-4051-9af4-fccfac78303e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:44.758252 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca801e2-6e4d-4660-8387-10de094ad14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:44.759107 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca801e2-6e4d-4660-8387-10de094ad14b admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:44.759541 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca801e2-6e4d-4660-8387-10de094ad14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:44.759836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca801e2-6e4d-4660-8387-10de094ad14b admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:44.760766 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca801e2-6e4d-4660-8387-10de094ad14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:44.763359 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca801e2-6e4d-4660-8387-10de094ad14b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:44.779192 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1364/2708] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:44.784194 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432570fe-5766-4c1c-b84b-ff9d54f66b8a admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:44.796176 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432570fe-5766-4c1c-b84b-ff9d54f66b8a admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:44.802043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468d4f9-f5c2-4d6b-9e6b-c556fee9eaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:44.802744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468d4f9-f5c2-4d6b-9e6b-c556fee9eaa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:44.803018 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468d4f9-f5c2-4d6b-9e6b-c556fee9eaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:44.803298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468d4f9-f5c2-4d6b-9e6b-c556fee9eaa4 admin admin] PATH_INFO: `/v3/projects/a25e4d706f5e427f9551ae4cd3ce285e/users/c20f0aefffcb4cd3ac5deb00a4782d94/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:44.823050 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468d4f9-f5c2-4d6b-9e6b-c556fee9eaa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25e4d706f5e427f9551ae4cd3ce285e, user_id=c20f0aefffcb4cd3ac5deb00a4782d94, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:44.826191 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468d4f9-f5c2-4d6b-9e6b-c556fee9eaa4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:44.841680 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1345/2709] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:44 2022] PUT /identity/v3/projects/a25e4d706f5e427f9551ae4cd3ce285e/users/c20f0aefffcb4cd3ac5deb00a4782d94/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:44.846270 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca801e2-6e4d-4660-8387-10de094ad14b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:44.860320 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca801e2-6e4d-4660-8387-10de094ad14b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:44.920498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63c14e-2755-45aa-9b0a-41f15585abd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:44.921113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63c14e-2755-45aa-9b0a-41f15585abd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:44.921398 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63c14e-2755-45aa-9b0a-41f15585abd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:44.921681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63c14e-2755-45aa-9b0a-41f15585abd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:44.922328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63c14e-2755-45aa-9b0a-41f15585abd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:44.923938 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63c14e-2755-45aa-9b0a-41f15585abd3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:44.935029 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1365/2710] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:44.940023 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468d4f9-f5c2-4d6b-9e6b-c556fee9eaa4 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:44.954919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468d4f9-f5c2-4d6b-9e6b-c556fee9eaa4 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:44.961736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d3b40-74fe-49f1-acbb-412f85efa254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:44.962681 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d3b40-74fe-49f1-acbb-412f85efa254 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:44.963032 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d3b40-74fe-49f1-acbb-412f85efa254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:44.963416 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d3b40-74fe-49f1-acbb-412f85efa254 admin admin] PATH_INFO: `/v3/projects/a25e4d706f5e427f9551ae4cd3ce285e/users/c20f0aefffcb4cd3ac5deb00a4782d94/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:44.966153 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d3b40-74fe-49f1-acbb-412f85efa254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25e4d706f5e427f9551ae4cd3ce285e, user_id=c20f0aefffcb4cd3ac5deb00a4782d94, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:44.970143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d3b40-74fe-49f1-acbb-412f85efa254 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:44.984500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1346/2711] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:44 2022] PUT /identity/v3/projects/a25e4d706f5e427f9551ae4cd3ce285e/users/c20f0aefffcb4cd3ac5deb00a4782d94/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:44.995623 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458552be-a805-4c5e-8219-a08c56489e5d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:44.995914 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458552be-a805-4c5e-8219-a08c56489e5d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:44.996146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458552be-a805-4c5e-8219-a08c56489e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:45.029172 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-458552be-a805-4c5e-8219-a08c56489e5d None None] MFA Rules not processed for user `c20f0aefffcb4cd3ac5deb00a4782d94`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:45.030414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-458552be-a805-4c5e-8219-a08c56489e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:45.103027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1366/2712] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:39:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:45.115145 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d3b40-74fe-49f1-acbb-412f85efa254 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:45.117029 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0e8d3b40-74fe-49f1-acbb-412f85efa254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:45.177796 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d3b40-74fe-49f1-acbb-412f85efa254 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:45.181812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600b5a7-e45f-48ca-ba90-2093eb341c14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:45.182434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b5a7-e45f-48ca-ba90-2093eb341c14 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:45.182714 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b5a7-e45f-48ca-ba90-2093eb341c14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:45.182986 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b5a7-e45f-48ca-ba90-2093eb341c14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:45.192930 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600b5a7-e45f-48ca-ba90-2093eb341c14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:45.194425 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600b5a7-e45f-48ca-ba90-2093eb341c14 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:45.204600 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1347/2713] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:39:45.289324 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458552be-a805-4c5e-8219-a08c56489e5d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:45.301169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458552be-a805-4c5e-8219-a08c56489e5d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:45.306426 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e2ebc-db51-4afa-abf6-63bf78cb427a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:45.307156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e2ebc-db51-4afa-abf6-63bf78cb427a service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:45.307320 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e2ebc-db51-4afa-abf6-63bf78cb427a service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:45.307675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e2ebc-db51-4afa-abf6-63bf78cb427a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:45.309803 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-657e2ebc-db51-4afa-abf6-63bf78cb427a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:45.329818 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:45.380013 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e2ebc-db51-4afa-abf6-63bf78cb427a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:45.381835 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e2ebc-db51-4afa-abf6-63bf78cb427a service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:45.394463 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1367/2714] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:39:55.200006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=76,keystone:INSERT=6 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:55.388897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=19 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:59.547306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d86c6-e278-4286-8f6b-9212a98ec961 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:59.547830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d86c6-e278-4286-8f6b-9212a98ec961 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:59.548423 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d86c6-e278-4286-8f6b-9212a98ec961 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:59.551341 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1348/2715] 10.222.0.52 () {54 vars in 921 bytes} [Mon Aug 29 20:39:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:39:59.558640 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13729aaf-f16c-4344-836c-5bdda27cb401 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:59.559179 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13729aaf-f16c-4344-836c-5bdda27cb401 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:59.559819 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13729aaf-f16c-4344-836c-5bdda27cb401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:59.621147 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-13729aaf-f16c-4344-836c-5bdda27cb401 None None] MFA Rules not processed for user `9c95d16fd4da4fa7987b893eae0b3ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:59.622743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-13729aaf-f16c-4344-836c-5bdda27cb401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:59.727925 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1368/2716] 10.222.0.52 () {58 vars in 1018 bytes} [Mon Aug 29 20:39:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:59.740079 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d86c6-e278-4286-8f6b-9212a98ec961 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:59.742074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f13d86c6-e278-4286-8f6b-9212a98ec961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:59.814536 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d86c6-e278-4286-8f6b-9212a98ec961 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:59.818190 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfdb75-9d5b-4599-8e4c-3ea75e5b843a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:59.818802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfdb75-9d5b-4599-8e4c-3ea75e5b843a service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:59.819089 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfdb75-9d5b-4599-8e4c-3ea75e5b843a service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:59.819356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfdb75-9d5b-4599-8e4c-3ea75e5b843a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:59.831518 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfdb75-9d5b-4599-8e4c-3ea75e5b843a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:59.833130 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfdb75-9d5b-4599-8e4c-3ea75e5b843a service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:59.844677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1349/2717] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:09.724233 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=43 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:09.839656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=26 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:16.345318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13729aaf-f16c-4344-836c-5bdda27cb401 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:16.417750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13729aaf-f16c-4344-836c-5bdda27cb401 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:16.423526 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73188d63-a9fa-4140-bd13-f5e659a83d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:16.424263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73188d63-a9fa-4140-bd13-f5e659a83d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:16.425038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73188d63-a9fa-4140-bd13-f5e659a83d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:16.425503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73188d63-a9fa-4140-bd13-f5e659a83d1f admin admin] PATH_INFO: `/v3/users/de2af0546bb449e5b9bc1d7dbc094206` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:16.427151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73188d63-a9fa-4140-bd13-f5e659a83d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de2af0546bb449e5b9bc1d7dbc094206)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:16.429529 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73188d63-a9fa-4140-bd13-f5e659a83d1f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:16.503595 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-73188d63-a9fa-4140-bd13-f5e659a83d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de2af0546bb449e5b9bc1d7dbc094206'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:16.515587 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-73188d63-a9fa-4140-bd13-f5e659a83d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de2af0546bb449e5b9bc1d7dbc094206'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:16.530767 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-73188d63-a9fa-4140-bd13-f5e659a83d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de2af0546bb449e5b9bc1d7dbc094206'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:16.531498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-73188d63-a9fa-4140-bd13-f5e659a83d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de2af0546bb449e5b9bc1d7dbc094206'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:16.532171 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-73188d63-a9fa-4140-bd13-f5e659a83d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de2af0546bb449e5b9bc1d7dbc094206'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:16.546337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1369/2718] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:16 2022] DELETE /identity/v3/users/de2af0546bb449e5b9bc1d7dbc094206 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:16.551796 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6be1d-543e-4377-8e8c-39057c78b8d4 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:16.552371 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6be1d-543e-4377-8e8c-39057c78b8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:16.553185 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6be1d-543e-4377-8e8c-39057c78b8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:16.578794 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-27f6be1d-543e-4377-8e8c-39057c78b8d4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:16.580197 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-27f6be1d-543e-4377-8e8c-39057c78b8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:16.656396 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1350/2719] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:16.667959 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73188d63-a9fa-4140-bd13-f5e659a83d1f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:16.669502 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-73188d63-a9fa-4140-bd13-f5e659a83d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:16.746445 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73188d63-a9fa-4140-bd13-f5e659a83d1f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:16.751935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037205e0-8d94-47b8-adee-ba80d6bde18f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:16.752899 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037205e0-8d94-47b8-adee-ba80d6bde18f service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:16.753389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037205e0-8d94-47b8-adee-ba80d6bde18f service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:16.753994 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037205e0-8d94-47b8-adee-ba80d6bde18f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:16.766702 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037205e0-8d94-47b8-adee-ba80d6bde18f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:16.768219 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037205e0-8d94-47b8-adee-ba80d6bde18f service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:16.779791 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1370/2720] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:16.929268 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9359a77-e886-4416-9416-9d9359be41b9 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:16.929592 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9359a77-e886-4416-9416-9d9359be41b9 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:16.929869 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9359a77-e886-4416-9416-9d9359be41b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:16.953073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c9359a77-e886-4416-9416-9d9359be41b9 None None] MFA Rules not processed for user `fc7638f8acfa4782924319d2aba62958`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:16.954713 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c9359a77-e886-4416-9416-9d9359be41b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:17.167004 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1351/2721] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:17.488271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037205e0-8d94-47b8-adee-ba80d6bde18f service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:17.490921 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-037205e0-8d94-47b8-adee-ba80d6bde18f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:17.526537 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037205e0-8d94-47b8-adee-ba80d6bde18f service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:17.533958 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:17.546043 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:17.546535 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:17.547013 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b admin admin] PATH_INFO: `/v3/projects/072e607eedc34895a40028d2995d1709` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:17.549306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b admin admin] RBAC: Authorizing `identity:delete_project(project_id=072e607eedc34895a40028d2995d1709)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:17.553589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:17.589271 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:17.651086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '072e607eedc34895a40028d2995d1709', 'request_id': 'req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:17.665990 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '072e607eedc34895a40028d2995d1709', 'request_id': 'req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:17.677975 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '072e607eedc34895a40028d2995d1709', 'request_id': 'req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:17.696327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b admin admin] The token cache is being invalidate because project 072e607eedc34895a40028d2995d1709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:17.696786 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:17.697625 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:17.699320 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1371/2722] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:17 2022] DELETE /identity/v3/projects/072e607eedc34895a40028d2995d1709 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:17.709113 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9359a77-e886-4416-9416-9d9359be41b9 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:17.720887 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9359a77-e886-4416-9416-9d9359be41b9 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:17.800202 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27ffe3-938c-4c08-b3c2-bdddbc3f56d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:17.801049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27ffe3-938c-4c08-b3c2-bdddbc3f56d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:17.801589 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27ffe3-938c-4c08-b3c2-bdddbc3f56d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:17.802953 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27ffe3-938c-4c08-b3c2-bdddbc3f56d7 admin admin] PATH_INFO: `/v3/users/c20f0aefffcb4cd3ac5deb00a4782d94` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:17.804287 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27ffe3-938c-4c08-b3c2-bdddbc3f56d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c20f0aefffcb4cd3ac5deb00a4782d94)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:17.806489 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27ffe3-938c-4c08-b3c2-bdddbc3f56d7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:17.898744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fb27ffe3-938c-4c08-b3c2-bdddbc3f56d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c20f0aefffcb4cd3ac5deb00a4782d94'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:17.901205 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:17.922044 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fb27ffe3-938c-4c08-b3c2-bdddbc3f56d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c20f0aefffcb4cd3ac5deb00a4782d94'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:17.931943 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fb27ffe3-938c-4c08-b3c2-bdddbc3f56d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c20f0aefffcb4cd3ac5deb00a4782d94'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:17.932735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fb27ffe3-938c-4c08-b3c2-bdddbc3f56d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c20f0aefffcb4cd3ac5deb00a4782d94'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:17.954638 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fb27ffe3-938c-4c08-b3c2-bdddbc3f56d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c20f0aefffcb4cd3ac5deb00a4782d94'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:17.966085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1352/2723] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:17 2022] DELETE /identity/v3/users/c20f0aefffcb4cd3ac5deb00a4782d94 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:18.468096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:18.470735 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:18.494638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1f769-4548-40b7-b2ad-92c3cdb6c69b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:18.573015 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2a96b-bae9-4f19-a729-0e0233b40b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:18.573705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2a96b-bae9-4f19-a729-0e0233b40b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.573981 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2a96b-bae9-4f19-a729-0e0233b40b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.574252 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2a96b-bae9-4f19-a729-0e0233b40b73 admin admin] PATH_INFO: `/v3/projects/a25e4d706f5e427f9551ae4cd3ce285e` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.575481 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2a96b-bae9-4f19-a729-0e0233b40b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a25e4d706f5e427f9551ae4cd3ce285e)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:18.577532 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2a96b-bae9-4f19-a729-0e0233b40b73 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:18.651738 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-49a2a96b-bae9-4f19-a729-0e0233b40b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a25e4d706f5e427f9551ae4cd3ce285e', 'request_id': 'req-49a2a96b-bae9-4f19-a729-0e0233b40b73'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:18.660457 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-49a2a96b-bae9-4f19-a729-0e0233b40b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a25e4d706f5e427f9551ae4cd3ce285e', 'request_id': 'req-49a2a96b-bae9-4f19-a729-0e0233b40b73'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:18.670038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-49a2a96b-bae9-4f19-a729-0e0233b40b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a25e4d706f5e427f9551ae4cd3ce285e', 'request_id': 'req-49a2a96b-bae9-4f19-a729-0e0233b40b73'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:18.684939 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-49a2a96b-bae9-4f19-a729-0e0233b40b73 admin admin] The token cache is being invalidate because project a25e4d706f5e427f9551ae4cd3ce285e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:18.685236 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-49a2a96b-bae9-4f19-a729-0e0233b40b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:18.685941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-49a2a96b-bae9-4f19-a729-0e0233b40b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:18.687541 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1372/2724] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:18 2022] DELETE /identity/v3/projects/a25e4d706f5e427f9551ae4cd3ce285e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:18.696921 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76901f-e939-423d-925e-239aee1af92e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.697196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76901f-e939-423d-925e-239aee1af92e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.697477 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76901f-e939-423d-925e-239aee1af92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.724816 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6e76901f-e939-423d-925e-239aee1af92e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:18.726075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6e76901f-e939-423d-925e-239aee1af92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:18.800031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1353/2725] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:40:18.810184 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14163452-7a50-4472-8ee3-f0136d5d63b4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.810442 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14163452-7a50-4472-8ee3-f0136d5d63b4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.810739 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14163452-7a50-4472-8ee3-f0136d5d63b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.833433 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-14163452-7a50-4472-8ee3-f0136d5d63b4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:18.834711 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-14163452-7a50-4472-8ee3-f0136d5d63b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:18.853462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1373/2726] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:18.858762 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76901f-e939-423d-925e-239aee1af92e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:18.870205 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76901f-e939-423d-925e-239aee1af92e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:18.875933 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66d9d5-e662-4200-add0-fd109f5bca3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:18.876563 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66d9d5-e662-4200-add0-fd109f5bca3d admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.876842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66d9d5-e662-4200-add0-fd109f5bca3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.877128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66d9d5-e662-4200-add0-fd109f5bca3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.877831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66d9d5-e662-4200-add0-fd109f5bca3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:40:18.878145 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66d9d5-e662-4200-add0-fd109f5bca3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:18.879805 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66d9d5-e662-4200-add0-fd109f5bca3d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:18.893517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1354/2727] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:40:18.898277 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14163452-7a50-4472-8ee3-f0136d5d63b4 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:18.910508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14163452-7a50-4472-8ee3-f0136d5d63b4 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:18.916035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e09736-4456-485a-a78b-decb25c1d9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:18.916660 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e09736-4456-485a-a78b-decb25c1d9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:18.916931 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e09736-4456-485a-a78b-decb25c1d9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:18.917194 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e09736-4456-485a-a78b-decb25c1d9e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:18.917894 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e09736-4456-485a-a78b-decb25c1d9e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:18.920542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e09736-4456-485a-a78b-decb25c1d9e1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:18.955013 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1374/2728] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:40:18 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:40:18.959558 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66d9d5-e662-4200-add0-fd109f5bca3d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:18.971209 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66d9d5-e662-4200-add0-fd109f5bca3d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:19.043688 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5304341-bec3-4ce7-9dc5-04c80713f14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:19.044871 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5304341-bec3-4ce7-9dc5-04c80713f14e admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:19.045134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5304341-bec3-4ce7-9dc5-04c80713f14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:19.045428 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5304341-bec3-4ce7-9dc5-04c80713f14e admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:19.046291 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5304341-bec3-4ce7-9dc5-04c80713f14e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:19.048738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5304341-bec3-4ce7-9dc5-04c80713f14e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:19.073785 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1355/2729] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:40:18 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:40:19.078355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e09736-4456-485a-a78b-decb25c1d9e1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:19.089908 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e09736-4456-485a-a78b-decb25c1d9e1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:19.094986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b171f-470e-4dd9-9c8e-27529193f043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:19.095775 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b171f-470e-4dd9-9c8e-27529193f043 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:19.095935 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b171f-470e-4dd9-9c8e-27529193f043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:19.096141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b171f-470e-4dd9-9c8e-27529193f043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:19.096812 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b171f-470e-4dd9-9c8e-27529193f043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:19.098632 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b171f-470e-4dd9-9c8e-27529193f043 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:19.100332 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:19.117412 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1375/2730] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:19.120288 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5304341-bec3-4ce7-9dc5-04c80713f14e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:19.131420 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5304341-bec3-4ce7-9dc5-04c80713f14e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:19.137250 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214c51b-889c-47da-b58c-748972614acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:19.137924 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214c51b-889c-47da-b58c-748972614acc admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:19.138199 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214c51b-889c-47da-b58c-748972614acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:19.138456 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214c51b-889c-47da-b58c-748972614acc admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:19.139123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214c51b-889c-47da-b58c-748972614acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:19.140783 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214c51b-889c-47da-b58c-748972614acc admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:19.152917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1356/2731] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:40:19.158969 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b171f-470e-4dd9-9c8e-27529193f043 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:19.169843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b171f-470e-4dd9-9c8e-27529193f043 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:19.174943 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f18b44-f0c6-454d-855e-9b1bab09768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:19.175627 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f18b44-f0c6-454d-855e-9b1bab09768b admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:19.175942 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f18b44-f0c6-454d-855e-9b1bab09768b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:19.176215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f18b44-f0c6-454d-855e-9b1bab09768b admin admin] PATH_INFO: `/v3/projects/ce4bec087faf4091b79a63596e23249b/users/86a3d41feedd4bc393d0e76c71a7e82f/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:19.193386 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f18b44-f0c6-454d-855e-9b1bab09768b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4bec087faf4091b79a63596e23249b, user_id=86a3d41feedd4bc393d0e76c71a7e82f, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:19.196098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f18b44-f0c6-454d-855e-9b1bab09768b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:19.212930 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1376/2732] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:19 2022] PUT /identity/v3/projects/ce4bec087faf4091b79a63596e23249b/users/86a3d41feedd4bc393d0e76c71a7e82f/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:19.224563 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f116-ec51-4555-af8e-10e3a7381a7c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:19.224832 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f116-ec51-4555-af8e-10e3a7381a7c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:19.225087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f116-ec51-4555-af8e-10e3a7381a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:19.257741 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-9111f116-ec51-4555-af8e-10e3a7381a7c None None] MFA Rules not processed for user `86a3d41feedd4bc393d0e76c71a7e82f`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:19.259005 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9111f116-ec51-4555-af8e-10e3a7381a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:19.279485 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:19.340554 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1357/2733] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:19.345578 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f18b44-f0c6-454d-855e-9b1bab09768b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:19.442680 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f18b44-f0c6-454d-855e-9b1bab09768b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:19.450953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285cedf-6bf5-45c1-b86b-5a452888c0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:19.452077 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285cedf-6bf5-45c1-b86b-5a452888c0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:19.452554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285cedf-6bf5-45c1-b86b-5a452888c0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:19.453038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285cedf-6bf5-45c1-b86b-5a452888c0a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:19.454291 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285cedf-6bf5-45c1-b86b-5a452888c0a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:19.457974 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285cedf-6bf5-45c1-b86b-5a452888c0a1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:19.513240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1377/2734] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:40:19 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:40:19.518444 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111f116-ec51-4555-af8e-10e3a7381a7c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:19.535642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111f116-ec51-4555-af8e-10e3a7381a7c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:19.622322 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bdb1a-d1aa-4664-bfc2-2eba58689edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:19.624283 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bdb1a-d1aa-4664-bfc2-2eba58689edd admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:19.624732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bdb1a-d1aa-4664-bfc2-2eba58689edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:19.625083 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bdb1a-d1aa-4664-bfc2-2eba58689edd admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:19.625888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bdb1a-d1aa-4664-bfc2-2eba58689edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:19.628046 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bdb1a-d1aa-4664-bfc2-2eba58689edd admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:19.663336 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1358/2735] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:40:19 2022] POST /identity/v3/users => generated 300 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:40:19.668137 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285cedf-6bf5-45c1-b86b-5a452888c0a1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:19.684782 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285cedf-6bf5-45c1-b86b-5a452888c0a1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:19.692829 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115cb07-6b10-4742-9bca-ff99430cc0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:19.693937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115cb07-6b10-4742-9bca-ff99430cc0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:19.694420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115cb07-6b10-4742-9bca-ff99430cc0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:19.694905 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115cb07-6b10-4742-9bca-ff99430cc0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:19.695910 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115cb07-6b10-4742-9bca-ff99430cc0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:19.698582 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115cb07-6b10-4742-9bca-ff99430cc0d5 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:19.713212 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1378/2736] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:19.719716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bdb1a-d1aa-4664-bfc2-2eba58689edd admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:19.736548 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bdb1a-d1aa-4664-bfc2-2eba58689edd admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:19.745085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b782be-5b5b-4915-be54-db443db7bb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:19.746326 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b782be-5b5b-4915-be54-db443db7bb70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:19.746661 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b782be-5b5b-4915-be54-db443db7bb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:19.746940 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b782be-5b5b-4915-be54-db443db7bb70 admin admin] PATH_INFO: `/v3/projects/c311dae6f28a41b4a79038eab36c6fe9/users/2fc6936eab6445609577b368a582f6cd/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:19.766723 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b782be-5b5b-4915-be54-db443db7bb70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c311dae6f28a41b4a79038eab36c6fe9, user_id=2fc6936eab6445609577b368a582f6cd, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:19.770004 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b782be-5b5b-4915-be54-db443db7bb70 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:19.789132 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1359/2737] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:19 2022] PUT /identity/v3/projects/c311dae6f28a41b4a79038eab36c6fe9/users/2fc6936eab6445609577b368a582f6cd/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:19.801239 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115cb07-6b10-4742-9bca-ff99430cc0d5 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:19.828970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115cb07-6b10-4742-9bca-ff99430cc0d5 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:19.900885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe9601-6660-44ff-aa08-03cf681b5713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:19.901547 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe9601-6660-44ff-aa08-03cf681b5713 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:19.901807 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe9601-6660-44ff-aa08-03cf681b5713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:19.902073 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe9601-6660-44ff-aa08-03cf681b5713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:19.902715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe9601-6660-44ff-aa08-03cf681b5713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:19.904349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe9601-6660-44ff-aa08-03cf681b5713 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:19.917211 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1379/2738] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:40:19.922128 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b782be-5b5b-4915-be54-db443db7bb70 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:19.936432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b782be-5b5b-4915-be54-db443db7bb70 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:19.943584 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5c700-26e6-43b9-9563-6d2a24e7c8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:19.943956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5c700-26e6-43b9-9563-6d2a24e7c8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:19.944218 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5c700-26e6-43b9-9563-6d2a24e7c8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:19.944526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5c700-26e6-43b9-9563-6d2a24e7c8f0 admin admin] PATH_INFO: `/v3/projects/c311dae6f28a41b4a79038eab36c6fe9/users/2fc6936eab6445609577b368a582f6cd/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:19.946516 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5c700-26e6-43b9-9563-6d2a24e7c8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c311dae6f28a41b4a79038eab36c6fe9, user_id=2fc6936eab6445609577b368a582f6cd, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:19.949184 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5c700-26e6-43b9-9563-6d2a24e7c8f0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:19.962900 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1360/2739] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:19 2022] PUT /identity/v3/projects/c311dae6f28a41b4a79038eab36c6fe9/users/2fc6936eab6445609577b368a582f6cd/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:40:19.974483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dbf0d-dd47-4348-9833-63d6f035c665 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:19.974738 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dbf0d-dd47-4348-9833-63d6f035c665 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:19.975017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dbf0d-dd47-4348-9833-63d6f035c665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:20.008122 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6f5dbf0d-dd47-4348-9833-63d6f035c665 None None] MFA Rules not processed for user `2fc6936eab6445609577b368a582f6cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:20.012073 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6f5dbf0d-dd47-4348-9833-63d6f035c665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:20.062586 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:20.118841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1380/2740] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:20.135908 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5c700-26e6-43b9-9563-6d2a24e7c8f0 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:20.139556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-62a5c700-26e6-43b9-9563-6d2a24e7c8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:20.225642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5c700-26e6-43b9-9563-6d2a24e7c8f0 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:20.229481 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ded665-9b0d-44cc-899a-163c7bd6741e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:20.230101 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded665-9b0d-44cc-899a-163c7bd6741e service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:20.230372 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded665-9b0d-44cc-899a-163c7bd6741e service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:20.230639 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded665-9b0d-44cc-899a-163c7bd6741e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:20.240945 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ded665-9b0d-44cc-899a-163c7bd6741e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:20.242567 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ded665-9b0d-44cc-899a-163c7bd6741e service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:20.254958 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1361/2741] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:20.286644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dbf0d-dd47-4348-9833-63d6f035c665 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:20.371045 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dbf0d-dd47-4348-9833-63d6f035c665 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:20.384371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f91d9-b8a1-4abc-ac15-8682c282ab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:20.384371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f91d9-b8a1-4abc-ac15-8682c282ab7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:20.384371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f91d9-b8a1-4abc-ac15-8682c282ab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:20.384371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f91d9-b8a1-4abc-ac15-8682c282ab7a admin admin] PATH_INFO: `/v3/users/86a3d41feedd4bc393d0e76c71a7e82f` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:20.386132 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f91d9-b8a1-4abc-ac15-8682c282ab7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a3d41feedd4bc393d0e76c71a7e82f)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:20.388264 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f91d9-b8a1-4abc-ac15-8682c282ab7a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:20.466201 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a87f91d9-b8a1-4abc-ac15-8682c282ab7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a3d41feedd4bc393d0e76c71a7e82f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:20.480196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a87f91d9-b8a1-4abc-ac15-8682c282ab7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a3d41feedd4bc393d0e76c71a7e82f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:20.502246 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a87f91d9-b8a1-4abc-ac15-8682c282ab7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a3d41feedd4bc393d0e76c71a7e82f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:20.503154 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a87f91d9-b8a1-4abc-ac15-8682c282ab7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a3d41feedd4bc393d0e76c71a7e82f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:20.503762 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a87f91d9-b8a1-4abc-ac15-8682c282ab7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a3d41feedd4bc393d0e76c71a7e82f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:20.519613 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1381/2742] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:20 2022] DELETE /identity/v3/users/86a3d41feedd4bc393d0e76c71a7e82f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:20.523898 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac989b-b292-46ba-af8c-776a85c8a404 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:20.524193 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac989b-b292-46ba-af8c-776a85c8a404 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:20.524468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac989b-b292-46ba-af8c-776a85c8a404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:20.564365 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d4ac989b-b292-46ba-af8c-776a85c8a404 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:20.567379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d4ac989b-b292-46ba-af8c-776a85c8a404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:20.586167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:20.695404 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1362/2743] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:20.705669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f91d9-b8a1-4abc-ac15-8682c282ab7a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:20.707141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a87f91d9-b8a1-4abc-ac15-8682c282ab7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:20.773457 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:20.782173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f91d9-b8a1-4abc-ac15-8682c282ab7a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:20.792403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4344bb-56fb-49c3-900e-3f8a39091880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:20.792926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4344bb-56fb-49c3-900e-3f8a39091880 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:20.793456 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4344bb-56fb-49c3-900e-3f8a39091880 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:20.793889 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4344bb-56fb-49c3-900e-3f8a39091880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:20.806776 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4344bb-56fb-49c3-900e-3f8a39091880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:20.808303 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4344bb-56fb-49c3-900e-3f8a39091880 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:20.819378 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1382/2744] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:40:21.167910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac989b-b292-46ba-af8c-776a85c8a404 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:21.171068 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d4ac989b-b292-46ba-af8c-776a85c8a404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:21.187338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac989b-b292-46ba-af8c-776a85c8a404 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:21.202943 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cb738-b15d-4c8f-a032-0f30f176e445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:21.203854 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cb738-b15d-4c8f-a032-0f30f176e445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:21.204307 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cb738-b15d-4c8f-a032-0f30f176e445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:21.204752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cb738-b15d-4c8f-a032-0f30f176e445 admin admin] PATH_INFO: `/v3/projects/ce4bec087faf4091b79a63596e23249b` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:21.206380 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cb738-b15d-4c8f-a032-0f30f176e445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4bec087faf4091b79a63596e23249b)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:21.208882 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cb738-b15d-4c8f-a032-0f30f176e445 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:21.273451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7f0cb738-b15d-4c8f-a032-0f30f176e445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4bec087faf4091b79a63596e23249b', 'request_id': 'req-7f0cb738-b15d-4c8f-a032-0f30f176e445'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:21.293681 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7f0cb738-b15d-4c8f-a032-0f30f176e445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4bec087faf4091b79a63596e23249b', 'request_id': 'req-7f0cb738-b15d-4c8f-a032-0f30f176e445'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:21.306736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7f0cb738-b15d-4c8f-a032-0f30f176e445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4bec087faf4091b79a63596e23249b', 'request_id': 'req-7f0cb738-b15d-4c8f-a032-0f30f176e445'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:21.325101 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7f0cb738-b15d-4c8f-a032-0f30f176e445 admin admin] The token cache is being invalidate because project ce4bec087faf4091b79a63596e23249b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:21.325749 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7f0cb738-b15d-4c8f-a032-0f30f176e445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:21.326902 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7f0cb738-b15d-4c8f-a032-0f30f176e445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:21.330508 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1363/2745] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:21 2022] DELETE /identity/v3/projects/ce4bec087faf4091b79a63596e23249b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:21.336406 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4344bb-56fb-49c3-900e-3f8a39091880 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:21.351724 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4344bb-56fb-49c3-900e-3f8a39091880 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:21.429597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61142a8-1719-430f-8b54-430d61a01ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:21.430365 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61142a8-1719-430f-8b54-430d61a01ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:21.430684 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61142a8-1719-430f-8b54-430d61a01ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:21.430995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61142a8-1719-430f-8b54-430d61a01ae7 admin admin] PATH_INFO: `/v3/users/2fc6936eab6445609577b368a582f6cd` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:21.432249 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61142a8-1719-430f-8b54-430d61a01ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fc6936eab6445609577b368a582f6cd)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:21.434394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61142a8-1719-430f-8b54-430d61a01ae7 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:21.495098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e61142a8-1719-430f-8b54-430d61a01ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fc6936eab6445609577b368a582f6cd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:21.505128 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e61142a8-1719-430f-8b54-430d61a01ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fc6936eab6445609577b368a582f6cd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:21.519670 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e61142a8-1719-430f-8b54-430d61a01ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fc6936eab6445609577b368a582f6cd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:21.520455 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e61142a8-1719-430f-8b54-430d61a01ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fc6936eab6445609577b368a582f6cd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:21.521091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e61142a8-1719-430f-8b54-430d61a01ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fc6936eab6445609577b368a582f6cd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:21.538764 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1383/2746] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:21 2022] DELETE /identity/v3/users/2fc6936eab6445609577b368a582f6cd => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:21.983635 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cb738-b15d-4c8f-a032-0f30f176e445 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:21.985350 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7f0cb738-b15d-4c8f-a032-0f30f176e445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:22.012896 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cb738-b15d-4c8f-a032-0f30f176e445 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:22.114279 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7faab38-d383-48e8-8e03-a908408907df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:22.115356 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faab38-d383-48e8-8e03-a908408907df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:22.115834 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faab38-d383-48e8-8e03-a908408907df admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:22.116306 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faab38-d383-48e8-8e03-a908408907df admin admin] PATH_INFO: `/v3/projects/c311dae6f28a41b4a79038eab36c6fe9` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:22.118262 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7faab38-d383-48e8-8e03-a908408907df admin admin] RBAC: Authorizing `identity:delete_project(project_id=c311dae6f28a41b4a79038eab36c6fe9)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:22.121929 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7faab38-d383-48e8-8e03-a908408907df admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:22.174594 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:22.184413 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d7faab38-d383-48e8-8e03-a908408907df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c311dae6f28a41b4a79038eab36c6fe9', 'request_id': 'req-d7faab38-d383-48e8-8e03-a908408907df'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:22.199722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d7faab38-d383-48e8-8e03-a908408907df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c311dae6f28a41b4a79038eab36c6fe9', 'request_id': 'req-d7faab38-d383-48e8-8e03-a908408907df'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:22.209935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d7faab38-d383-48e8-8e03-a908408907df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c311dae6f28a41b4a79038eab36c6fe9', 'request_id': 'req-d7faab38-d383-48e8-8e03-a908408907df'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:22.222689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d7faab38-d383-48e8-8e03-a908408907df admin admin] The token cache is being invalidate because project c311dae6f28a41b4a79038eab36c6fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:22.223017 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d7faab38-d383-48e8-8e03-a908408907df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:22.223691 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d7faab38-d383-48e8-8e03-a908408907df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:22.225241 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1364/2747] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:21 2022] DELETE /identity/v3/projects/c311dae6f28a41b4a79038eab36c6fe9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:22.230824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c14bac-3b55-4814-b0fb-ed523568464b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:22.231119 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c14bac-3b55-4814-b0fb-ed523568464b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:22.231392 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c14bac-3b55-4814-b0fb-ed523568464b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:22.258109 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e2c14bac-3b55-4814-b0fb-ed523568464b None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:22.259761 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e2c14bac-3b55-4814-b0fb-ed523568464b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:22.347902 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1384/2748] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:22.356455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590b54e-996f-4f82-aa94-68a6c022d4b4 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:22.356735 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590b54e-996f-4f82-aa94-68a6c022d4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:22.357002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590b54e-996f-4f82-aa94-68a6c022d4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:22.380118 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5590b54e-996f-4f82-aa94-68a6c022d4b4 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:22.381417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5590b54e-996f-4f82-aa94-68a6c022d4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:22.390028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1365/2749] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:22.395167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c14bac-3b55-4814-b0fb-ed523568464b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:22.412380 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c14bac-3b55-4814-b0fb-ed523568464b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:22.418620 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba98417-967a-448e-a444-5a21e31b03df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:22.419261 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba98417-967a-448e-a444-5a21e31b03df admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:22.419540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba98417-967a-448e-a444-5a21e31b03df admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:22.419810 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba98417-967a-448e-a444-5a21e31b03df admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:22.420483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba98417-967a-448e-a444-5a21e31b03df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:40:22.420785 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba98417-967a-448e-a444-5a21e31b03df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:22.422494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba98417-967a-448e-a444-5a21e31b03df admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:22.425873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:22.438538 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1385/2750] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:40:22.443051 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590b54e-996f-4f82-aa94-68a6c022d4b4 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:22.453592 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590b54e-996f-4f82-aa94-68a6c022d4b4 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:22.458720 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1f0b6-f068-488a-8bb0-937bbbbc924f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:22.459338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1f0b6-f068-488a-8bb0-937bbbbc924f admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:22.459612 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1f0b6-f068-488a-8bb0-937bbbbc924f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:22.459876 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1f0b6-f068-488a-8bb0-937bbbbc924f admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:22.460529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1f0b6-f068-488a-8bb0-937bbbbc924f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:22.462500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1f0b6-f068-488a-8bb0-937bbbbc924f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:22.496054 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1366/2751] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:40:22 2022] POST /identity/v3/projects => generated 401 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:40:22.501226 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba98417-967a-448e-a444-5a21e31b03df admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:22.512576 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba98417-967a-448e-a444-5a21e31b03df admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:22.579856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64102fd-ce1b-454a-a083-328b180692cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:22.580901 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64102fd-ce1b-454a-a083-328b180692cd admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:22.581389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64102fd-ce1b-454a-a083-328b180692cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:22.581937 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64102fd-ce1b-454a-a083-328b180692cd admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:22.583001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64102fd-ce1b-454a-a083-328b180692cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:22.586180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64102fd-ce1b-454a-a083-328b180692cd admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:22.615558 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1386/2752] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:40:22 2022] POST /identity/v3/users => generated 301 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:40:22.621952 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1f0b6-f068-488a-8bb0-937bbbbc924f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:22.634168 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1f0b6-f068-488a-8bb0-937bbbbc924f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:22.639323 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7ca57-1afb-4aee-885f-df316fb4877a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:22.639979 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7ca57-1afb-4aee-885f-df316fb4877a admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:22.640289 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7ca57-1afb-4aee-885f-df316fb4877a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:22.640560 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7ca57-1afb-4aee-885f-df316fb4877a admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:22.641220 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7ca57-1afb-4aee-885f-df316fb4877a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:22.642886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7ca57-1afb-4aee-885f-df316fb4877a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:22.654771 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1367/2753] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:22.659109 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64102fd-ce1b-454a-a083-328b180692cd admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:22.669970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64102fd-ce1b-454a-a083-328b180692cd admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:22.675923 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe6f80-e2dc-4c87-84f6-fec58a5ce9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:22.676627 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe6f80-e2dc-4c87-84f6-fec58a5ce9dc admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:22.676903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe6f80-e2dc-4c87-84f6-fec58a5ce9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:22.677209 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe6f80-e2dc-4c87-84f6-fec58a5ce9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:22.677903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe6f80-e2dc-4c87-84f6-fec58a5ce9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:22.679553 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe6f80-e2dc-4c87-84f6-fec58a5ce9dc admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:22.691847 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1387/2754] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:22.697074 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7ca57-1afb-4aee-885f-df316fb4877a admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:22.708483 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7ca57-1afb-4aee-885f-df316fb4877a admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:22.715752 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5733e-fa89-4bef-8d58-653765dcee5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:22.716631 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5733e-fa89-4bef-8d58-653765dcee5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:22.716911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5733e-fa89-4bef-8d58-653765dcee5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:22.717184 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5733e-fa89-4bef-8d58-653765dcee5b admin admin] PATH_INFO: `/v3/projects/3032b917762a43e1a0fee256dec13312/users/f85e4ec55ddd4ea2b409c32c165b7bf0/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:22.736059 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5733e-fa89-4bef-8d58-653765dcee5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3032b917762a43e1a0fee256dec13312, user_id=f85e4ec55ddd4ea2b409c32c165b7bf0, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:22.739295 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5733e-fa89-4bef-8d58-653765dcee5b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:22.757200 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1368/2755] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:22 2022] PUT /identity/v3/projects/3032b917762a43e1a0fee256dec13312/users/f85e4ec55ddd4ea2b409c32c165b7bf0/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:22.768046 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3713616-d5f3-4f8c-a616-05f8fbf826fd None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:22.768444 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3713616-d5f3-4f8c-a616-05f8fbf826fd None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:22.768706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3713616-d5f3-4f8c-a616-05f8fbf826fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:22.801028 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d3713616-d5f3-4f8c-a616-05f8fbf826fd None None] MFA Rules not processed for user `f85e4ec55ddd4ea2b409c32c165b7bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:22.802448 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d3713616-d5f3-4f8c-a616-05f8fbf826fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:22.873596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1388/2756] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:22 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:22.878231 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5733e-fa89-4bef-8d58-653765dcee5b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:22.973634 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5733e-fa89-4bef-8d58-653765dcee5b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:22.978598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54a2e2-5d0b-4ba6-ad1e-96dba1d4f4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:22.979225 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54a2e2-5d0b-4ba6-ad1e-96dba1d4f4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:22.979503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54a2e2-5d0b-4ba6-ad1e-96dba1d4f4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:22.979773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54a2e2-5d0b-4ba6-ad1e-96dba1d4f4f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:22.980420 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54a2e2-5d0b-4ba6-ad1e-96dba1d4f4f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:22.989420 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54a2e2-5d0b-4ba6-ad1e-96dba1d4f4f3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:23.038087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1369/2757] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:40:22 2022] POST /identity/v3/projects => generated 399 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:40:23.043432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3713616-d5f3-4f8c-a616-05f8fbf826fd None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:23.064816 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3713616-d5f3-4f8c-a616-05f8fbf826fd None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:23.193048 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e5c3-5136-468b-8a96-a4cca15fdd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:23.193983 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e5c3-5136-468b-8a96-a4cca15fdd46 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:23.194440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e5c3-5136-468b-8a96-a4cca15fdd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:23.194725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e5c3-5136-468b-8a96-a4cca15fdd46 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:23.195531 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678e5c3-5136-468b-8a96-a4cca15fdd46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:23.198148 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678e5c3-5136-468b-8a96-a4cca15fdd46 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:23.220536 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:23.236627 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1389/2758] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:40:23 2022] POST /identity/v3/users => generated 306 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:40:23.241637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54a2e2-5d0b-4ba6-ad1e-96dba1d4f4f3 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:23.260560 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54a2e2-5d0b-4ba6-ad1e-96dba1d4f4f3 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:23.269296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96af490-0543-4c23-9c30-5b86751e490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:23.270583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96af490-0543-4c23-9c30-5b86751e490e admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:23.271175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96af490-0543-4c23-9c30-5b86751e490e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:23.271748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96af490-0543-4c23-9c30-5b86751e490e admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:23.273027 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96af490-0543-4c23-9c30-5b86751e490e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:23.276033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96af490-0543-4c23-9c30-5b86751e490e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:23.296418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1370/2759] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:40:23.301797 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e5c3-5136-468b-8a96-a4cca15fdd46 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:23.317924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e5c3-5136-468b-8a96-a4cca15fdd46 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:23.323708 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922d418-9aab-40ec-b185-be162b84ebed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:23.324477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922d418-9aab-40ec-b185-be162b84ebed admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:23.324728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922d418-9aab-40ec-b185-be162b84ebed admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:23.325151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922d418-9aab-40ec-b185-be162b84ebed admin admin] PATH_INFO: `/v3/projects/fe6517c97dd4453eb1d5858311602f42/users/ada17d3d88664b07bdb6077eaa78ac00/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:23.346562 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922d418-9aab-40ec-b185-be162b84ebed admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6517c97dd4453eb1d5858311602f42, user_id=ada17d3d88664b07bdb6077eaa78ac00, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:23.349747 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922d418-9aab-40ec-b185-be162b84ebed admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:23.369561 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1390/2760] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:23 2022] PUT /identity/v3/projects/fe6517c97dd4453eb1d5858311602f42/users/ada17d3d88664b07bdb6077eaa78ac00/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:23.374201 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96af490-0543-4c23-9c30-5b86751e490e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:23.386127 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96af490-0543-4c23-9c30-5b86751e490e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:23.434417 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:23.462509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb7759-cdd3-4745-96c4-40dbbe00d8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:23.463138 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb7759-cdd3-4745-96c4-40dbbe00d8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:23.463412 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb7759-cdd3-4745-96c4-40dbbe00d8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:23.463682 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb7759-cdd3-4745-96c4-40dbbe00d8d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:23.464339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb7759-cdd3-4745-96c4-40dbbe00d8d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:23.466116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb7759-cdd3-4745-96c4-40dbbe00d8d3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:23.478140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1371/2761] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:40:23.484725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922d418-9aab-40ec-b185-be162b84ebed admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:23.504423 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922d418-9aab-40ec-b185-be162b84ebed admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:23.511571 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23c321-7118-43c7-8d64-6736f4eeda62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:23.512297 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23c321-7118-43c7-8d64-6736f4eeda62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:23.512575 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23c321-7118-43c7-8d64-6736f4eeda62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:23.512996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23c321-7118-43c7-8d64-6736f4eeda62 admin admin] PATH_INFO: `/v3/projects/fe6517c97dd4453eb1d5858311602f42/users/ada17d3d88664b07bdb6077eaa78ac00/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:23.515498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23c321-7118-43c7-8d64-6736f4eeda62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6517c97dd4453eb1d5858311602f42, user_id=ada17d3d88664b07bdb6077eaa78ac00, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:23.522096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23c321-7118-43c7-8d64-6736f4eeda62 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:23.535165 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1391/2762] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:23 2022] PUT /identity/v3/projects/fe6517c97dd4453eb1d5858311602f42/users/ada17d3d88664b07bdb6077eaa78ac00/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:23.608638 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f76e70-030f-46b3-9df8-89fe636e50b5 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:23.609147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f76e70-030f-46b3-9df8-89fe636e50b5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:23.609695 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f76e70-030f-46b3-9df8-89fe636e50b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:23.653294 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-39f76e70-030f-46b3-9df8-89fe636e50b5 None None] MFA Rules not processed for user `ada17d3d88664b07bdb6077eaa78ac00`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:23.654949 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-39f76e70-030f-46b3-9df8-89fe636e50b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:23.764145 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1372/2763] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:23 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:23.777656 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23c321-7118-43c7-8d64-6736f4eeda62 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:23.779641 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-af23c321-7118-43c7-8d64-6736f4eeda62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:23.857666 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23c321-7118-43c7-8d64-6736f4eeda62 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:23.861717 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e384c-d5c8-4ce5-96f6-248f0ffd1150 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:23.862340 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e384c-d5c8-4ce5-96f6-248f0ffd1150 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:23.862615 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e384c-d5c8-4ce5-96f6-248f0ffd1150 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:23.862885 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e384c-d5c8-4ce5-96f6-248f0ffd1150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:23.873993 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e384c-d5c8-4ce5-96f6-248f0ffd1150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:23.875710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e384c-d5c8-4ce5-96f6-248f0ffd1150 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:23.887292 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1392/2764] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:23 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:23.985259 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f76e70-030f-46b3-9df8-89fe636e50b5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:23.998798 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f76e70-030f-46b3-9df8-89fe636e50b5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:24.003580 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1b90a-e24e-4d92-91ab-cdc080880ac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:24.004450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1b90a-e24e-4d92-91ab-cdc080880ac0 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:24.004827 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1b90a-e24e-4d92-91ab-cdc080880ac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:24.005263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1b90a-e24e-4d92-91ab-cdc080880ac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:24.075051 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1b90a-e24e-4d92-91ab-cdc080880ac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:24.076665 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1b90a-e24e-4d92-91ab-cdc080880ac0 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:24.086504 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1373/2765] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:23 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:40:28.553866 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e384c-d5c8-4ce5-96f6-248f0ffd1150 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:28.657348 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e384c-d5c8-4ce5-96f6-248f0ffd1150 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:28.662947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9925bf-707e-4f56-8394-93369b310e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:28.663686 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9925bf-707e-4f56-8394-93369b310e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:28.663848 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9925bf-707e-4f56-8394-93369b310e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:28.664219 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9925bf-707e-4f56-8394-93369b310e17 admin admin] PATH_INFO: `/v3/users/f85e4ec55ddd4ea2b409c32c165b7bf0` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:28.666890 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9925bf-707e-4f56-8394-93369b310e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85e4ec55ddd4ea2b409c32c165b7bf0)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:28.670820 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9925bf-707e-4f56-8394-93369b310e17 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:28.746926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2d9925bf-707e-4f56-8394-93369b310e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85e4ec55ddd4ea2b409c32c165b7bf0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:28.759318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2d9925bf-707e-4f56-8394-93369b310e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85e4ec55ddd4ea2b409c32c165b7bf0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:28.766944 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:28.778403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2d9925bf-707e-4f56-8394-93369b310e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85e4ec55ddd4ea2b409c32c165b7bf0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:28.780456 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2d9925bf-707e-4f56-8394-93369b310e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85e4ec55ddd4ea2b409c32c165b7bf0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:28.781940 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2d9925bf-707e-4f56-8394-93369b310e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85e4ec55ddd4ea2b409c32c165b7bf0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:28.803912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1393/2766] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:28 2022] DELETE /identity/v3/users/f85e4ec55ddd4ea2b409c32c165b7bf0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:40:28.809353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebf42a-fbe1-4adf-8d1d-61280c112268 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:28.810195 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebf42a-fbe1-4adf-8d1d-61280c112268 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:28.810195 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebf42a-fbe1-4adf-8d1d-61280c112268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:28.841865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-37ebf42a-fbe1-4adf-8d1d-61280c112268 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:28.844047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-37ebf42a-fbe1-4adf-8d1d-61280c112268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:28.927387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:28.939773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1374/2767] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:28.950851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9925bf-707e-4f56-8394-93369b310e17 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:28.952554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2d9925bf-707e-4f56-8394-93369b310e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:29.044223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9925bf-707e-4f56-8394-93369b310e17 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:29.055614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60cb39-6d64-4065-9360-e0b91f1a0d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:29.056900 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60cb39-6d64-4065-9360-e0b91f1a0d9b service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:29.057628 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60cb39-6d64-4065-9360-e0b91f1a0d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:29.058054 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60cb39-6d64-4065-9360-e0b91f1a0d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:29.074070 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60cb39-6d64-4065-9360-e0b91f1a0d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:29.075936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60cb39-6d64-4065-9360-e0b91f1a0d9b service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:29.087522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1394/2768] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:40:29.447692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebf42a-fbe1-4adf-8d1d-61280c112268 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:29.450435 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-37ebf42a-fbe1-4adf-8d1d-61280c112268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:29.471107 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebf42a-fbe1-4adf-8d1d-61280c112268 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:29.481795 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:29.482984 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:29.483365 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:29.484076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97 admin admin] PATH_INFO: `/v3/projects/3032b917762a43e1a0fee256dec13312` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:29.486241 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3032b917762a43e1a0fee256dec13312)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:29.489652 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:29.566744 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3032b917762a43e1a0fee256dec13312', 'request_id': 'req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:29.578941 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3032b917762a43e1a0fee256dec13312', 'request_id': 'req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:29.594433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3032b917762a43e1a0fee256dec13312', 'request_id': 'req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:29.615914 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97 admin admin] The token cache is being invalidate because project 3032b917762a43e1a0fee256dec13312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:29.615914 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:29.616273 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:29.618181 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1375/2769] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:29 2022] DELETE /identity/v3/projects/3032b917762a43e1a0fee256dec13312 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:29.622896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60cb39-6d64-4065-9360-e0b91f1a0d9b service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:29.634414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60cb39-6d64-4065-9360-e0b91f1a0d9b service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:29.724878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f1855-ab23-4fa1-826d-b62b0668a932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:29.724878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f1855-ab23-4fa1-826d-b62b0668a932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:29.724878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f1855-ab23-4fa1-826d-b62b0668a932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:29.724878 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f1855-ab23-4fa1-826d-b62b0668a932 admin admin] PATH_INFO: `/v3/users/ada17d3d88664b07bdb6077eaa78ac00` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:29.727542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f1855-ab23-4fa1-826d-b62b0668a932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada17d3d88664b07bdb6077eaa78ac00)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:29.729940 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f1855-ab23-4fa1-826d-b62b0668a932 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:29.805732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3c7f1855-ab23-4fa1-826d-b62b0668a932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada17d3d88664b07bdb6077eaa78ac00'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:29.820115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3c7f1855-ab23-4fa1-826d-b62b0668a932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada17d3d88664b07bdb6077eaa78ac00'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:29.847174 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3c7f1855-ab23-4fa1-826d-b62b0668a932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada17d3d88664b07bdb6077eaa78ac00'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:29.849068 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3c7f1855-ab23-4fa1-826d-b62b0668a932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada17d3d88664b07bdb6077eaa78ac00'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:29.850327 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3c7f1855-ab23-4fa1-826d-b62b0668a932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada17d3d88664b07bdb6077eaa78ac00'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:29.863465 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:29.873206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1395/2770] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:29 2022] DELETE /identity/v3/users/ada17d3d88664b07bdb6077eaa78ac00 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:40:30.331598 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:30.333859 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:30.367272 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad5b64-fc79-4bd8-a9d0-50d66fe31d97 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:30.465997 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481d613-be81-4e3e-a2c9-7eeb3dde25a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:30.466676 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481d613-be81-4e3e-a2c9-7eeb3dde25a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:30.466957 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481d613-be81-4e3e-a2c9-7eeb3dde25a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:30.467236 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481d613-be81-4e3e-a2c9-7eeb3dde25a2 admin admin] PATH_INFO: `/v3/projects/fe6517c97dd4453eb1d5858311602f42` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:30.468618 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481d613-be81-4e3e-a2c9-7eeb3dde25a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6517c97dd4453eb1d5858311602f42)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:30.470713 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481d613-be81-4e3e-a2c9-7eeb3dde25a2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:30.531814 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c481d613-be81-4e3e-a2c9-7eeb3dde25a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6517c97dd4453eb1d5858311602f42', 'request_id': 'req-c481d613-be81-4e3e-a2c9-7eeb3dde25a2'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:30.543057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c481d613-be81-4e3e-a2c9-7eeb3dde25a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6517c97dd4453eb1d5858311602f42', 'request_id': 'req-c481d613-be81-4e3e-a2c9-7eeb3dde25a2'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:30.551902 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c481d613-be81-4e3e-a2c9-7eeb3dde25a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6517c97dd4453eb1d5858311602f42', 'request_id': 'req-c481d613-be81-4e3e-a2c9-7eeb3dde25a2'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:30.565157 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c481d613-be81-4e3e-a2c9-7eeb3dde25a2 admin admin] The token cache is being invalidate because project fe6517c97dd4453eb1d5858311602f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:30.565587 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c481d613-be81-4e3e-a2c9-7eeb3dde25a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:30.566450 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c481d613-be81-4e3e-a2c9-7eeb3dde25a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:30.568433 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1376/2771] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:30 2022] DELETE /identity/v3/projects/fe6517c97dd4453eb1d5858311602f42 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:30.573841 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e10f12-6424-4cce-8655-60d156d30e75 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:30.574361 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e10f12-6424-4cce-8655-60d156d30e75 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:30.574828 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e10f12-6424-4cce-8655-60d156d30e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:30.600245 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-17e10f12-6424-4cce-8655-60d156d30e75 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:30.601681 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-17e10f12-6424-4cce-8655-60d156d30e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:30.684093 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1396/2772] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:30.692612 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67913f-939a-4d15-8bb2-7517c2c958eb None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:30.693184 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67913f-939a-4d15-8bb2-7517c2c958eb None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:30.693597 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67913f-939a-4d15-8bb2-7517c2c958eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:30.721344 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7d67913f-939a-4d15-8bb2-7517c2c958eb None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:30.722782 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7d67913f-939a-4d15-8bb2-7517c2c958eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:30.731746 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1377/2773] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:30.736310 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e10f12-6424-4cce-8655-60d156d30e75 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:30.747129 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e10f12-6424-4cce-8655-60d156d30e75 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:30.752317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a4d63-59e7-49a1-9437-b4bf3dbd50fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:30.753899 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a4d63-59e7-49a1-9437-b4bf3dbd50fd admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:30.754238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a4d63-59e7-49a1-9437-b4bf3dbd50fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:30.754535 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a4d63-59e7-49a1-9437-b4bf3dbd50fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:30.755077 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a4d63-59e7-49a1-9437-b4bf3dbd50fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:40:30.755371 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a4d63-59e7-49a1-9437-b4bf3dbd50fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:30.757006 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a4d63-59e7-49a1-9437-b4bf3dbd50fd admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:30.769430 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1397/2774] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:40:30.774137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67913f-939a-4d15-8bb2-7517c2c958eb None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:30.785164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67913f-939a-4d15-8bb2-7517c2c958eb None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:30.790309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c3f0b-3668-4959-b6d6-4cf87e786931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:30.790919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c3f0b-3668-4959-b6d6-4cf87e786931 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:30.791192 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c3f0b-3668-4959-b6d6-4cf87e786931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:30.791458 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c3f0b-3668-4959-b6d6-4cf87e786931 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:30.792127 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c3f0b-3668-4959-b6d6-4cf87e786931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:30.794101 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c3f0b-3668-4959-b6d6-4cf87e786931 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:30.799387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:30.833143 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1378/2775] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:40:30 2022] POST /identity/v3/projects => generated 407 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:40:30.834462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a4d63-59e7-49a1-9437-b4bf3dbd50fd admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:30.850154 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a4d63-59e7-49a1-9437-b4bf3dbd50fd admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:30.948640 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba14ddd-f014-494d-81bf-92af7fd31fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:30.950557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba14ddd-f014-494d-81bf-92af7fd31fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:30.950890 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba14ddd-f014-494d-81bf-92af7fd31fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:30.951321 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba14ddd-f014-494d-81bf-92af7fd31fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:30.952464 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba14ddd-f014-494d-81bf-92af7fd31fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:30.954846 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba14ddd-f014-494d-81bf-92af7fd31fd3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:30.983440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1398/2776] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:40:30 2022] POST /identity/v3/users => generated 304 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:40:30.989296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c3f0b-3668-4959-b6d6-4cf87e786931 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:31.001218 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c3f0b-3668-4959-b6d6-4cf87e786931 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:31.006701 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41821674-1c06-4074-8190-74076a0692b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:31.007304 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41821674-1c06-4074-8190-74076a0692b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:31.007591 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41821674-1c06-4074-8190-74076a0692b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:31.007860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41821674-1c06-4074-8190-74076a0692b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:31.008552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41821674-1c06-4074-8190-74076a0692b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:31.010273 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41821674-1c06-4074-8190-74076a0692b9 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:31.022006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1379/2777] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:31.026749 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba14ddd-f014-494d-81bf-92af7fd31fd3 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:31.038611 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba14ddd-f014-494d-81bf-92af7fd31fd3 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:31.045142 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456884b-aa34-4849-af41-fbfd98a9a64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:31.046248 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456884b-aa34-4849-af41-fbfd98a9a64f admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:31.046793 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456884b-aa34-4849-af41-fbfd98a9a64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:31.047431 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456884b-aa34-4849-af41-fbfd98a9a64f admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:31.048576 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456884b-aa34-4849-af41-fbfd98a9a64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:31.052118 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456884b-aa34-4849-af41-fbfd98a9a64f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:31.073226 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1399/2778] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:40:31.077836 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41821674-1c06-4074-8190-74076a0692b9 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:31.089130 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41821674-1c06-4074-8190-74076a0692b9 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:31.094748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207accc-a476-487f-9014-b63debbfd32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:31.095745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207accc-a476-487f-9014-b63debbfd32f admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:31.095889 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207accc-a476-487f-9014-b63debbfd32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:31.096158 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207accc-a476-487f-9014-b63debbfd32f admin admin] PATH_INFO: `/v3/projects/aaec690b4e3245a893b906d82091e827/users/eedf8ead6bf744e8854fc79c2679c45f/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:31.113855 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207accc-a476-487f-9014-b63debbfd32f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaec690b4e3245a893b906d82091e827, user_id=eedf8ead6bf744e8854fc79c2679c45f, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:31.116557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207accc-a476-487f-9014-b63debbfd32f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:31.132515 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1380/2779] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:31 2022] PUT /identity/v3/projects/aaec690b4e3245a893b906d82091e827/users/eedf8ead6bf744e8854fc79c2679c45f/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:31.143662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a91d0-3b9a-4513-bf80-3532eefd7f50 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:31.143974 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a91d0-3b9a-4513-bf80-3532eefd7f50 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:31.144204 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a91d0-3b9a-4513-bf80-3532eefd7f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:31.177328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-8c2a91d0-3b9a-4513-bf80-3532eefd7f50 None None] MFA Rules not processed for user `eedf8ead6bf744e8854fc79c2679c45f`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:31.178610 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8c2a91d0-3b9a-4513-bf80-3532eefd7f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:31.258285 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:31.274323 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1400/2780] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:31 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:31.276474 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207accc-a476-487f-9014-b63debbfd32f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:31.380178 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207accc-a476-487f-9014-b63debbfd32f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:31.388428 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fe756-8301-4388-b293-97c116aa09fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:31.389380 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fe756-8301-4388-b293-97c116aa09fe admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:31.389811 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fe756-8301-4388-b293-97c116aa09fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:31.390278 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fe756-8301-4388-b293-97c116aa09fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:31.391404 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fe756-8301-4388-b293-97c116aa09fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:31.395104 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fe756-8301-4388-b293-97c116aa09fe admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:31.445281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1381/2781] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:40:31 2022] POST /identity/v3/projects => generated 409 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:40:31.450777 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a91d0-3b9a-4513-bf80-3532eefd7f50 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:31.466895 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a91d0-3b9a-4513-bf80-3532eefd7f50 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:31.560014 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f095cf-55a4-4a3b-9e1d-274ae5b9db77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:31.560675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f095cf-55a4-4a3b-9e1d-274ae5b9db77 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:31.560951 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f095cf-55a4-4a3b-9e1d-274ae5b9db77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:31.561219 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f095cf-55a4-4a3b-9e1d-274ae5b9db77 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:31.561913 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f095cf-55a4-4a3b-9e1d-274ae5b9db77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:31.563940 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f095cf-55a4-4a3b-9e1d-274ae5b9db77 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:31.592148 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1401/2782] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:40:31 2022] POST /identity/v3/users => generated 311 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:40:31.596601 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fe756-8301-4388-b293-97c116aa09fe admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:31.609237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fe756-8301-4388-b293-97c116aa09fe admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:31.616864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a79dac-0bf1-4929-bef6-186a959a96e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:31.617641 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a79dac-0bf1-4929-bef6-186a959a96e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:31.618716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a79dac-0bf1-4929-bef6-186a959a96e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:31.619410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a79dac-0bf1-4929-bef6-186a959a96e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:31.621137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a79dac-0bf1-4929-bef6-186a959a96e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:31.624470 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a79dac-0bf1-4929-bef6-186a959a96e7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:31.647275 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1382/2783] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:31.654155 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f095cf-55a4-4a3b-9e1d-274ae5b9db77 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:31.674640 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f095cf-55a4-4a3b-9e1d-274ae5b9db77 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:31.684821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b363b6c-9ea5-42dc-933b-6ce00c8747c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:31.686083 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b363b6c-9ea5-42dc-933b-6ce00c8747c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:31.686560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b363b6c-9ea5-42dc-933b-6ce00c8747c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:31.687037 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b363b6c-9ea5-42dc-933b-6ce00c8747c2 admin admin] PATH_INFO: `/v3/projects/46c34b22a6604e288d7e716656b58c12/users/56ebdaca9dec456a9fdd33236934be29/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:31.715669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b363b6c-9ea5-42dc-933b-6ce00c8747c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c34b22a6604e288d7e716656b58c12, user_id=56ebdaca9dec456a9fdd33236934be29, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:31.720970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b363b6c-9ea5-42dc-933b-6ce00c8747c2 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:31.744273 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1402/2784] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:31 2022] PUT /identity/v3/projects/46c34b22a6604e288d7e716656b58c12/users/56ebdaca9dec456a9fdd33236934be29/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:40:31.750273 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a79dac-0bf1-4929-bef6-186a959a96e7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:31.761864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a79dac-0bf1-4929-bef6-186a959a96e7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:31.844466 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2843124-22f2-4424-8194-9ece501b5d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:31.845152 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2843124-22f2-4424-8194-9ece501b5d90 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:31.845536 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2843124-22f2-4424-8194-9ece501b5d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:31.845702 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2843124-22f2-4424-8194-9ece501b5d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:31.846339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2843124-22f2-4424-8194-9ece501b5d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:31.848196 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2843124-22f2-4424-8194-9ece501b5d90 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:31.860903 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1383/2785] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:31.865738 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b363b6c-9ea5-42dc-933b-6ce00c8747c2 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:31.877872 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b363b6c-9ea5-42dc-933b-6ce00c8747c2 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:31.884452 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167919f-c8df-49d0-a0b8-0d749a8a63df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:31.885494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167919f-c8df-49d0-a0b8-0d749a8a63df admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:31.885970 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167919f-c8df-49d0-a0b8-0d749a8a63df admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:31.886494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167919f-c8df-49d0-a0b8-0d749a8a63df admin admin] PATH_INFO: `/v3/projects/46c34b22a6604e288d7e716656b58c12/users/56ebdaca9dec456a9fdd33236934be29/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:31.889120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167919f-c8df-49d0-a0b8-0d749a8a63df admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c34b22a6604e288d7e716656b58c12, user_id=56ebdaca9dec456a9fdd33236934be29, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:31.892237 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167919f-c8df-49d0-a0b8-0d749a8a63df admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:31.905590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1403/2786] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:31 2022] PUT /identity/v3/projects/46c34b22a6604e288d7e716656b58c12/users/56ebdaca9dec456a9fdd33236934be29/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:40:31.918236 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179e964-c77d-4210-b398-a86b02e259d4 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:31.919176 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179e964-c77d-4210-b398-a86b02e259d4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:31.919176 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179e964-c77d-4210-b398-a86b02e259d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:31.954470 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3179e964-c77d-4210-b398-a86b02e259d4 None None] MFA Rules not processed for user `56ebdaca9dec456a9fdd33236934be29`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:31.955709 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3179e964-c77d-4210-b398-a86b02e259d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:31.966839 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:32.055845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1384/2787] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:31 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:32.070862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167919f-c8df-49d0-a0b8-0d749a8a63df admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:32.073451 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0167919f-c8df-49d0-a0b8-0d749a8a63df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:32.150980 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167919f-c8df-49d0-a0b8-0d749a8a63df admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:32.154951 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708b703-1d6b-47b6-b2f7-8c1f933257a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:32.155706 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708b703-1d6b-47b6-b2f7-8c1f933257a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:32.155896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708b703-1d6b-47b6-b2f7-8c1f933257a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:32.156154 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708b703-1d6b-47b6-b2f7-8c1f933257a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:32.167048 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708b703-1d6b-47b6-b2f7-8c1f933257a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:32.168622 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708b703-1d6b-47b6-b2f7-8c1f933257a6 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:32.181769 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1404/2788] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:32 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:32.414670 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179e964-c77d-4210-b398-a86b02e259d4 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:32.427698 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179e964-c77d-4210-b398-a86b02e259d4 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:32.435781 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403e497-d5b7-44cb-aac4-6a5fc01ae574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:32.436112 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403e497-d5b7-44cb-aac4-6a5fc01ae574 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:32.436432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403e497-d5b7-44cb-aac4-6a5fc01ae574 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:32.436773 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403e497-d5b7-44cb-aac4-6a5fc01ae574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:32.521701 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403e497-d5b7-44cb-aac4-6a5fc01ae574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:32.523156 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403e497-d5b7-44cb-aac4-6a5fc01ae574 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:32.533432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1385/2789] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:32 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:38.593133 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708b703-1d6b-47b6-b2f7-8c1f933257a6 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:38.678879 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:38.702114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708b703-1d6b-47b6-b2f7-8c1f933257a6 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:38.710542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a56f12-f7d1-4e78-94ad-b9ac5cf8df6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:38.711658 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a56f12-f7d1-4e78-94ad-b9ac5cf8df6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:38.712167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a56f12-f7d1-4e78-94ad-b9ac5cf8df6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:38.712673 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a56f12-f7d1-4e78-94ad-b9ac5cf8df6b admin admin] PATH_INFO: `/v3/users/eedf8ead6bf744e8854fc79c2679c45f` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:38.714953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a56f12-f7d1-4e78-94ad-b9ac5cf8df6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eedf8ead6bf744e8854fc79c2679c45f)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:38.719028 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a56f12-f7d1-4e78-94ad-b9ac5cf8df6b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:38.818887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e8a56f12-f7d1-4e78-94ad-b9ac5cf8df6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eedf8ead6bf744e8854fc79c2679c45f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:38.835897 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e8a56f12-f7d1-4e78-94ad-b9ac5cf8df6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eedf8ead6bf744e8854fc79c2679c45f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:38.862135 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e8a56f12-f7d1-4e78-94ad-b9ac5cf8df6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eedf8ead6bf744e8854fc79c2679c45f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:38.863020 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e8a56f12-f7d1-4e78-94ad-b9ac5cf8df6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eedf8ead6bf744e8854fc79c2679c45f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:38.863798 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e8a56f12-f7d1-4e78-94ad-b9ac5cf8df6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eedf8ead6bf744e8854fc79c2679c45f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:38.889311 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1405/2790] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:38 2022] DELETE /identity/v3/users/eedf8ead6bf744e8854fc79c2679c45f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:38.896612 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34e922-a814-4b8b-9ca2-0007e73fcd6a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:38.897571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34e922-a814-4b8b-9ca2-0007e73fcd6a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:38.897571 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34e922-a814-4b8b-9ca2-0007e73fcd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:38.920447 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-aa34e922-a814-4b8b-9ca2-0007e73fcd6a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:38.922525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-aa34e922-a814-4b8b-9ca2-0007e73fcd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:39.024420 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1386/2791] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:39.037139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a56f12-f7d1-4e78-94ad-b9ac5cf8df6b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:39.039545 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e8a56f12-f7d1-4e78-94ad-b9ac5cf8df6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:39.137725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a56f12-f7d1-4e78-94ad-b9ac5cf8df6b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:39.142654 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2d0c4-e1fc-422c-8d7b-7bf489c93e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:39.143355 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2d0c4-e1fc-422c-8d7b-7bf489c93e26 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:39.143969 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2d0c4-e1fc-422c-8d7b-7bf489c93e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:39.144416 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2d0c4-e1fc-422c-8d7b-7bf489c93e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:39.156250 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2d0c4-e1fc-422c-8d7b-7bf489c93e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:39.158501 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2d0c4-e1fc-422c-8d7b-7bf489c93e26 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:39.171959 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1406/2792] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:39.619781 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34e922-a814-4b8b-9ca2-0007e73fcd6a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:39.622287 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-aa34e922-a814-4b8b-9ca2-0007e73fcd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:39.643071 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34e922-a814-4b8b-9ca2-0007e73fcd6a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:39.653989 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:39.656664 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:39.657694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:39.658202 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23 admin admin] PATH_INFO: `/v3/projects/aaec690b4e3245a893b906d82091e827` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:39.660581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaec690b4e3245a893b906d82091e827)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:39.664667 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:39.738473 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:39.749738 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaec690b4e3245a893b906d82091e827', 'request_id': 'req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:39.761823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaec690b4e3245a893b906d82091e827', 'request_id': 'req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:39.775693 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaec690b4e3245a893b906d82091e827', 'request_id': 'req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:39.795483 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23 admin admin] The token cache is being invalidate because project aaec690b4e3245a893b906d82091e827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:39.796073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:39.797558 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:39.801214 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1387/2793] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:39 2022] DELETE /identity/v3/projects/aaec690b4e3245a893b906d82091e827 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:39.808154 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2d0c4-e1fc-422c-8d7b-7bf489c93e26 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:39.828638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2d0c4-e1fc-422c-8d7b-7bf489c93e26 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:39.913021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a1b75-c9aa-4984-bef7-d959d7f4009c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:39.913618 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1b75-c9aa-4984-bef7-d959d7f4009c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:39.913927 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1b75-c9aa-4984-bef7-d959d7f4009c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:39.914390 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1b75-c9aa-4984-bef7-d959d7f4009c admin admin] PATH_INFO: `/v3/users/56ebdaca9dec456a9fdd33236934be29` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:39.916156 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a1b75-c9aa-4984-bef7-d959d7f4009c admin admin] RBAC: Authorizing `identity:delete_user(user_id=56ebdaca9dec456a9fdd33236934be29)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:39.919216 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a1b75-c9aa-4984-bef7-d959d7f4009c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:39.946522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:39.990146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-091a1b75-c9aa-4984-bef7-d959d7f4009c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ebdaca9dec456a9fdd33236934be29'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:40.000559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-091a1b75-c9aa-4984-bef7-d959d7f4009c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ebdaca9dec456a9fdd33236934be29'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:40.019591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-091a1b75-c9aa-4984-bef7-d959d7f4009c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ebdaca9dec456a9fdd33236934be29'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:40.020441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-091a1b75-c9aa-4984-bef7-d959d7f4009c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ebdaca9dec456a9fdd33236934be29'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:40.021262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-091a1b75-c9aa-4984-bef7-d959d7f4009c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ebdaca9dec456a9fdd33236934be29'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:40.036579 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1407/2794] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:39 2022] DELETE /identity/v3/users/56ebdaca9dec456a9fdd33236934be29 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:40.458742 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:40.461226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:40.486353 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697894e2-7c2b-4aea-bf72-e4f1f19b2b23 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:40.591847 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57dddc-d6ab-49e9-8263-0aed6bf6360c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:40.592918 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57dddc-d6ab-49e9-8263-0aed6bf6360c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:40.593385 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57dddc-d6ab-49e9-8263-0aed6bf6360c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:40.593886 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57dddc-d6ab-49e9-8263-0aed6bf6360c admin admin] PATH_INFO: `/v3/projects/46c34b22a6604e288d7e716656b58c12` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:40.596123 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57dddc-d6ab-49e9-8263-0aed6bf6360c admin admin] RBAC: Authorizing `identity:delete_project(project_id=46c34b22a6604e288d7e716656b58c12)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:40.600022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57dddc-d6ab-49e9-8263-0aed6bf6360c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:40.675865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fa57dddc-d6ab-49e9-8263-0aed6bf6360c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46c34b22a6604e288d7e716656b58c12', 'request_id': 'req-fa57dddc-d6ab-49e9-8263-0aed6bf6360c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:40.690940 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fa57dddc-d6ab-49e9-8263-0aed6bf6360c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46c34b22a6604e288d7e716656b58c12', 'request_id': 'req-fa57dddc-d6ab-49e9-8263-0aed6bf6360c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:40.704497 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fa57dddc-d6ab-49e9-8263-0aed6bf6360c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46c34b22a6604e288d7e716656b58c12', 'request_id': 'req-fa57dddc-d6ab-49e9-8263-0aed6bf6360c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:40.726458 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fa57dddc-d6ab-49e9-8263-0aed6bf6360c admin admin] The token cache is being invalidate because project 46c34b22a6604e288d7e716656b58c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:40.727042 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fa57dddc-d6ab-49e9-8263-0aed6bf6360c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:40.728334 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fa57dddc-d6ab-49e9-8263-0aed6bf6360c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:40.731263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1388/2795] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:40 2022] DELETE /identity/v3/projects/46c34b22a6604e288d7e716656b58c12 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:40.739596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8f0a9-ea52-4f6b-ac70-9e49a8df8437 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:40.740080 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8f0a9-ea52-4f6b-ac70-9e49a8df8437 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:40.740569 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8f0a9-ea52-4f6b-ac70-9e49a8df8437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:40.772900 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b8a8f0a9-ea52-4f6b-ac70-9e49a8df8437 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:40.774296 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b8a8f0a9-ea52-4f6b-ac70-9e49a8df8437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:40.880754 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1408/2796] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:40.894771 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df74d9-e9db-46a6-8aee-502476e5d142 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:40.895239 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df74d9-e9db-46a6-8aee-502476e5d142 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:40.895712 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df74d9-e9db-46a6-8aee-502476e5d142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:40.936451 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-69df74d9-e9db-46a6-8aee-502476e5d142 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:40.938406 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-69df74d9-e9db-46a6-8aee-502476e5d142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:40.952909 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1389/2797] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:40.960328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8f0a9-ea52-4f6b-ac70-9e49a8df8437 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:40.976987 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8f0a9-ea52-4f6b-ac70-9e49a8df8437 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:40.986520 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197dc918-ef83-4d42-be97-017abb609b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:40.987579 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc918-ef83-4d42-be97-017abb609b02 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:40.988102 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc918-ef83-4d42-be97-017abb609b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:40.988595 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc918-ef83-4d42-be97-017abb609b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:40.989871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197dc918-ef83-4d42-be97-017abb609b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:40:40.990401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197dc918-ef83-4d42-be97-017abb609b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:40.993503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197dc918-ef83-4d42-be97-017abb609b02 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:41.017764 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1409/2798] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:40:41.025052 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df74d9-e9db-46a6-8aee-502476e5d142 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:41.041139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df74d9-e9db-46a6-8aee-502476e5d142 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:41.049174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7a2f6-2de2-43bf-9f91-268bb5547561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:41.050318 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a2f6-2de2-43bf-9f91-268bb5547561 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:41.050850 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a2f6-2de2-43bf-9f91-268bb5547561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:41.051313 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a2f6-2de2-43bf-9f91-268bb5547561 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:41.052516 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7a2f6-2de2-43bf-9f91-268bb5547561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:41.056486 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7a2f6-2de2-43bf-9f91-268bb5547561 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:41.108081 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1390/2799] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:40:41 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:40:41.113629 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197dc918-ef83-4d42-be97-017abb609b02 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:41.129516 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197dc918-ef83-4d42-be97-017abb609b02 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:41.228366 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5527e01-f765-4f44-a29b-4f1352a0440a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:41.229457 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5527e01-f765-4f44-a29b-4f1352a0440a admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:41.229995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5527e01-f765-4f44-a29b-4f1352a0440a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:41.230503 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5527e01-f765-4f44-a29b-4f1352a0440a admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:41.231808 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5527e01-f765-4f44-a29b-4f1352a0440a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:41.235887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5527e01-f765-4f44-a29b-4f1352a0440a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:41.272440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1410/2800] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:40:41 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:40:41.278097 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7a2f6-2de2-43bf-9f91-268bb5547561 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:41.295867 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7a2f6-2de2-43bf-9f91-268bb5547561 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:41.304692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a1e40-6ee7-413b-b61f-840f65b7fd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:41.305802 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a1e40-6ee7-413b-b61f-840f65b7fd80 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:41.306328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a1e40-6ee7-413b-b61f-840f65b7fd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:41.306834 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a1e40-6ee7-413b-b61f-840f65b7fd80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:41.308147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a1e40-6ee7-413b-b61f-840f65b7fd80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:41.311065 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a1e40-6ee7-413b-b61f-840f65b7fd80 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:41.332720 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1391/2801] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:41.339146 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5527e01-f765-4f44-a29b-4f1352a0440a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:41.359773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5527e01-f765-4f44-a29b-4f1352a0440a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:41.367277 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2defbdf-2c2a-4279-bad0-9300a35b8be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:41.368238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2defbdf-2c2a-4279-bad0-9300a35b8be7 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:41.368705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2defbdf-2c2a-4279-bad0-9300a35b8be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:41.369162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2defbdf-2c2a-4279-bad0-9300a35b8be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:41.370277 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2defbdf-2c2a-4279-bad0-9300a35b8be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:41.371973 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2defbdf-2c2a-4279-bad0-9300a35b8be7 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:41.374974 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:41.389046 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1411/2802] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:41.394015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a1e40-6ee7-413b-b61f-840f65b7fd80 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:41.406688 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a1e40-6ee7-413b-b61f-840f65b7fd80 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:41.414204 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c393d8-776c-47f0-8442-62681f556369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:41.415602 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c393d8-776c-47f0-8442-62681f556369 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:41.416073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c393d8-776c-47f0-8442-62681f556369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:41.416467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c393d8-776c-47f0-8442-62681f556369 admin admin] PATH_INFO: `/v3/projects/e270f9b23fc74b50bf775b56888c9b64/users/73b0cf83bb044231bd914740da6d2232/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:41.443761 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c393d8-776c-47f0-8442-62681f556369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e270f9b23fc74b50bf775b56888c9b64, user_id=73b0cf83bb044231bd914740da6d2232, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:41.447726 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c393d8-776c-47f0-8442-62681f556369 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:41.450812 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:41.468713 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1392/2803] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:41 2022] PUT /identity/v3/projects/e270f9b23fc74b50bf775b56888c9b64/users/73b0cf83bb044231bd914740da6d2232/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:41.474669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262737c7-df0c-463c-af2a-d67edbcf9b12 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:41.475115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262737c7-df0c-463c-af2a-d67edbcf9b12 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:41.475498 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262737c7-df0c-463c-af2a-d67edbcf9b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:41.507079 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-262737c7-df0c-463c-af2a-d67edbcf9b12 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:41.509186 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-262737c7-df0c-463c-af2a-d67edbcf9b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:41.611157 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1412/2804] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:41.626846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c393d8-776c-47f0-8442-62681f556369 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:41.629682 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d4c393d8-776c-47f0-8442-62681f556369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:41.722977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c393d8-776c-47f0-8442-62681f556369 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:41.727574 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22fbf5-6fab-4e3f-930b-8f41b16128b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:41.728351 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22fbf5-6fab-4e3f-930b-8f41b16128b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:41.728722 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22fbf5-6fab-4e3f-930b-8f41b16128b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:41.729099 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22fbf5-6fab-4e3f-930b-8f41b16128b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:41.745319 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22fbf5-6fab-4e3f-930b-8f41b16128b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:41.746919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22fbf5-6fab-4e3f-930b-8f41b16128b4 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:41.758434 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1393/2805] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:42.825345 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb91df-4718-4ee7-93f3-873ab3c3de3c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:42.826206 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb91df-4718-4ee7-93f3-873ab3c3de3c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:42.826410 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb91df-4718-4ee7-93f3-873ab3c3de3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:42.868525 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d2cb91df-4718-4ee7-93f3-873ab3c3de3c None None] MFA Rules not processed for user `73b0cf83bb044231bd914740da6d2232`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:42.870096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d2cb91df-4718-4ee7-93f3-873ab3c3de3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:42.965755 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1413/2806] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:40:42.983697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22fbf5-6fab-4e3f-930b-8f41b16128b4 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:42.986206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7e22fbf5-6fab-4e3f-930b-8f41b16128b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:43.104475 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22fbf5-6fab-4e3f-930b-8f41b16128b4 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:43.111521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af448c38-ce98-48d7-9d71-47a1f4d9be5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:43.112606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af448c38-ce98-48d7-9d71-47a1f4d9be5c service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:43.113081 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af448c38-ce98-48d7-9d71-47a1f4d9be5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:43.113593 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af448c38-ce98-48d7-9d71-47a1f4d9be5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:43.129019 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af448c38-ce98-48d7-9d71-47a1f4d9be5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:43.131421 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af448c38-ce98-48d7-9d71-47a1f4d9be5c service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:43.146517 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1394/2807] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:44.793527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cde90-382f-48e3-ad7d-aaec87d42557 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:44.794302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cde90-382f-48e3-ad7d-aaec87d42557 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:44.794442 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cde90-382f-48e3-ad7d-aaec87d42557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:44.830337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c22cde90-382f-48e3-ad7d-aaec87d42557 None None] MFA Rules not processed for user `73b0cf83bb044231bd914740da6d2232`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:44.832577 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c22cde90-382f-48e3-ad7d-aaec87d42557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:44.841711 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1414/2808] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:40:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:53.140560 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:INSERT=1,keystone:SELECT=54 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:54.820805 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=63 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:00.561092 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d97d3e-2a34-4841-8b19-5e232fe42b14 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:00.561689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d97d3e-2a34-4841-8b19-5e232fe42b14 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:00.561689 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d97d3e-2a34-4841-8b19-5e232fe42b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:00.589845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-37d97d3e-2a34-4841-8b19-5e232fe42b14 None None] MFA Rules not processed for user `73b0cf83bb044231bd914740da6d2232`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:00.590955 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-37d97d3e-2a34-4841-8b19-5e232fe42b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:00.599513 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1395/2809] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:41:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:41:10.583556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:17.408784 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cde90-382f-48e3-ad7d-aaec87d42557 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:17.410246 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c22cde90-382f-48e3-ad7d-aaec87d42557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:17.424017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cde90-382f-48e3-ad7d-aaec87d42557 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:17.427790 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08d7fc-19d1-49a2-b645-abb5b291b426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:17.428415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08d7fc-19d1-49a2-b645-abb5b291b426 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:17.428724 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08d7fc-19d1-49a2-b645-abb5b291b426 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:17.428867 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08d7fc-19d1-49a2-b645-abb5b291b426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:17.430727 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2d08d7fc-19d1-49a2-b645-abb5b291b426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:17.506159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08d7fc-19d1-49a2-b645-abb5b291b426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:17.507621 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08d7fc-19d1-49a2-b645-abb5b291b426 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:17.519491 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1415/2810] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:41:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:41:20.212822 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9967bc4-a51a-42d8-a68b-54f82b254e8f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:20.213459 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9967bc4-a51a-42d8-a68b-54f82b254e8f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:20.213459 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9967bc4-a51a-42d8-a68b-54f82b254e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:20.235445 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e9967bc4-a51a-42d8-a68b-54f82b254e8f None None] MFA Rules not processed for user `0327aa38835f41a7a82802f9cad2e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:20.237049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e9967bc4-a51a-42d8-a68b-54f82b254e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:20.307254 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1396/2811] 10.222.0.52 () {58 vars in 1009 bytes} [Mon Aug 29 20:41:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:41:20.371021 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08d7fc-19d1-49a2-b645-abb5b291b426 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:20.372520 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2d08d7fc-19d1-49a2-b645-abb5b291b426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:20.474169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08d7fc-19d1-49a2-b645-abb5b291b426 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:20.479378 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede29dc7-c102-43d3-bcc8-30617007623d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9791ea73d46b191ad9fc146297565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:20.480002 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede29dc7-c102-43d3-bcc8-30617007623d service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:20.480282 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede29dc7-c102-43d3-bcc8-30617007623d service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:20.480566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede29dc7-c102-43d3-bcc8-30617007623d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:20.489911 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede29dc7-c102-43d3-bcc8-30617007623d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:20.491533 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede29dc7-c102-43d3-bcc8-30617007623d service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:20.500571 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1416/2812] 10.222.0.52 () {60 vars in 1384 bytes} [Mon Aug 29 20:41:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:41:20.734397 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9967bc4-a51a-42d8-a68b-54f82b254e8f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:20.749522 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9967bc4-a51a-42d8-a68b-54f82b254e8f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:20.766796 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902de2d8-1068-46d4-9fc8-2f429782f6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:20.768357 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902de2d8-1068-46d4-9fc8-2f429782f6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:20.769500 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902de2d8-1068-46d4-9fc8-2f429782f6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:20.770325 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902de2d8-1068-46d4-9fc8-2f429782f6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:20.774780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-902de2d8-1068-46d4-9fc8-2f429782f6d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:20.812113 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902de2d8-1068-46d4-9fc8-2f429782f6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:20.814146 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902de2d8-1068-46d4-9fc8-2f429782f6d4 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:20.840965 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1397/2813] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:41:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:41:30.496789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=66 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:30.826521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=31 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:37.454058 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede29dc7-c102-43d3-bcc8-30617007623d service swift] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:37.456114 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ede29dc7-c102-43d3-bcc8-30617007623d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:37.502275 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede29dc7-c102-43d3-bcc8-30617007623d service swift] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:37.512477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09ab44-716b-41e3-afa4-1e441970e886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:37.519974 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09ab44-716b-41e3-afa4-1e441970e886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:37.521428 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09ab44-716b-41e3-afa4-1e441970e886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:37.522255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09ab44-716b-41e3-afa4-1e441970e886 admin admin] PATH_INFO: `/v3/users/fc7638f8acfa4782924319d2aba62958` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:37.525554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09ab44-716b-41e3-afa4-1e441970e886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc7638f8acfa4782924319d2aba62958)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:37.531194 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09ab44-716b-41e3-afa4-1e441970e886 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:37.659272 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-be09ab44-716b-41e3-afa4-1e441970e886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc7638f8acfa4782924319d2aba62958'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:37.676750 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-be09ab44-716b-41e3-afa4-1e441970e886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc7638f8acfa4782924319d2aba62958'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:37.711626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-be09ab44-716b-41e3-afa4-1e441970e886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc7638f8acfa4782924319d2aba62958'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:37.712458 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-be09ab44-716b-41e3-afa4-1e441970e886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc7638f8acfa4782924319d2aba62958'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:37.713083 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-be09ab44-716b-41e3-afa4-1e441970e886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc7638f8acfa4782924319d2aba62958'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:37.769187 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1417/2814] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:41:37 2022] DELETE /identity/v3/users/fc7638f8acfa4782924319d2aba62958 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:38.136031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902de2d8-1068-46d4-9fc8-2f429782f6d4 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:38.208637 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902de2d8-1068-46d4-9fc8-2f429782f6d4 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:38.408527 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065dce65-35bf-45c4-8f99-1ee36fdd8fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:38.410402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dce65-35bf-45c4-8f99-1ee36fdd8fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:38.411050 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dce65-35bf-45c4-8f99-1ee36fdd8fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:38.411519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dce65-35bf-45c4-8f99-1ee36fdd8fae admin admin] PATH_INFO: `/v3/projects/76e4fd65770747e4b9361a5b6015268b` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:38.414480 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065dce65-35bf-45c4-8f99-1ee36fdd8fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e4fd65770747e4b9361a5b6015268b)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:38.420588 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065dce65-35bf-45c4-8f99-1ee36fdd8fae admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:38.536380 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-065dce65-35bf-45c4-8f99-1ee36fdd8fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e4fd65770747e4b9361a5b6015268b', 'request_id': 'req-065dce65-35bf-45c4-8f99-1ee36fdd8fae'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:38.554730 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-065dce65-35bf-45c4-8f99-1ee36fdd8fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e4fd65770747e4b9361a5b6015268b', 'request_id': 'req-065dce65-35bf-45c4-8f99-1ee36fdd8fae'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:38.567262 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-065dce65-35bf-45c4-8f99-1ee36fdd8fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e4fd65770747e4b9361a5b6015268b', 'request_id': 'req-065dce65-35bf-45c4-8f99-1ee36fdd8fae'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:38.593990 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-065dce65-35bf-45c4-8f99-1ee36fdd8fae admin admin] The token cache is being invalidate because project 76e4fd65770747e4b9361a5b6015268b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:41:38.594716 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-065dce65-35bf-45c4-8f99-1ee36fdd8fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:38.596338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-065dce65-35bf-45c4-8f99-1ee36fdd8fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:38.599905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1398/2815] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:41:38 2022] DELETE /identity/v3/projects/76e4fd65770747e4b9361a5b6015268b => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:38.607940 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52d2de-dfad-43f5-9934-9c0807f455a7 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:38.608700 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52d2de-dfad-43f5-9934-9c0807f455a7 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:38.608985 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52d2de-dfad-43f5-9934-9c0807f455a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:38.643821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-fe52d2de-dfad-43f5-9934-9c0807f455a7 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:38.646626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fe52d2de-dfad-43f5-9934-9c0807f455a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:38.883609 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1418/2816] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:41:38.900367 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f599f2a-1daf-4fd2-88e3-e824bf274090 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:38.900919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f599f2a-1daf-4fd2-88e3-e824bf274090 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:38.901298 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f599f2a-1daf-4fd2-88e3-e824bf274090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:38.953905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6f599f2a-1daf-4fd2-88e3-e824bf274090 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:38.956505 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6f599f2a-1daf-4fd2-88e3-e824bf274090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:38.973407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1399/2817] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:41:38.978705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52d2de-dfad-43f5-9934-9c0807f455a7 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:39.009989 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52d2de-dfad-43f5-9934-9c0807f455a7 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:39.019566 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08a42f-8da8-4eef-a495-30f4526eae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:39.020669 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08a42f-8da8-4eef-a495-30f4526eae00 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:39.021160 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08a42f-8da8-4eef-a495-30f4526eae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:39.021686 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08a42f-8da8-4eef-a495-30f4526eae00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:39.022824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08a42f-8da8-4eef-a495-30f4526eae00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:41:39.023354 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08a42f-8da8-4eef-a495-30f4526eae00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:39.026441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08a42f-8da8-4eef-a495-30f4526eae00 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:39.059690 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f599f2a-1daf-4fd2-88e3-e824bf274090 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:39.060001 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1419/2818] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:41:39.074011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f599f2a-1daf-4fd2-88e3-e824bf274090 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:39.079514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee0909-3f48-431c-909e-1962545db320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:39.080701 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee0909-3f48-431c-909e-1962545db320 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:39.080973 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee0909-3f48-431c-909e-1962545db320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:39.081574 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee0909-3f48-431c-909e-1962545db320 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:39.082663 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee0909-3f48-431c-909e-1962545db320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:39.084703 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee0909-3f48-431c-909e-1962545db320 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:39.161339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1400/2819] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:41:39 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:41:39.163759 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08a42f-8da8-4eef-a495-30f4526eae00 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:39.198052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08a42f-8da8-4eef-a495-30f4526eae00 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:39.441689 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8916296-ec96-4e74-86b6-48090fa3c4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:39.442919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8916296-ec96-4e74-86b6-48090fa3c4bf admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:39.443964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8916296-ec96-4e74-86b6-48090fa3c4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:39.444741 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8916296-ec96-4e74-86b6-48090fa3c4bf admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:39.451274 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8916296-ec96-4e74-86b6-48090fa3c4bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:39.456376 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8916296-ec96-4e74-86b6-48090fa3c4bf admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:39.478151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:39.515683 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1420/2820] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:41:39 2022] POST /identity/v3/users => generated 288 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:41:39.523262 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee0909-3f48-431c-909e-1962545db320 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:39.568958 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee0909-3f48-431c-909e-1962545db320 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:39.586575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fe045-2f4b-47d9-b3da-4458127bc83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:39.598161 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fe045-2f4b-47d9-b3da-4458127bc83b admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:39.601607 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fe045-2f4b-47d9-b3da-4458127bc83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:39.601915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fe045-2f4b-47d9-b3da-4458127bc83b admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:39.602934 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fe045-2f4b-47d9-b3da-4458127bc83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:39.604684 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fe045-2f4b-47d9-b3da-4458127bc83b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:39.649423 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1401/2821] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:41:39.651713 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8916296-ec96-4e74-86b6-48090fa3c4bf admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:39.679749 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8916296-ec96-4e74-86b6-48090fa3c4bf admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:39.687052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1912eb-a663-4cf2-90d8-0e41ea5c6458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:39.688107 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1912eb-a663-4cf2-90d8-0e41ea5c6458 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:39.688556 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1912eb-a663-4cf2-90d8-0e41ea5c6458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:39.690194 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1912eb-a663-4cf2-90d8-0e41ea5c6458 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:39.695912 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1912eb-a663-4cf2-90d8-0e41ea5c6458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:39.698838 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1912eb-a663-4cf2-90d8-0e41ea5c6458 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:39.731302 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1421/2822] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:41:39.732162 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fe045-2f4b-47d9-b3da-4458127bc83b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:39.760140 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fe045-2f4b-47d9-b3da-4458127bc83b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:39.771677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6192b93-5905-470b-a4ef-52dd3280b523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:39.772842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6192b93-5905-470b-a4ef-52dd3280b523 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:39.773339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6192b93-5905-470b-a4ef-52dd3280b523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:39.773910 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6192b93-5905-470b-a4ef-52dd3280b523 admin admin] PATH_INFO: `/v3/projects/2cd572c9ec8e4b809a49cd6b6a340ba1/users/1088d7e612674896bdfa5bd1641f92c7/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:39.827229 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6192b93-5905-470b-a4ef-52dd3280b523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd572c9ec8e4b809a49cd6b6a340ba1, user_id=1088d7e612674896bdfa5bd1641f92c7, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:39.834711 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6192b93-5905-470b-a4ef-52dd3280b523 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:39.896750 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1402/2823] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:41:39 2022] PUT /identity/v3/projects/2cd572c9ec8e4b809a49cd6b6a340ba1/users/1088d7e612674896bdfa5bd1641f92c7/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:41:39.919804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1912eb-a663-4cf2-90d8-0e41ea5c6458 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:39.923632 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ff1912eb-a663-4cf2-90d8-0e41ea5c6458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:39.924717 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cddea1-12c1-4701-b3d0-f78f0dd1d11b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:39.925536 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cddea1-12c1-4701-b3d0-f78f0dd1d11b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:39.926028 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cddea1-12c1-4701-b3d0-f78f0dd1d11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:39.954929 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1912eb-a663-4cf2-90d8-0e41ea5c6458 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:40.006526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-96cddea1-12c1-4701-b3d0-f78f0dd1d11b None None] MFA Rules not processed for user `1088d7e612674896bdfa5bd1641f92c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:40.008455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-96cddea1-12c1-4701-b3d0-f78f0dd1d11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:40.026339 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:40.087414 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28076206-6d9f-4d01-b905-042e5cfd45d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:40.088385 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28076206-6d9f-4d01-b905-042e5cfd45d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:40.088824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28076206-6d9f-4d01-b905-042e5cfd45d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:40.089401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28076206-6d9f-4d01-b905-042e5cfd45d5 admin admin] PATH_INFO: `/v3/users/92314357a96448648010e7db45cc7bc7` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:40.093542 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28076206-6d9f-4d01-b905-042e5cfd45d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92314357a96448648010e7db45cc7bc7)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:40.096062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28076206-6d9f-4d01-b905-042e5cfd45d5 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:40.209767 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1403/2824] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:41:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:41:40.232431 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-28076206-6d9f-4d01-b905-042e5cfd45d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92314357a96448648010e7db45cc7bc7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:40.243480 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cddea1-12c1-4701-b3d0-f78f0dd1d11b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:40.246898 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-96cddea1-12c1-4701-b3d0-f78f0dd1d11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:40.273079 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-28076206-6d9f-4d01-b905-042e5cfd45d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92314357a96448648010e7db45cc7bc7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:40.301985 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-28076206-6d9f-4d01-b905-042e5cfd45d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92314357a96448648010e7db45cc7bc7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:40.303407 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-28076206-6d9f-4d01-b905-042e5cfd45d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92314357a96448648010e7db45cc7bc7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:40.304586 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-28076206-6d9f-4d01-b905-042e5cfd45d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92314357a96448648010e7db45cc7bc7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:40.339374 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1422/2825] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:41:39 2022] DELETE /identity/v3/users/92314357a96448648010e7db45cc7bc7 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:40.450532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cddea1-12c1-4701-b3d0-f78f0dd1d11b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:40.590521 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7c468-6d7d-4d28-a70d-332e5cf01d9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:40.591454 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7c468-6d7d-4d28-a70d-332e5cf01d9b service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:40.591893 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7c468-6d7d-4d28-a70d-332e5cf01d9b service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:40.592498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7c468-6d7d-4d28-a70d-332e5cf01d9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:40.595160 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d8c7c468-6d7d-4d28-a70d-332e5cf01d9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:40.691086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28076206-6d9f-4d01-b905-042e5cfd45d5 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:40.694535 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-28076206-6d9f-4d01-b905-042e5cfd45d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:40.743420 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:40.783397 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7c468-6d7d-4d28-a70d-332e5cf01d9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:40.791465 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7c468-6d7d-4d28-a70d-332e5cf01d9b service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:40.807930 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1404/2826] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:41:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:41:41.009940 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:41.020491 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28076206-6d9f-4d01-b905-042e5cfd45d5 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:41.078387 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798e239-5231-48c7-b7a3-4eaa199554fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:41.080508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798e239-5231-48c7-b7a3-4eaa199554fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:41.081347 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798e239-5231-48c7-b7a3-4eaa199554fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:41.082147 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798e239-5231-48c7-b7a3-4eaa199554fa admin admin] PATH_INFO: `/v3/projects/9567d2d0114e41e6b344083212e9806b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:41.086202 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798e239-5231-48c7-b7a3-4eaa199554fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9567d2d0114e41e6b344083212e9806b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:41.090696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798e239-5231-48c7-b7a3-4eaa199554fa admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:41.271163 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-b798e239-5231-48c7-b7a3-4eaa199554fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9567d2d0114e41e6b344083212e9806b', 'request_id': 'req-b798e239-5231-48c7-b7a3-4eaa199554fa'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:41.289485 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-b798e239-5231-48c7-b7a3-4eaa199554fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9567d2d0114e41e6b344083212e9806b', 'request_id': 'req-b798e239-5231-48c7-b7a3-4eaa199554fa'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:41.304668 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-b798e239-5231-48c7-b7a3-4eaa199554fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9567d2d0114e41e6b344083212e9806b', 'request_id': 'req-b798e239-5231-48c7-b7a3-4eaa199554fa'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:41.359845 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-b798e239-5231-48c7-b7a3-4eaa199554fa admin admin] The token cache is being invalidate because project 9567d2d0114e41e6b344083212e9806b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:41:41.360253 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-b798e239-5231-48c7-b7a3-4eaa199554fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:41.361971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-b798e239-5231-48c7-b7a3-4eaa199554fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:41.375735 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1423/2827] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:41:40 2022] DELETE /identity/v3/projects/9567d2d0114e41e6b344083212e9806b => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:41:41.382922 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798e239-5231-48c7-b7a3-4eaa199554fa admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:41.384281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7c468-6d7d-4d28-a70d-332e5cf01d9b service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:41.385023 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b798e239-5231-48c7-b7a3-4eaa199554fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:41.438800 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7c468-6d7d-4d28-a70d-332e5cf01d9b service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:41.583392 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798e239-5231-48c7-b7a3-4eaa199554fa admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:41.598665 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eae8e9-0912-4c8f-80fe-e34f9d851a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:41.600329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eae8e9-0912-4c8f-80fe-e34f9d851a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:41.601461 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eae8e9-0912-4c8f-80fe-e34f9d851a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:41.602205 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eae8e9-0912-4c8f-80fe-e34f9d851a45 admin admin] PATH_INFO: `/v3/users/1088d7e612674896bdfa5bd1641f92c7` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:41.604735 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eae8e9-0912-4c8f-80fe-e34f9d851a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1088d7e612674896bdfa5bd1641f92c7)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:41.608846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33676f5-0b2f-4e52-b11e-bead505d0471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:41.609573 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eae8e9-0912-4c8f-80fe-e34f9d851a45 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:41.610121 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33676f5-0b2f-4e52-b11e-bead505d0471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:41.611338 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33676f5-0b2f-4e52-b11e-bead505d0471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:41.612442 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33676f5-0b2f-4e52-b11e-bead505d0471 admin admin] PATH_INFO: `/v3/users/1b25cf016c244b97ba7042b801b728fd` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:41.615400 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33676f5-0b2f-4e52-b11e-bead505d0471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b25cf016c244b97ba7042b801b728fd)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:41.619842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33676f5-0b2f-4e52-b11e-bead505d0471 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:41.738875 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a33676f5-0b2f-4e52-b11e-bead505d0471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b25cf016c244b97ba7042b801b728fd'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:41.743432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-65eae8e9-0912-4c8f-80fe-e34f9d851a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1088d7e612674896bdfa5bd1641f92c7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:41.761639 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-65eae8e9-0912-4c8f-80fe-e34f9d851a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1088d7e612674896bdfa5bd1641f92c7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:41.770612 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a33676f5-0b2f-4e52-b11e-bead505d0471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b25cf016c244b97ba7042b801b728fd'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:41.788557 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a33676f5-0b2f-4e52-b11e-bead505d0471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b25cf016c244b97ba7042b801b728fd'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:41.789850 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a33676f5-0b2f-4e52-b11e-bead505d0471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b25cf016c244b97ba7042b801b728fd'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:41.804752 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-65eae8e9-0912-4c8f-80fe-e34f9d851a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1088d7e612674896bdfa5bd1641f92c7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:41.808127 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-65eae8e9-0912-4c8f-80fe-e34f9d851a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1088d7e612674896bdfa5bd1641f92c7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:41.810445 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-65eae8e9-0912-4c8f-80fe-e34f9d851a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1088d7e612674896bdfa5bd1641f92c7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:41.811425 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a33676f5-0b2f-4e52-b11e-bead505d0471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b25cf016c244b97ba7042b801b728fd'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:41.828675 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1405/2828] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:41:41 2022] DELETE /identity/v3/users/1b25cf016c244b97ba7042b801b728fd => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:41.856233 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1424/2829] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:41:41 2022] DELETE /identity/v3/users/1088d7e612674896bdfa5bd1641f92c7 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:41.864796 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbf05b-86a5-4f44-862e-d941ba3ff30a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:41.865841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbf05b-86a5-4f44-862e-d941ba3ff30a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:41.866595 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbf05b-86a5-4f44-862e-d941ba3ff30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:41.912692 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-58dbf05b-86a5-4f44-862e-d941ba3ff30a None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:41.916386 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-58dbf05b-86a5-4f44-862e-d941ba3ff30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:42.074956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1406/2830] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:41:42.083925 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eae8e9-0912-4c8f-80fe-e34f9d851a45 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:42.085569 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-65eae8e9-0912-4c8f-80fe-e34f9d851a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:42.103486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:42.221117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbf05b-86a5-4f44-862e-d941ba3ff30a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:42.224416 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-58dbf05b-86a5-4f44-862e-d941ba3ff30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:42.230776 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eae8e9-0912-4c8f-80fe-e34f9d851a45 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:42.245075 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:42.254773 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b4376-5c67-41e8-8be5-9c584383161e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:42.255805 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b4376-5c67-41e8-8be5-9c584383161e service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:42.256301 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b4376-5c67-41e8-8be5-9c584383161e service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:42.256787 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b4376-5c67-41e8-8be5-9c584383161e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:42.261418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbf05b-86a5-4f44-862e-d941ba3ff30a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:42.271584 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c42f51-5b9b-44ac-b4f1-23204d22fd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:42.272604 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42f51-5b9b-44ac-b4f1-23204d22fd44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:42.273169 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42f51-5b9b-44ac-b4f1-23204d22fd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:42.273864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42f51-5b9b-44ac-b4f1-23204d22fd44 admin admin] PATH_INFO: `/v3/projects/5d4e83f71ba04a8abf99927c2f354954` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:42.278896 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b4376-5c67-41e8-8be5-9c584383161e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:42.279553 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c42f51-5b9b-44ac-b4f1-23204d22fd44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4e83f71ba04a8abf99927c2f354954)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:42.281667 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b4376-5c67-41e8-8be5-9c584383161e service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:42.283060 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c42f51-5b9b-44ac-b4f1-23204d22fd44 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:42.306212 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1425/2831] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:41:42.430255 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-35c42f51-5b9b-44ac-b4f1-23204d22fd44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4e83f71ba04a8abf99927c2f354954', 'request_id': 'req-35c42f51-5b9b-44ac-b4f1-23204d22fd44'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:42.445924 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-35c42f51-5b9b-44ac-b4f1-23204d22fd44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4e83f71ba04a8abf99927c2f354954', 'request_id': 'req-35c42f51-5b9b-44ac-b4f1-23204d22fd44'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:42.464004 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-35c42f51-5b9b-44ac-b4f1-23204d22fd44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4e83f71ba04a8abf99927c2f354954', 'request_id': 'req-35c42f51-5b9b-44ac-b4f1-23204d22fd44'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:42.489672 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-35c42f51-5b9b-44ac-b4f1-23204d22fd44 admin admin] The token cache is being invalidate because project 5d4e83f71ba04a8abf99927c2f354954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:41:42.490184 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-35c42f51-5b9b-44ac-b4f1-23204d22fd44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:42.492687 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-35c42f51-5b9b-44ac-b4f1-23204d22fd44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:42.496564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1407/2832] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:41:42 2022] DELETE /identity/v3/projects/5d4e83f71ba04a8abf99927c2f354954 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:42.971605 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b4376-5c67-41e8-8be5-9c584383161e service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:42.974164 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8c1b4376-5c67-41e8-8be5-9c584383161e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:43.001534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b4376-5c67-41e8-8be5-9c584383161e service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:43.111731 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86230602-2be9-4882-9a9d-5d06050feff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:43.112704 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86230602-2be9-4882-9a9d-5d06050feff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:43.113121 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86230602-2be9-4882-9a9d-5d06050feff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:43.117421 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86230602-2be9-4882-9a9d-5d06050feff7 admin admin] PATH_INFO: `/v3/projects/2cd572c9ec8e4b809a49cd6b6a340ba1` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:43.117421 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86230602-2be9-4882-9a9d-5d06050feff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cd572c9ec8e4b809a49cd6b6a340ba1)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:43.120415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86230602-2be9-4882-9a9d-5d06050feff7 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:43.204934 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-86230602-2be9-4882-9a9d-5d06050feff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd572c9ec8e4b809a49cd6b6a340ba1', 'request_id': 'req-86230602-2be9-4882-9a9d-5d06050feff7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:43.217916 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-86230602-2be9-4882-9a9d-5d06050feff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd572c9ec8e4b809a49cd6b6a340ba1', 'request_id': 'req-86230602-2be9-4882-9a9d-5d06050feff7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:43.235240 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-86230602-2be9-4882-9a9d-5d06050feff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd572c9ec8e4b809a49cd6b6a340ba1', 'request_id': 'req-86230602-2be9-4882-9a9d-5d06050feff7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:43.250812 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-86230602-2be9-4882-9a9d-5d06050feff7 admin admin] The token cache is being invalidate because project 2cd572c9ec8e4b809a49cd6b6a340ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:41:43.251289 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-86230602-2be9-4882-9a9d-5d06050feff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:43.252208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-86230602-2be9-4882-9a9d-5d06050feff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:43.254215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1426/2833] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:41:42 2022] DELETE /identity/v3/projects/2cd572c9ec8e4b809a49cd6b6a340ba1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:43.265080 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc5f9d-d08c-4853-bfaa-647227d796ca None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:43.265552 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc5f9d-d08c-4853-bfaa-647227d796ca None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:43.266282 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc5f9d-d08c-4853-bfaa-647227d796ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:43.302405 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-17dc5f9d-d08c-4853-bfaa-647227d796ca None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:43.304239 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-17dc5f9d-d08c-4853-bfaa-647227d796ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:43.414865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1408/2834] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:41:43.431677 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666aaba-20d1-4c28-8ecb-102a94f7e1c1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:43.432191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666aaba-20d1-4c28-8ecb-102a94f7e1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:43.432789 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666aaba-20d1-4c28-8ecb-102a94f7e1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:43.480641 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-8666aaba-20d1-4c28-8ecb-102a94f7e1c1 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:43.482907 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8666aaba-20d1-4c28-8ecb-102a94f7e1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:43.497507 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1427/2835] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:41:43.505818 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc5f9d-d08c-4853-bfaa-647227d796ca None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:43.526634 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc5f9d-d08c-4853-bfaa-647227d796ca None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:43.540787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc7e55-6686-4ae8-9d4d-474127e79784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:43.542197 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc7e55-6686-4ae8-9d4d-474127e79784 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:43.542490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc7e55-6686-4ae8-9d4d-474127e79784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:43.542903 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc7e55-6686-4ae8-9d4d-474127e79784 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:43.544206 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc7e55-6686-4ae8-9d4d-474127e79784 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:41:43.545117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc7e55-6686-4ae8-9d4d-474127e79784 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:43.548774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc7e55-6686-4ae8-9d4d-474127e79784 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:43.575932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1409/2836] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:41:43.581813 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666aaba-20d1-4c28-8ecb-102a94f7e1c1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:43.602215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666aaba-20d1-4c28-8ecb-102a94f7e1c1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:43.612018 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad41dc-1969-4826-93b1-6ecce191b3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:43.612917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad41dc-1969-4826-93b1-6ecce191b3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:43.613447 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad41dc-1969-4826-93b1-6ecce191b3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:43.614011 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad41dc-1969-4826-93b1-6ecce191b3d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:43.614926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad41dc-1969-4826-93b1-6ecce191b3d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:43.618017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad41dc-1969-4826-93b1-6ecce191b3d1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:43.673429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1428/2837] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:41:43 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:41:43.674634 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc7e55-6686-4ae8-9d4d-474127e79784 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:43.695654 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc7e55-6686-4ae8-9d4d-474127e79784 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:43.808884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f081c46-d839-4a0b-a1f0-24b7a16a4e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:43.809931 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f081c46-d839-4a0b-a1f0-24b7a16a4e48 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:43.810277 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f081c46-d839-4a0b-a1f0-24b7a16a4e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:43.810568 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f081c46-d839-4a0b-a1f0-24b7a16a4e48 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:43.811256 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f081c46-d839-4a0b-a1f0-24b7a16a4e48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:43.813311 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f081c46-d839-4a0b-a1f0-24b7a16a4e48 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:43.850499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1410/2838] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:41:43 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:41:43.851972 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad41dc-1969-4826-93b1-6ecce191b3d1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:43.870441 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad41dc-1969-4826-93b1-6ecce191b3d1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:43.876730 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3214ec9-7f83-43b1-8a03-f2841a06045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:43.877547 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3214ec9-7f83-43b1-8a03-f2841a06045a admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:43.877840 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3214ec9-7f83-43b1-8a03-f2841a06045a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:43.878150 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3214ec9-7f83-43b1-8a03-f2841a06045a admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:43.878832 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3214ec9-7f83-43b1-8a03-f2841a06045a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:43.880746 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3214ec9-7f83-43b1-8a03-f2841a06045a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:43.894030 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:43.900494 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1429/2839] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:41:43.906695 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f081c46-d839-4a0b-a1f0-24b7a16a4e48 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:43.914221 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:43.922564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f081c46-d839-4a0b-a1f0-24b7a16a4e48 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:43.934019 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f62514-c79f-4bb4-a910-5de399c3597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:43.935106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f62514-c79f-4bb4-a910-5de399c3597a admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:43.936167 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f62514-c79f-4bb4-a910-5de399c3597a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:43.938868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f62514-c79f-4bb4-a910-5de399c3597a admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:43.940105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f62514-c79f-4bb4-a910-5de399c3597a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:43.943329 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f62514-c79f-4bb4-a910-5de399c3597a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:43.965209 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1411/2840] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:41:43.970646 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3214ec9-7f83-43b1-8a03-f2841a06045a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:43.989223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3214ec9-7f83-43b1-8a03-f2841a06045a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:43.995554 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c4bec-f130-4a23-b30c-145aa7e17b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:43.996511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c4bec-f130-4a23-b30c-145aa7e17b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:43.997073 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c4bec-f130-4a23-b30c-145aa7e17b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:43.997720 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c4bec-f130-4a23-b30c-145aa7e17b63 admin admin] PATH_INFO: `/v3/projects/d7c282892b104970ac11e66a37f7a24b/users/3af2726218164072afe551c1d93bed91/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:44.024264 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c4bec-f130-4a23-b30c-145aa7e17b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c282892b104970ac11e66a37f7a24b, user_id=3af2726218164072afe551c1d93bed91, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:44.028776 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c4bec-f130-4a23-b30c-145aa7e17b63 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:44.055492 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1430/2841] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:41:43 2022] PUT /identity/v3/projects/d7c282892b104970ac11e66a37f7a24b/users/3af2726218164072afe551c1d93bed91/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:44.072687 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07737c85-32db-4987-ad0f-628b7d6612c9 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:44.073072 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07737c85-32db-4987-ad0f-628b7d6612c9 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:44.073526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07737c85-32db-4987-ad0f-628b7d6612c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:44.118713 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-07737c85-32db-4987-ad0f-628b7d6612c9 None None] MFA Rules not processed for user `3af2726218164072afe551c1d93bed91`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:44.120218 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-07737c85-32db-4987-ad0f-628b7d6612c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:44.218655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1412/2842] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:41:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:41:44.224539 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c4bec-f130-4a23-b30c-145aa7e17b63 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:44.349534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c4bec-f130-4a23-b30c-145aa7e17b63 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:44.352965 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ae22f-ef50-44d0-9012-72925f89f955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:44.354038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ae22f-ef50-44d0-9012-72925f89f955 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:44.354476 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ae22f-ef50-44d0-9012-72925f89f955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:44.354903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ae22f-ef50-44d0-9012-72925f89f955 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:44.355900 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ae22f-ef50-44d0-9012-72925f89f955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:44.358743 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ae22f-ef50-44d0-9012-72925f89f955 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:44.416404 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1431/2843] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:41:44 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:41:44.418453 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07737c85-32db-4987-ad0f-628b7d6612c9 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:44.437642 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07737c85-32db-4987-ad0f-628b7d6612c9 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:44.534870 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c44ea-97ba-405d-8ff6-010238cbc1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:44.535702 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c44ea-97ba-405d-8ff6-010238cbc1de admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:44.535865 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c44ea-97ba-405d-8ff6-010238cbc1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:44.536281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c44ea-97ba-405d-8ff6-010238cbc1de admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:44.537100 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c44ea-97ba-405d-8ff6-010238cbc1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:44.539139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c44ea-97ba-405d-8ff6-010238cbc1de admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:44.567694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1413/2844] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:41:44 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:41:44.574084 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ae22f-ef50-44d0-9012-72925f89f955 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:44.583781 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ae22f-ef50-44d0-9012-72925f89f955 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:44.588710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4764734-0ce3-45ac-acac-881628b640f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:44.589328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4764734-0ce3-45ac-acac-881628b640f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:44.589643 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4764734-0ce3-45ac-acac-881628b640f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:44.589964 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4764734-0ce3-45ac-acac-881628b640f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:44.590720 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4764734-0ce3-45ac-acac-881628b640f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:44.592432 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4764734-0ce3-45ac-acac-881628b640f4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:44.604794 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1432/2845] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:41:44.610040 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c44ea-97ba-405d-8ff6-010238cbc1de admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:44.628320 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c44ea-97ba-405d-8ff6-010238cbc1de admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:44.636683 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3cd1b-3451-465f-9af2-c318bb242b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:44.637888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3cd1b-3451-465f-9af2-c318bb242b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:44.638416 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3cd1b-3451-465f-9af2-c318bb242b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:44.638907 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3cd1b-3451-465f-9af2-c318bb242b2d admin admin] PATH_INFO: `/v3/projects/7a52bb82549f46a6a3da33f532b0772c/users/ed59a39e32fa45cc9a1633a44cc03fcc/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:44.667440 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3cd1b-3451-465f-9af2-c318bb242b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a52bb82549f46a6a3da33f532b0772c, user_id=ed59a39e32fa45cc9a1633a44cc03fcc, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:44.670667 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3cd1b-3451-465f-9af2-c318bb242b2d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:44.690473 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1414/2846] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:41:44 2022] PUT /identity/v3/projects/7a52bb82549f46a6a3da33f532b0772c/users/ed59a39e32fa45cc9a1633a44cc03fcc/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:41:44.695877 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4764734-0ce3-45ac-acac-881628b640f4 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:44.714661 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4764734-0ce3-45ac-acac-881628b640f4 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:44.799151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5a196-0082-4402-9f35-43bf8b48e14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:44.799924 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5a196-0082-4402-9f35-43bf8b48e14e admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:44.800300 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5a196-0082-4402-9f35-43bf8b48e14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:44.800679 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5a196-0082-4402-9f35-43bf8b48e14e admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:44.801626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5a196-0082-4402-9f35-43bf8b48e14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:44.803548 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5a196-0082-4402-9f35-43bf8b48e14e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:44.821655 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1433/2847] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:41:44.827483 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3cd1b-3451-465f-9af2-c318bb242b2d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:44.841623 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3cd1b-3451-465f-9af2-c318bb242b2d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:44.847010 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923a988-d988-4336-83c4-6f380020029a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:44.847717 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923a988-d988-4336-83c4-6f380020029a admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:44.847996 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923a988-d988-4336-83c4-6f380020029a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:44.848271 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923a988-d988-4336-83c4-6f380020029a admin admin] PATH_INFO: `/v3/projects/7a52bb82549f46a6a3da33f532b0772c/users/ed59a39e32fa45cc9a1633a44cc03fcc/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:44.850827 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923a988-d988-4336-83c4-6f380020029a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a52bb82549f46a6a3da33f532b0772c, user_id=ed59a39e32fa45cc9a1633a44cc03fcc, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:44.853884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923a988-d988-4336-83c4-6f380020029a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:44.867860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1415/2848] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:41:44 2022] PUT /identity/v3/projects/7a52bb82549f46a6a3da33f532b0772c/users/ed59a39e32fa45cc9a1633a44cc03fcc/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:44.881026 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e5274-a9ab-401c-8028-55eac02d6618 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:44.881386 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e5274-a9ab-401c-8028-55eac02d6618 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:44.881754 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e5274-a9ab-401c-8028-55eac02d6618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:44.918088 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e55e5274-a9ab-401c-8028-55eac02d6618 None None] MFA Rules not processed for user `ed59a39e32fa45cc9a1633a44cc03fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:44.919670 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e55e5274-a9ab-401c-8028-55eac02d6618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:44.980936 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:45.029779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1434/2849] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:41:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:41:45.047650 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923a988-d988-4336-83c4-6f380020029a admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:45.050105 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6923a988-d988-4336-83c4-6f380020029a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:45.093751 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:45.120400 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923a988-d988-4336-83c4-6f380020029a admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:45.125154 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa74237-eebd-438f-8615-f9c03fd1f842 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:45.125844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa74237-eebd-438f-8615-f9c03fd1f842 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:45.126129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa74237-eebd-438f-8615-f9c03fd1f842 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:45.126480 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa74237-eebd-438f-8615-f9c03fd1f842 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:45.137175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa74237-eebd-438f-8615-f9c03fd1f842 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:45.138696 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa74237-eebd-438f-8615-f9c03fd1f842 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:45.150499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1416/2850] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:41:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:41:45.251434 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e5274-a9ab-401c-8028-55eac02d6618 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:45.264077 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e5274-a9ab-401c-8028-55eac02d6618 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:45.267869 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be39ad6-b486-413a-9780-473027cd6ed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:45.268493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be39ad6-b486-413a-9780-473027cd6ed3 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:45.268788 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be39ad6-b486-413a-9780-473027cd6ed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:45.269035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be39ad6-b486-413a-9780-473027cd6ed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:45.371025 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be39ad6-b486-413a-9780-473027cd6ed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:45.372721 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be39ad6-b486-413a-9780-473027cd6ed3 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:45.386851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1435/2851] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:41:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:41:45.903736 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075f61b-21d4-4648-a98b-de7ea02d865d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:45.904380 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075f61b-21d4-4648-a98b-de7ea02d865d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:45.904525 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075f61b-21d4-4648-a98b-de7ea02d865d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:45.999705 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e075f61b-21d4-4648-a98b-de7ea02d865d None None] MFA Rules not processed for user `0327aa38835f41a7a82802f9cad2e6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:46.001928 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e075f61b-21d4-4648-a98b-de7ea02d865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:46.110621 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1417/2852] 10.222.0.52 () {58 vars in 967 bytes} [Mon Aug 29 20:41:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:41:46.127198 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be39ad6-b486-413a-9780-473027cd6ed3 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:46.128948 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4be39ad6-b486-413a-9780-473027cd6ed3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:46.243415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be39ad6-b486-413a-9780-473027cd6ed3 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:46.250263 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d1059-1cbc-4c9c-b885-a957781d9693 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9791ea73d46b191ad9fc146297565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:46.251042 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d1059-1cbc-4c9c-b885-a957781d9693 service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:46.251396 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d1059-1cbc-4c9c-b885-a957781d9693 service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:46.251768 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d1059-1cbc-4c9c-b885-a957781d9693 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:46.263413 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d1059-1cbc-4c9c-b885-a957781d9693 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:46.265349 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d1059-1cbc-4c9c-b885-a957781d9693 service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:46.275442 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1436/2853] 10.222.0.52 () {60 vars in 1384 bytes} [Mon Aug 29 20:41:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 20:41:48.709568 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075f61b-21d4-4648-a98b-de7ea02d865d None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:48.713732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e075f61b-21d4-4648-a98b-de7ea02d865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:48.872881 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075f61b-21d4-4648-a98b-de7ea02d865d None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:48.883509 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50398b-0b6f-44e5-b72a-2c5b605dab2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8295272eec349f8aa38e44c861faa47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:48.884447 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50398b-0b6f-44e5-b72a-2c5b605dab2d service placement] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:48.884790 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50398b-0b6f-44e5-b72a-2c5b605dab2d service placement] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:48.885079 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50398b-0b6f-44e5-b72a-2c5b605dab2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:48.887841 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-da50398b-0b6f-44e5-b72a-2c5b605dab2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:48.908095 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50398b-0b6f-44e5-b72a-2c5b605dab2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:48.910348 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50398b-0b6f-44e5-b72a-2c5b605dab2d service placement] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:48.933672 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1418/2854] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:41:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:41:49.158703 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d1059-1cbc-4c9c-b885-a957781d9693 service swift] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:49.161648 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-768d1059-1cbc-4c9c-b885-a957781d9693 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:49.233595 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:49.263855 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d1059-1cbc-4c9c-b885-a957781d9693 service swift] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:49.271395 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadc6b9-9a25-487c-adc3-c9db248acf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:49.272261 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadc6b9-9a25-487c-adc3-c9db248acf4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:49.272678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadc6b9-9a25-487c-adc3-c9db248acf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:49.273067 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadc6b9-9a25-487c-adc3-c9db248acf4e admin admin] PATH_INFO: `/v3/users/73b0cf83bb044231bd914740da6d2232` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:49.274994 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadc6b9-9a25-487c-adc3-c9db248acf4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b0cf83bb044231bd914740da6d2232)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:49.277603 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadc6b9-9a25-487c-adc3-c9db248acf4e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:49.347945 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-eeadc6b9-9a25-487c-adc3-c9db248acf4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b0cf83bb044231bd914740da6d2232'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:49.359871 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-eeadc6b9-9a25-487c-adc3-c9db248acf4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b0cf83bb044231bd914740da6d2232'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:49.378671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-eeadc6b9-9a25-487c-adc3-c9db248acf4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b0cf83bb044231bd914740da6d2232'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:49.379475 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-eeadc6b9-9a25-487c-adc3-c9db248acf4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b0cf83bb044231bd914740da6d2232'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:49.380331 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-eeadc6b9-9a25-487c-adc3-c9db248acf4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b0cf83bb044231bd914740da6d2232'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:49.396650 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1437/2855] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:41:49 2022] DELETE /identity/v3/users/73b0cf83bb044231bd914740da6d2232 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:49.698202 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50398b-0b6f-44e5-b72a-2c5b605dab2d service placement] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:49.718779 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50398b-0b6f-44e5-b72a-2c5b605dab2d service placement] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:49.784748 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:49.838117 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ec0cd-2ce8-4dd5-a986-4a02ab1e54e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:49.839395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ec0cd-2ce8-4dd5-a986-4a02ab1e54e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:49.840031 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ec0cd-2ce8-4dd5-a986-4a02ab1e54e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:49.840640 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ec0cd-2ce8-4dd5-a986-4a02ab1e54e5 admin admin] PATH_INFO: `/v3/projects/e270f9b23fc74b50bf775b56888c9b64` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:49.843414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ec0cd-2ce8-4dd5-a986-4a02ab1e54e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e270f9b23fc74b50bf775b56888c9b64)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:49.847713 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ec0cd-2ce8-4dd5-a986-4a02ab1e54e5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:49.931935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e80ec0cd-2ce8-4dd5-a986-4a02ab1e54e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e270f9b23fc74b50bf775b56888c9b64', 'request_id': 'req-e80ec0cd-2ce8-4dd5-a986-4a02ab1e54e5'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:49.947155 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e80ec0cd-2ce8-4dd5-a986-4a02ab1e54e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e270f9b23fc74b50bf775b56888c9b64', 'request_id': 'req-e80ec0cd-2ce8-4dd5-a986-4a02ab1e54e5'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:49.962706 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e80ec0cd-2ce8-4dd5-a986-4a02ab1e54e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e270f9b23fc74b50bf775b56888c9b64', 'request_id': 'req-e80ec0cd-2ce8-4dd5-a986-4a02ab1e54e5'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:49.982380 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e80ec0cd-2ce8-4dd5-a986-4a02ab1e54e5 admin admin] The token cache is being invalidate because project e270f9b23fc74b50bf775b56888c9b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:41:49.982864 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e80ec0cd-2ce8-4dd5-a986-4a02ab1e54e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:49.984245 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e80ec0cd-2ce8-4dd5-a986-4a02ab1e54e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:49.987368 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1419/2856] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:41:49 2022] DELETE /identity/v3/projects/e270f9b23fc74b50bf775b56888c9b64 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:53.408280 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadc6b9-9a25-487c-adc3-c9db248acf4e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:53.410177 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-eeadc6b9-9a25-487c-adc3-c9db248acf4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:53.435497 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadc6b9-9a25-487c-adc3-c9db248acf4e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:53.541162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4c0d6-07bb-486b-8363-60bd6aaf8434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:53.541873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4c0d6-07bb-486b-8363-60bd6aaf8434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:53.542312 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4c0d6-07bb-486b-8363-60bd6aaf8434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:53.542740 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4c0d6-07bb-486b-8363-60bd6aaf8434 admin admin] PATH_INFO: `/v3/users/3af2726218164072afe551c1d93bed91` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:53.544483 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4c0d6-07bb-486b-8363-60bd6aaf8434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3af2726218164072afe551c1d93bed91)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:53.547167 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4c0d6-07bb-486b-8363-60bd6aaf8434 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:53.624130 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-eca4c0d6-07bb-486b-8363-60bd6aaf8434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3af2726218164072afe551c1d93bed91'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:53.637412 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-eca4c0d6-07bb-486b-8363-60bd6aaf8434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3af2726218164072afe551c1d93bed91'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:53.648557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:53.662429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-eca4c0d6-07bb-486b-8363-60bd6aaf8434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3af2726218164072afe551c1d93bed91'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:53.663675 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-eca4c0d6-07bb-486b-8363-60bd6aaf8434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3af2726218164072afe551c1d93bed91'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:53.664590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-eca4c0d6-07bb-486b-8363-60bd6aaf8434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3af2726218164072afe551c1d93bed91'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:53.686280 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1438/2857] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:41:53 2022] DELETE /identity/v3/users/3af2726218164072afe551c1d93bed91 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:53.693483 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb4cd4-2d7a-4812-b5c1-3e68d63da7d0 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:53.694346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb4cd4-2d7a-4812-b5c1-3e68d63da7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:53.694346 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb4cd4-2d7a-4812-b5c1-3e68d63da7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:53.729809 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-bafb4cd4-2d7a-4812-b5c1-3e68d63da7d0 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:53.731922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bafb4cd4-2d7a-4812-b5c1-3e68d63da7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:53.855550 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1420/2858] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:41:53.871552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4c0d6-07bb-486b-8363-60bd6aaf8434 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:53.873326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-eca4c0d6-07bb-486b-8363-60bd6aaf8434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:53.966316 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4c0d6-07bb-486b-8363-60bd6aaf8434 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:53.970776 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621825ef-e469-46a1-81ba-ce8b9fc41318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:53.971618 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621825ef-e469-46a1-81ba-ce8b9fc41318 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:53.972002 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621825ef-e469-46a1-81ba-ce8b9fc41318 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:53.972472 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621825ef-e469-46a1-81ba-ce8b9fc41318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:53.990420 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621825ef-e469-46a1-81ba-ce8b9fc41318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:53.993223 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621825ef-e469-46a1-81ba-ce8b9fc41318 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:54.009779 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1439/2859] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:41:54.446030 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb4cd4-2d7a-4812-b5c1-3e68d63da7d0 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:54.448534 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bafb4cd4-2d7a-4812-b5c1-3e68d63da7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:54.469935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb4cd4-2d7a-4812-b5c1-3e68d63da7d0 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:54.481512 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:54.482511 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:54.483008 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:54.483355 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8 admin admin] PATH_INFO: `/v3/projects/d7c282892b104970ac11e66a37f7a24b` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:54.485486 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c282892b104970ac11e66a37f7a24b)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:54.489296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:54.581712 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c282892b104970ac11e66a37f7a24b', 'request_id': 'req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:54.595583 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c282892b104970ac11e66a37f7a24b', 'request_id': 'req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:54.616174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c282892b104970ac11e66a37f7a24b', 'request_id': 'req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:54.619217 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:54.639985 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8 admin admin] The token cache is being invalidate because project d7c282892b104970ac11e66a37f7a24b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:41:54.640930 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:54.642269 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:54.644510 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1421/2860] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:41:54 2022] DELETE /identity/v3/projects/d7c282892b104970ac11e66a37f7a24b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:54.651284 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621825ef-e469-46a1-81ba-ce8b9fc41318 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:54.669614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621825ef-e469-46a1-81ba-ce8b9fc41318 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:54.771063 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8f405-bd03-4a9e-9a9a-a8c642b1dd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:54.771656 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8f405-bd03-4a9e-9a9a-a8c642b1dd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:54.772007 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8f405-bd03-4a9e-9a9a-a8c642b1dd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:54.772581 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8f405-bd03-4a9e-9a9a-a8c642b1dd2a admin admin] PATH_INFO: `/v3/users/ed59a39e32fa45cc9a1633a44cc03fcc` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:54.774218 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8f405-bd03-4a9e-9a9a-a8c642b1dd2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed59a39e32fa45cc9a1633a44cc03fcc)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:54.777164 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8f405-bd03-4a9e-9a9a-a8c642b1dd2a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:54.861204 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f4d8f405-bd03-4a9e-9a9a-a8c642b1dd2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed59a39e32fa45cc9a1633a44cc03fcc'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:54.872142 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f4d8f405-bd03-4a9e-9a9a-a8c642b1dd2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed59a39e32fa45cc9a1633a44cc03fcc'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:54.888378 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f4d8f405-bd03-4a9e-9a9a-a8c642b1dd2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed59a39e32fa45cc9a1633a44cc03fcc'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:54.889153 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f4d8f405-bd03-4a9e-9a9a-a8c642b1dd2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed59a39e32fa45cc9a1633a44cc03fcc'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:54.889826 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f4d8f405-bd03-4a9e-9a9a-a8c642b1dd2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed59a39e32fa45cc9a1633a44cc03fcc'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:54.908200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:54.916653 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1440/2861] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:41:54 2022] DELETE /identity/v3/users/ed59a39e32fa45cc9a1633a44cc03fcc => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:55.362851 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:55.365287 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:55.381956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc1ab2-e724-4fc5-bbaf-e8feb36489a8 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:55.452147 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e96e4-3d2e-4c60-b4cc-6d5fa44f3634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:55.452817 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e96e4-3d2e-4c60-b4cc-6d5fa44f3634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:55.453073 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e96e4-3d2e-4c60-b4cc-6d5fa44f3634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:55.453610 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e96e4-3d2e-4c60-b4cc-6d5fa44f3634 admin admin] PATH_INFO: `/v3/projects/7a52bb82549f46a6a3da33f532b0772c` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:55.454709 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e96e4-3d2e-4c60-b4cc-6d5fa44f3634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a52bb82549f46a6a3da33f532b0772c)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:55.456663 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e96e4-3d2e-4c60-b4cc-6d5fa44f3634 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:55.537503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2d4e96e4-3d2e-4c60-b4cc-6d5fa44f3634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a52bb82549f46a6a3da33f532b0772c', 'request_id': 'req-2d4e96e4-3d2e-4c60-b4cc-6d5fa44f3634'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:55.548223 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2d4e96e4-3d2e-4c60-b4cc-6d5fa44f3634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a52bb82549f46a6a3da33f532b0772c', 'request_id': 'req-2d4e96e4-3d2e-4c60-b4cc-6d5fa44f3634'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:55.558556 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2d4e96e4-3d2e-4c60-b4cc-6d5fa44f3634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a52bb82549f46a6a3da33f532b0772c', 'request_id': 'req-2d4e96e4-3d2e-4c60-b4cc-6d5fa44f3634'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:55.572137 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2d4e96e4-3d2e-4c60-b4cc-6d5fa44f3634 admin admin] The token cache is being invalidate because project 7a52bb82549f46a6a3da33f532b0772c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:41:55.572428 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2d4e96e4-3d2e-4c60-b4cc-6d5fa44f3634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:55.573108 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2d4e96e4-3d2e-4c60-b4cc-6d5fa44f3634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:55.574732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1422/2862] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:41:55 2022] DELETE /identity/v3/projects/7a52bb82549f46a6a3da33f532b0772c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:55.580474 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df0b6b-19da-4014-b86b-037014421a8e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:55.580852 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df0b6b-19da-4014-b86b-037014421a8e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:55.581208 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df0b6b-19da-4014-b86b-037014421a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:55.605560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-33df0b6b-19da-4014-b86b-037014421a8e None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:55.607135 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-33df0b6b-19da-4014-b86b-037014421a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:55.697062 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1441/2863] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:41:55.711383 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cd692-f70f-41ae-b26e-117377a6aa68 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:55.711899 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cd692-f70f-41ae-b26e-117377a6aa68 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:55.712601 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cd692-f70f-41ae-b26e-117377a6aa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:55.744737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-861cd692-f70f-41ae-b26e-117377a6aa68 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:55.746670 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-861cd692-f70f-41ae-b26e-117377a6aa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:55.759432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1423/2864] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:41:55.765652 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df0b6b-19da-4014-b86b-037014421a8e None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:55.786254 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df0b6b-19da-4014-b86b-037014421a8e None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:55.792191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9908ee4-d8f2-4a3f-8c09-79c1bec610f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:55.792862 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9908ee4-d8f2-4a3f-8c09-79c1bec610f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:55.793139 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9908ee4-d8f2-4a3f-8c09-79c1bec610f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:55.793487 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9908ee4-d8f2-4a3f-8c09-79c1bec610f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:55.794272 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9908ee4-d8f2-4a3f-8c09-79c1bec610f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:41:55.794567 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9908ee4-d8f2-4a3f-8c09-79c1bec610f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:55.797469 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9908ee4-d8f2-4a3f-8c09-79c1bec610f5 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:55.814844 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1442/2865] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:41:55.819621 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cd692-f70f-41ae-b26e-117377a6aa68 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:55.835564 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cd692-f70f-41ae-b26e-117377a6aa68 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:55.842617 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fa198-436a-4f7f-ad6c-dd24216f69ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:55.842911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fa198-436a-4f7f-ad6c-dd24216f69ef admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:55.843186 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fa198-436a-4f7f-ad6c-dd24216f69ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:55.843569 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fa198-436a-4f7f-ad6c-dd24216f69ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:55.844541 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fa198-436a-4f7f-ad6c-dd24216f69ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:55.846823 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fa198-436a-4f7f-ad6c-dd24216f69ef admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:55.891820 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1424/2866] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:41:55 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:41:55.898531 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9908ee4-d8f2-4a3f-8c09-79c1bec610f5 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:55.916086 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9908ee4-d8f2-4a3f-8c09-79c1bec610f5 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:56.014272 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c3709-633d-4c2e-b8db-9a0b01b6ea72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:56.015187 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c3709-633d-4c2e-b8db-9a0b01b6ea72 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:56.015643 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c3709-633d-4c2e-b8db-9a0b01b6ea72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:56.016094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c3709-633d-4c2e-b8db-9a0b01b6ea72 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:56.017099 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c3709-633d-4c2e-b8db-9a0b01b6ea72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:56.019323 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c3709-633d-4c2e-b8db-9a0b01b6ea72 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:56.044977 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1443/2867] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:41:55 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:41:56.052445 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fa198-436a-4f7f-ad6c-dd24216f69ef admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:56.072041 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fa198-436a-4f7f-ad6c-dd24216f69ef admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:56.079874 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f58a4c-97fd-4de9-96dd-ea7b8c25fe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:56.080553 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f58a4c-97fd-4de9-96dd-ea7b8c25fe77 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:56.080825 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f58a4c-97fd-4de9-96dd-ea7b8c25fe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:56.081129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f58a4c-97fd-4de9-96dd-ea7b8c25fe77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:56.081922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f58a4c-97fd-4de9-96dd-ea7b8c25fe77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:56.083657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f58a4c-97fd-4de9-96dd-ea7b8c25fe77 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:56.096355 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1425/2868] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:41:56.100904 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c3709-633d-4c2e-b8db-9a0b01b6ea72 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:56.112138 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c3709-633d-4c2e-b8db-9a0b01b6ea72 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:56.117416 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b9111-0e03-45a1-9642-693dfc3b1766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:56.118039 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b9111-0e03-45a1-9642-693dfc3b1766 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:56.118317 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b9111-0e03-45a1-9642-693dfc3b1766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:56.118588 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b9111-0e03-45a1-9642-693dfc3b1766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:56.119237 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b9111-0e03-45a1-9642-693dfc3b1766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:56.120899 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b9111-0e03-45a1-9642-693dfc3b1766 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:56.133696 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1444/2869] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:41:56.140671 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f58a4c-97fd-4de9-96dd-ea7b8c25fe77 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:56.158906 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f58a4c-97fd-4de9-96dd-ea7b8c25fe77 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:56.164468 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb765419-d9c5-4c42-96a4-4ed8bad63a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:56.165164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb765419-d9c5-4c42-96a4-4ed8bad63a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:56.165485 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb765419-d9c5-4c42-96a4-4ed8bad63a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:56.165756 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb765419-d9c5-4c42-96a4-4ed8bad63a63 admin admin] PATH_INFO: `/v3/projects/74a793b4cdd44b63b9c8af3f0f2e268c/users/4258f99a3bfe4673b00581718f1b1a53/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:56.198694 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb765419-d9c5-4c42-96a4-4ed8bad63a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a793b4cdd44b63b9c8af3f0f2e268c, user_id=4258f99a3bfe4673b00581718f1b1a53, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:56.201656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb765419-d9c5-4c42-96a4-4ed8bad63a63 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:56.221562 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1426/2870] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:41:56 2022] PUT /identity/v3/projects/74a793b4cdd44b63b9c8af3f0f2e268c/users/4258f99a3bfe4673b00581718f1b1a53/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:56.236270 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aea50a-d253-4baf-8966-14d30c977abc None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:56.236701 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aea50a-d253-4baf-8966-14d30c977abc None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:56.236978 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aea50a-d253-4baf-8966-14d30c977abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:56.278501 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e5aea50a-d253-4baf-8966-14d30c977abc None None] MFA Rules not processed for user `4258f99a3bfe4673b00581718f1b1a53`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:56.280009 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e5aea50a-d253-4baf-8966-14d30c977abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:56.358824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:56.374429 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1445/2871] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:41:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:41:56.379753 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb765419-d9c5-4c42-96a4-4ed8bad63a63 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:56.405676 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:56.466187 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb765419-d9c5-4c42-96a4-4ed8bad63a63 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:56.474888 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d28b2b-710a-468c-97f1-178a556465fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:56.475961 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d28b2b-710a-468c-97f1-178a556465fb admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:56.476465 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d28b2b-710a-468c-97f1-178a556465fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:56.476956 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d28b2b-710a-468c-97f1-178a556465fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:56.478215 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d28b2b-710a-468c-97f1-178a556465fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:56.482126 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d28b2b-710a-468c-97f1-178a556465fb admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:56.532594 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1427/2872] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:41:56 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:41:56.539994 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aea50a-d253-4baf-8966-14d30c977abc None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:56.559238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aea50a-d253-4baf-8966-14d30c977abc None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:56.651275 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ad374-c4e1-4b02-af07-bb1fb3225111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:56.652293 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ad374-c4e1-4b02-af07-bb1fb3225111 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:56.652802 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ad374-c4e1-4b02-af07-bb1fb3225111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:56.653288 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ad374-c4e1-4b02-af07-bb1fb3225111 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:56.654484 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ad374-c4e1-4b02-af07-bb1fb3225111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:56.658075 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ad374-c4e1-4b02-af07-bb1fb3225111 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:56.697738 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1446/2873] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:41:56 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:41:56.705347 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d28b2b-710a-468c-97f1-178a556465fb admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:56.718483 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d28b2b-710a-468c-97f1-178a556465fb admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:56.727002 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30171909-1dff-4c98-8223-29f1f57738f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:56.728142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30171909-1dff-4c98-8223-29f1f57738f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:56.728734 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30171909-1dff-4c98-8223-29f1f57738f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:56.729242 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30171909-1dff-4c98-8223-29f1f57738f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:56.730718 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30171909-1dff-4c98-8223-29f1f57738f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:56.734080 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30171909-1dff-4c98-8223-29f1f57738f3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:56.756259 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1428/2874] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:41:56.763594 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ad374-c4e1-4b02-af07-bb1fb3225111 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:56.781744 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ad374-c4e1-4b02-af07-bb1fb3225111 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:56.790202 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3e66a-26d5-42a7-8dda-d879c28fdcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:56.791103 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3e66a-26d5-42a7-8dda-d879c28fdcda admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:56.791530 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3e66a-26d5-42a7-8dda-d879c28fdcda admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:56.792028 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3e66a-26d5-42a7-8dda-d879c28fdcda admin admin] PATH_INFO: `/v3/projects/4171c75e20914a848407c194cb22c03f/users/fe91f80496b6447cade1a798eb5bd125/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:56.820597 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3e66a-26d5-42a7-8dda-d879c28fdcda admin admin] RBAC: Authorizing `identity:create_grant(project_id=4171c75e20914a848407c194cb22c03f, user_id=fe91f80496b6447cade1a798eb5bd125, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:56.826572 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3e66a-26d5-42a7-8dda-d879c28fdcda admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:56.847089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1447/2875] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:41:56 2022] PUT /identity/v3/projects/4171c75e20914a848407c194cb22c03f/users/fe91f80496b6447cade1a798eb5bd125/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:56.852296 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30171909-1dff-4c98-8223-29f1f57738f3 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:56.870787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30171909-1dff-4c98-8223-29f1f57738f3 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:56.975780 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363e4ac-aa23-45f7-beb0-a1e99d6ae1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:56.976720 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e4ac-aa23-45f7-beb0-a1e99d6ae1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:56.977247 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e4ac-aa23-45f7-beb0-a1e99d6ae1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:56.977709 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e4ac-aa23-45f7-beb0-a1e99d6ae1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:56.978874 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363e4ac-aa23-45f7-beb0-a1e99d6ae1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:56.982326 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363e4ac-aa23-45f7-beb0-a1e99d6ae1f0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:57.003760 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1429/2876] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:41:57.008980 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3e66a-26d5-42a7-8dda-d879c28fdcda admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:57.021180 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3e66a-26d5-42a7-8dda-d879c28fdcda admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:57.027174 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac818d2-8eb3-4127-82f8-e3482f571082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:57.027955 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac818d2-8eb3-4127-82f8-e3482f571082 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:57.028279 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac818d2-8eb3-4127-82f8-e3482f571082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:57.028644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac818d2-8eb3-4127-82f8-e3482f571082 admin admin] PATH_INFO: `/v3/projects/4171c75e20914a848407c194cb22c03f/users/fe91f80496b6447cade1a798eb5bd125/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:57.031059 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac818d2-8eb3-4127-82f8-e3482f571082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4171c75e20914a848407c194cb22c03f, user_id=fe91f80496b6447cade1a798eb5bd125, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:57.034090 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac818d2-8eb3-4127-82f8-e3482f571082 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:57.053996 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1448/2877] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:41:57 2022] PUT /identity/v3/projects/4171c75e20914a848407c194cb22c03f/users/fe91f80496b6447cade1a798eb5bd125/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:57.067438 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d0339-b6de-490e-9e66-9efbe40fa903 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:57.067772 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d0339-b6de-490e-9e66-9efbe40fa903 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:57.068139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d0339-b6de-490e-9e66-9efbe40fa903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:57.132164 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3f8d0339-b6de-490e-9e66-9efbe40fa903 None None] MFA Rules not processed for user `fe91f80496b6447cade1a798eb5bd125`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:57.134540 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3f8d0339-b6de-490e-9e66-9efbe40fa903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:57.233717 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1430/2878] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:41:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:41:57.249392 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac818d2-8eb3-4127-82f8-e3482f571082 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:57.251266 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7ac818d2-8eb3-4127-82f8-e3482f571082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:57.354338 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac818d2-8eb3-4127-82f8-e3482f571082 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:57.361954 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3b62d-56f1-4ea3-bede-dbffe1572a34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:57.363066 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3b62d-56f1-4ea3-bede-dbffe1572a34 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:57.363548 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3b62d-56f1-4ea3-bede-dbffe1572a34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:57.364038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3b62d-56f1-4ea3-bede-dbffe1572a34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:57.380757 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3b62d-56f1-4ea3-bede-dbffe1572a34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:57.382515 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3b62d-56f1-4ea3-bede-dbffe1572a34 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:57.394778 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1449/2879] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:41:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:41:57.938103 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d0339-b6de-490e-9e66-9efbe40fa903 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:57.962502 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:58.018737 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d0339-b6de-490e-9e66-9efbe40fa903 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:58.023398 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81237704-c14f-474d-92eb-5b1aa708ed82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:58.024049 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81237704-c14f-474d-92eb-5b1aa708ed82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:58.024543 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81237704-c14f-474d-92eb-5b1aa708ed82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:58.024830 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81237704-c14f-474d-92eb-5b1aa708ed82 admin admin] PATH_INFO: `/v3/users/4258f99a3bfe4673b00581718f1b1a53` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:58.025976 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81237704-c14f-474d-92eb-5b1aa708ed82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4258f99a3bfe4673b00581718f1b1a53)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:58.027974 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81237704-c14f-474d-92eb-5b1aa708ed82 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:58.085958 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-81237704-c14f-474d-92eb-5b1aa708ed82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4258f99a3bfe4673b00581718f1b1a53'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:58.099526 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-81237704-c14f-474d-92eb-5b1aa708ed82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4258f99a3bfe4673b00581718f1b1a53'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:58.108142 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-81237704-c14f-474d-92eb-5b1aa708ed82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4258f99a3bfe4673b00581718f1b1a53'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:58.109071 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-81237704-c14f-474d-92eb-5b1aa708ed82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4258f99a3bfe4673b00581718f1b1a53'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:58.120595 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-81237704-c14f-474d-92eb-5b1aa708ed82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4258f99a3bfe4673b00581718f1b1a53'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:58.128401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1431/2880] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:41:57 2022] DELETE /identity/v3/users/4258f99a3bfe4673b00581718f1b1a53 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:58.133265 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cdfdb-a6d7-4f80-823f-ed04683bf27d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:58.133971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cdfdb-a6d7-4f80-823f-ed04683bf27d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:58.133971 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cdfdb-a6d7-4f80-823f-ed04683bf27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:58.154390 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c88cdfdb-a6d7-4f80-823f-ed04683bf27d None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:58.155645 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c88cdfdb-a6d7-4f80-823f-ed04683bf27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:58.213563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:58.233241 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1450/2881] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:41:58.244467 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81237704-c14f-474d-92eb-5b1aa708ed82 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:58.246581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-81237704-c14f-474d-92eb-5b1aa708ed82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:58.322717 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81237704-c14f-474d-92eb-5b1aa708ed82 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:58.326674 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a4649-13f1-4ce9-adcb-1e5a3c7d0295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:58.327183 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a4649-13f1-4ce9-adcb-1e5a3c7d0295 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:58.327446 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a4649-13f1-4ce9-adcb-1e5a3c7d0295 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:58.327801 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a4649-13f1-4ce9-adcb-1e5a3c7d0295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:58.339309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a4649-13f1-4ce9-adcb-1e5a3c7d0295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:58.340935 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a4649-13f1-4ce9-adcb-1e5a3c7d0295 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:58.352498 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1432/2882] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:41:58.694397 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cdfdb-a6d7-4f80-823f-ed04683bf27d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:58.696686 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c88cdfdb-a6d7-4f80-823f-ed04683bf27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:58.718471 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cdfdb-a6d7-4f80-823f-ed04683bf27d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:58.726262 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:58.727196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:58.727644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:58.728176 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0 admin admin] PATH_INFO: `/v3/projects/74a793b4cdd44b63b9c8af3f0f2e268c` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:58.730034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a793b4cdd44b63b9c8af3f0f2e268c)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:58.732585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:58.799693 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a793b4cdd44b63b9c8af3f0f2e268c', 'request_id': 'req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:58.807691 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a793b4cdd44b63b9c8af3f0f2e268c', 'request_id': 'req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:58.819596 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a793b4cdd44b63b9c8af3f0f2e268c', 'request_id': 'req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:58.834622 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0 admin admin] The token cache is being invalidate because project 74a793b4cdd44b63b9c8af3f0f2e268c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:41:58.835043 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:58.836266 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:58.838613 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1451/2883] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:41:58 2022] DELETE /identity/v3/projects/74a793b4cdd44b63b9c8af3f0f2e268c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:58.844134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a4649-13f1-4ce9-adcb-1e5a3c7d0295 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:58.862360 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a4649-13f1-4ce9-adcb-1e5a3c7d0295 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:58.922599 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:58.963050 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfdf85-e9b7-4586-bf90-9df772f406b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:58.964087 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfdf85-e9b7-4586-bf90-9df772f406b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:58.964829 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfdf85-e9b7-4586-bf90-9df772f406b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:58.964829 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfdf85-e9b7-4586-bf90-9df772f406b3 admin admin] PATH_INFO: `/v3/users/fe91f80496b6447cade1a798eb5bd125` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:58.966207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfdf85-e9b7-4586-bf90-9df772f406b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe91f80496b6447cade1a798eb5bd125)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:58.969134 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfdf85-e9b7-4586-bf90-9df772f406b3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:59.037873 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-50dfdf85-e9b7-4586-bf90-9df772f406b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe91f80496b6447cade1a798eb5bd125'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:59.056307 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-50dfdf85-e9b7-4586-bf90-9df772f406b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe91f80496b6447cade1a798eb5bd125'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:59.070315 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-50dfdf85-e9b7-4586-bf90-9df772f406b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe91f80496b6447cade1a798eb5bd125'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:59.071487 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-50dfdf85-e9b7-4586-bf90-9df772f406b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe91f80496b6447cade1a798eb5bd125'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:59.083993 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-50dfdf85-e9b7-4586-bf90-9df772f406b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe91f80496b6447cade1a798eb5bd125'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:59.093402 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1433/2884] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:41:58 2022] DELETE /identity/v3/users/fe91f80496b6447cade1a798eb5bd125 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:41:59.529927 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:59.531903 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:59.549848 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d628d9-03f1-4d61-a7f7-0c12b03f03c0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:59.626306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad77ef-1c64-40c0-bbd8-df183d6e3319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:59.626972 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad77ef-1c64-40c0-bbd8-df183d6e3319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:59.627248 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad77ef-1c64-40c0-bbd8-df183d6e3319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:59.627522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad77ef-1c64-40c0-bbd8-df183d6e3319 admin admin] PATH_INFO: `/v3/projects/4171c75e20914a848407c194cb22c03f` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:59.628812 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad77ef-1c64-40c0-bbd8-df183d6e3319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4171c75e20914a848407c194cb22c03f)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:59.630830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad77ef-1c64-40c0-bbd8-df183d6e3319 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:59.688342 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6bad77ef-1c64-40c0-bbd8-df183d6e3319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4171c75e20914a848407c194cb22c03f', 'request_id': 'req-6bad77ef-1c64-40c0-bbd8-df183d6e3319'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:59.698544 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6bad77ef-1c64-40c0-bbd8-df183d6e3319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4171c75e20914a848407c194cb22c03f', 'request_id': 'req-6bad77ef-1c64-40c0-bbd8-df183d6e3319'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:59.715310 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6bad77ef-1c64-40c0-bbd8-df183d6e3319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4171c75e20914a848407c194cb22c03f', 'request_id': 'req-6bad77ef-1c64-40c0-bbd8-df183d6e3319'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:59.731123 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6bad77ef-1c64-40c0-bbd8-df183d6e3319 admin admin] The token cache is being invalidate because project 4171c75e20914a848407c194cb22c03f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:41:59.731563 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6bad77ef-1c64-40c0-bbd8-df183d6e3319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:59.732354 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6bad77ef-1c64-40c0-bbd8-df183d6e3319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:41:59.734395 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1452/2885] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:41:59 2022] DELETE /identity/v3/projects/4171c75e20914a848407c194cb22c03f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:41:59.742092 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfb85d-e4f6-48a7-93f8-d4f44a469f68 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:59.742499 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfb85d-e4f6-48a7-93f8-d4f44a469f68 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:59.742849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfb85d-e4f6-48a7-93f8-d4f44a469f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:59.776529 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-32dfb85d-e4f6-48a7-93f8-d4f44a469f68 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:59.778267 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-32dfb85d-e4f6-48a7-93f8-d4f44a469f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:59.880937 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1434/2886] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:41:59.894604 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78109f-fdd8-4b43-b35b-444825f4f0ce None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:59.894965 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78109f-fdd8-4b43-b35b-444825f4f0ce None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:59.895196 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78109f-fdd8-4b43-b35b-444825f4f0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:59.906661 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:59.923926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-bf78109f-fdd8-4b43-b35b-444825f4f0ce None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:41:59.925350 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bf78109f-fdd8-4b43-b35b-444825f4f0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:59.933830 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1453/2887] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:41:59.940044 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfb85d-e4f6-48a7-93f8-d4f44a469f68 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:59.959009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfb85d-e4f6-48a7-93f8-d4f44a469f68 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:59.967043 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2522cf-f4fa-4cd2-bad2-d73b5c1a5fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:59.968086 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2522cf-f4fa-4cd2-bad2-d73b5c1a5fac admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:59.968585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2522cf-f4fa-4cd2-bad2-d73b5c1a5fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:59.969067 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2522cf-f4fa-4cd2-bad2-d73b5c1a5fac admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:59.970493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2522cf-f4fa-4cd2-bad2-d73b5c1a5fac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:41:59.971022 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2522cf-f4fa-4cd2-bad2-d73b5c1a5fac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:59.974253 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2522cf-f4fa-4cd2-bad2-d73b5c1a5fac admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:59.991015 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1435/2888] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:41:59.996300 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78109f-fdd8-4b43-b35b-444825f4f0ce None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:00.006438 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78109f-fdd8-4b43-b35b-444825f4f0ce None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:00.011698 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d907f5f-781e-4e77-aa80-34148610b3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:00.012463 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d907f5f-781e-4e77-aa80-34148610b3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:00.012843 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d907f5f-781e-4e77-aa80-34148610b3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:00.013215 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d907f5f-781e-4e77-aa80-34148610b3b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:00.014094 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d907f5f-781e-4e77-aa80-34148610b3b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:00.016144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d907f5f-781e-4e77-aa80-34148610b3b3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:00.056052 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1454/2889] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:41:59 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:42:00.060815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2522cf-f4fa-4cd2-bad2-d73b5c1a5fac admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:00.072829 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2522cf-f4fa-4cd2-bad2-d73b5c1a5fac admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:00.127033 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:00.148527 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196d34b-8552-4dff-a18a-91098f2b83d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:00.149149 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196d34b-8552-4dff-a18a-91098f2b83d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:00.149465 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196d34b-8552-4dff-a18a-91098f2b83d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:00.149747 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196d34b-8552-4dff-a18a-91098f2b83d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:00.150377 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196d34b-8552-4dff-a18a-91098f2b83d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:00.152324 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196d34b-8552-4dff-a18a-91098f2b83d7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:00.180397 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1436/2890] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:42:00 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:42:00.187354 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d907f5f-781e-4e77-aa80-34148610b3b3 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:00.206523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d907f5f-781e-4e77-aa80-34148610b3b3 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:00.214522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e55d2-69a5-436b-b2cd-6e2358cdceb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:00.215573 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e55d2-69a5-436b-b2cd-6e2358cdceb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:00.216089 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e55d2-69a5-436b-b2cd-6e2358cdceb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:00.216591 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e55d2-69a5-436b-b2cd-6e2358cdceb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:00.217851 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e55d2-69a5-436b-b2cd-6e2358cdceb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:00.221109 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e55d2-69a5-436b-b2cd-6e2358cdceb3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:00.240511 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1455/2891] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:42:00.245633 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196d34b-8552-4dff-a18a-91098f2b83d7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:00.260029 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196d34b-8552-4dff-a18a-91098f2b83d7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:00.266977 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d1e50-8c61-457d-8ee5-f26a67ba873f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:00.267940 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d1e50-8c61-457d-8ee5-f26a67ba873f admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:00.268222 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d1e50-8c61-457d-8ee5-f26a67ba873f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:00.268555 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d1e50-8c61-457d-8ee5-f26a67ba873f admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:00.269280 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d1e50-8c61-457d-8ee5-f26a67ba873f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:00.271136 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d1e50-8c61-457d-8ee5-f26a67ba873f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:00.284905 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1437/2892] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:42:00.290527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e55d2-69a5-436b-b2cd-6e2358cdceb3 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:00.307410 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e55d2-69a5-436b-b2cd-6e2358cdceb3 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:00.314425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59bb1e2-0a00-426a-a37e-b21b3d939ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:00.315305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bb1e2-0a00-426a-a37e-b21b3d939ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:00.315678 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bb1e2-0a00-426a-a37e-b21b3d939ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:00.316017 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bb1e2-0a00-426a-a37e-b21b3d939ac4 admin admin] PATH_INFO: `/v3/projects/a2f897304c584bda8d25caf958d02f5f/users/b4758fd89481459699b369896d12c6eb/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:00.341603 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59bb1e2-0a00-426a-a37e-b21b3d939ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f897304c584bda8d25caf958d02f5f, user_id=b4758fd89481459699b369896d12c6eb, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:00.346175 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59bb1e2-0a00-426a-a37e-b21b3d939ac4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:00.367055 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1456/2893] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:42:00 2022] PUT /identity/v3/projects/a2f897304c584bda8d25caf958d02f5f/users/b4758fd89481459699b369896d12c6eb/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:42:00.373799 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229c3c7-2762-4a8c-9942-8156f0064a1c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:00.374213 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229c3c7-2762-4a8c-9942-8156f0064a1c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:00.374573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229c3c7-2762-4a8c-9942-8156f0064a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:00.408650 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d229c3c7-2762-4a8c-9942-8156f0064a1c None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:42:00.411145 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d229c3c7-2762-4a8c-9942-8156f0064a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:00.525662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1438/2894] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:42:00.540614 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59bb1e2-0a00-426a-a37e-b21b3d939ac4 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:00.543557 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a59bb1e2-0a00-426a-a37e-b21b3d939ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:00.650848 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59bb1e2-0a00-426a-a37e-b21b3d939ac4 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:00.656495 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248bd24-cf63-4e51-be2b-1aaf5070c3ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:00.657324 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248bd24-cf63-4e51-be2b-1aaf5070c3ac service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:00.657708 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248bd24-cf63-4e51-be2b-1aaf5070c3ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:00.657995 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248bd24-cf63-4e51-be2b-1aaf5070c3ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:00.675648 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248bd24-cf63-4e51-be2b-1aaf5070c3ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:00.678853 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248bd24-cf63-4e51-be2b-1aaf5070c3ac service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:00.699866 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1457/2895] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:42:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:42:01.650917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65398295-4dcf-45cb-b6ee-030339340840 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:01.651732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65398295-4dcf-45cb-b6ee-030339340840 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:01.651732 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65398295-4dcf-45cb-b6ee-030339340840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:01.689321 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-65398295-4dcf-45cb-b6ee-030339340840 None None] MFA Rules not processed for user `b4758fd89481459699b369896d12c6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:42:01.690657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-65398295-4dcf-45cb-b6ee-030339340840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:01.780842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1439/2896] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:42:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:42:01.786586 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248bd24-cf63-4e51-be2b-1aaf5070c3ac service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:01.799940 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248bd24-cf63-4e51-be2b-1aaf5070c3ac service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:01.806103 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51b0b6-4e3d-405e-8191-e6b965423276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:01.806839 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b0b6-4e3d-405e-8191-e6b965423276 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:01.807178 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b0b6-4e3d-405e-8191-e6b965423276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:01.807518 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b0b6-4e3d-405e-8191-e6b965423276 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:01.808305 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51b0b6-4e3d-405e-8191-e6b965423276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:01.811932 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51b0b6-4e3d-405e-8191-e6b965423276 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:01.857329 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1458/2897] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:42:01 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:42:01.864328 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65398295-4dcf-45cb-b6ee-030339340840 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:01.882226 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65398295-4dcf-45cb-b6ee-030339340840 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:01.959200 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:01.975281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f10ba-0a45-481c-97fb-a8a2b30c6c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:01.976174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f10ba-0a45-481c-97fb-a8a2b30c6c3f admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:01.976503 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f10ba-0a45-481c-97fb-a8a2b30c6c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:01.976787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f10ba-0a45-481c-97fb-a8a2b30c6c3f admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:01.977811 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f10ba-0a45-481c-97fb-a8a2b30c6c3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:01.980289 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f10ba-0a45-481c-97fb-a8a2b30c6c3f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:02.015170 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1440/2898] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:42:01 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:42:02.019883 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51b0b6-4e3d-405e-8191-e6b965423276 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:02.034012 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51b0b6-4e3d-405e-8191-e6b965423276 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:02.041034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861453c-00d9-4f91-a9c9-dcef8d07cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:02.041926 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861453c-00d9-4f91-a9c9-dcef8d07cf53 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:02.042337 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861453c-00d9-4f91-a9c9-dcef8d07cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:02.042728 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861453c-00d9-4f91-a9c9-dcef8d07cf53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:02.043535 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861453c-00d9-4f91-a9c9-dcef8d07cf53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:02.045694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861453c-00d9-4f91-a9c9-dcef8d07cf53 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:02.059161 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1459/2899] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:42:02.063952 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f10ba-0a45-481c-97fb-a8a2b30c6c3f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:02.076050 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f10ba-0a45-481c-97fb-a8a2b30c6c3f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:02.082251 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d16f5-60de-4ef9-a197-37eaf1b9938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:02.083389 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d16f5-60de-4ef9-a197-37eaf1b9938e admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:02.083867 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d16f5-60de-4ef9-a197-37eaf1b9938e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:02.084361 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d16f5-60de-4ef9-a197-37eaf1b9938e admin admin] PATH_INFO: `/v3/projects/fbb6971db2974c7bb6268933bb32f442/users/8bd518112f6a4297af6a0231cd56bb56/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:02.107490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d16f5-60de-4ef9-a197-37eaf1b9938e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb6971db2974c7bb6268933bb32f442, user_id=8bd518112f6a4297af6a0231cd56bb56, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:02.110829 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d16f5-60de-4ef9-a197-37eaf1b9938e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:02.128911 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1441/2900] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:42:02 2022] PUT /identity/v3/projects/fbb6971db2974c7bb6268933bb32f442/users/8bd518112f6a4297af6a0231cd56bb56/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:42:02.133585 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861453c-00d9-4f91-a9c9-dcef8d07cf53 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:02.146148 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861453c-00d9-4f91-a9c9-dcef8d07cf53 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:02.247096 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103a8ff-dd90-4d83-850f-f51f8cfd1994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:02.247752 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a8ff-dd90-4d83-850f-f51f8cfd1994 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:02.248078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a8ff-dd90-4d83-850f-f51f8cfd1994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:02.248394 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a8ff-dd90-4d83-850f-f51f8cfd1994 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:02.249201 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103a8ff-dd90-4d83-850f-f51f8cfd1994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:02.251439 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103a8ff-dd90-4d83-850f-f51f8cfd1994 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:02.266603 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1460/2901] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:42:02.272281 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d16f5-60de-4ef9-a197-37eaf1b9938e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:02.284476 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d16f5-60de-4ef9-a197-37eaf1b9938e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:02.290620 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652381b-87e0-40c6-9888-bf70f6f80f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:02.291544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652381b-87e0-40c6-9888-bf70f6f80f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:02.292006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652381b-87e0-40c6-9888-bf70f6f80f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:02.292490 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652381b-87e0-40c6-9888-bf70f6f80f18 admin admin] PATH_INFO: `/v3/projects/fbb6971db2974c7bb6268933bb32f442/users/8bd518112f6a4297af6a0231cd56bb56/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:02.295843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652381b-87e0-40c6-9888-bf70f6f80f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb6971db2974c7bb6268933bb32f442, user_id=8bd518112f6a4297af6a0231cd56bb56, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:02.301524 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652381b-87e0-40c6-9888-bf70f6f80f18 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:02.318418 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1442/2902] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:42:02 2022] PUT /identity/v3/projects/fbb6971db2974c7bb6268933bb32f442/users/8bd518112f6a4297af6a0231cd56bb56/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:42:03.143589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356946a8-2f39-4b4b-87f6-8d20206d375d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:03.144508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356946a8-2f39-4b4b-87f6-8d20206d375d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:03.144886 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356946a8-2f39-4b4b-87f6-8d20206d375d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:03.175742 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:03.204202 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-356946a8-2f39-4b4b-87f6-8d20206d375d None None] MFA Rules not processed for user `8bd518112f6a4297af6a0231cd56bb56`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:42:03.206333 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-356946a8-2f39-4b4b-87f6-8d20206d375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:03.324038 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1461/2903] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:42:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:42:03.337787 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cc127-5200-483f-a667-d923186dd706 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:03.338544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cc127-5200-483f-a667-d923186dd706 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:03.338544 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cc127-5200-483f-a667-d923186dd706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:03.361768 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-563cc127-5200-483f-a667-d923186dd706 None None] MFA Rules not processed for user `b4758fd89481459699b369896d12c6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:42:03.362410 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-563cc127-5200-483f-a667-d923186dd706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:03.444374 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1443/2904] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:42:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:42:03.457884 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356946a8-2f39-4b4b-87f6-8d20206d375d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:03.459745 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-356946a8-2f39-4b4b-87f6-8d20206d375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:03.548144 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356946a8-2f39-4b4b-87f6-8d20206d375d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:03.554589 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144726a4-2a61-43e1-afd9-215866fcbcce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:03.555234 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144726a4-2a61-43e1-afd9-215866fcbcce service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:03.555559 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144726a4-2a61-43e1-afd9-215866fcbcce service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:03.555795 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144726a4-2a61-43e1-afd9-215866fcbcce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:03.567176 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144726a4-2a61-43e1-afd9-215866fcbcce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:03.569035 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144726a4-2a61-43e1-afd9-215866fcbcce service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:03.580676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1462/2905] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:42:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:42:03.867093 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cc127-5200-483f-a667-d923186dd706 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:03.868774 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-563cc127-5200-483f-a667-d923186dd706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:03.948844 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cc127-5200-483f-a667-d923186dd706 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:03.952902 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3f5fe-752b-4d96-8cdf-0f401cee3fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:03.953677 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3f5fe-752b-4d96-8cdf-0f401cee3fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:03.954014 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3f5fe-752b-4d96-8cdf-0f401cee3fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:03.954330 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3f5fe-752b-4d96-8cdf-0f401cee3fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:03.956380 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-58e3f5fe-752b-4d96-8cdf-0f401cee3fb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:03.968079 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3f5fe-752b-4d96-8cdf-0f401cee3fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:03.969575 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3f5fe-752b-4d96-8cdf-0f401cee3fb1 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:03.979174 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1444/2906] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:42:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:42:04.412939 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144726a4-2a61-43e1-afd9-215866fcbcce service nova] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:04.415213 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-144726a4-2a61-43e1-afd9-215866fcbcce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:04.522575 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144726a4-2a61-43e1-afd9-215866fcbcce service nova] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:04.530856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea70b5-8add-484d-b0b5-95b6f09b972d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8295272eec349f8aa38e44c861faa47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:04.530856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea70b5-8add-484d-b0b5-95b6f09b972d service placement] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:04.530856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea70b5-8add-484d-b0b5-95b6f09b972d service placement] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:04.530856 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea70b5-8add-484d-b0b5-95b6f09b972d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:04.534120 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-86ea70b5-8add-484d-b0b5-95b6f09b972d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:04.556992 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea70b5-8add-484d-b0b5-95b6f09b972d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:04.560243 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea70b5-8add-484d-b0b5-95b6f09b972d service placement] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:04.576306 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1463/2907] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:42:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:42:07.168085 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3f5fe-752b-4d96-8cdf-0f401cee3fb1 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:07.180817 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3f5fe-752b-4d96-8cdf-0f401cee3fb1 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:07.188057 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996256c1-dcf0-41e8-bc5e-a91a7b52ab23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:07.189201 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996256c1-dcf0-41e8-bc5e-a91a7b52ab23 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:07.189757 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996256c1-dcf0-41e8-bc5e-a91a7b52ab23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:07.190230 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996256c1-dcf0-41e8-bc5e-a91a7b52ab23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:07.193603 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-996256c1-dcf0-41e8-bc5e-a91a7b52ab23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:07.213289 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996256c1-dcf0-41e8-bc5e-a91a7b52ab23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:07.215096 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996256c1-dcf0-41e8-bc5e-a91a7b52ab23 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:07.228568 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1445/2908] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:42:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:42:08.185907 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea70b5-8add-484d-b0b5-95b6f09b972d service placement] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:08.189560 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-86ea70b5-8add-484d-b0b5-95b6f09b972d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:08.209676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea70b5-8add-484d-b0b5-95b6f09b972d service placement] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:08.217953 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ada3b-cf55-48e4-85b5-54978081ca1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:08.218732 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ada3b-cf55-48e4-85b5-54978081ca1c service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:08.219051 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ada3b-cf55-48e4-85b5-54978081ca1c service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:08.219369 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ada3b-cf55-48e4-85b5-54978081ca1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:08.221787 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-741ada3b-cf55-48e4-85b5-54978081ca1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:08.233861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:08.241740 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ada3b-cf55-48e4-85b5-54978081ca1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:08.244763 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ada3b-cf55-48e4-85b5-54978081ca1c service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:08.261957 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1464/2909] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:42:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:42:12.800414 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996256c1-dcf0-41e8-bc5e-a91a7b52ab23 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:12.824367 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996256c1-dcf0-41e8-bc5e-a91a7b52ab23 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:12.834148 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ae529-ae43-4076-8bf7-622404a7485e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c95d16fd4da4fa7987b893eae0b3ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:12.835150 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ae529-ae43-4076-8bf7-622404a7485e service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:12.835645 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ae529-ae43-4076-8bf7-622404a7485e service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:12.836067 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ae529-ae43-4076-8bf7-622404a7485e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:12.839808 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d12ae529-ae43-4076-8bf7-622404a7485e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:12.856092 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ae529-ae43-4076-8bf7-622404a7485e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:12.858686 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ae529-ae43-4076-8bf7-622404a7485e service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:12.874523 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1446/2910] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:42:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:42:17.256644 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ada3b-cf55-48e4-85b5-54978081ca1c service nova] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:17.258659 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-741ada3b-cf55-48e4-85b5-54978081ca1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:17.327687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ada3b-cf55-48e4-85b5-54978081ca1c service nova] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:17.332342 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c62d2-5771-4a5c-8c95-388ca831403e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:17.333403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c62d2-5771-4a5c-8c95-388ca831403e service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:17.333710 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c62d2-5771-4a5c-8c95-388ca831403e service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:17.334034 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c62d2-5771-4a5c-8c95-388ca831403e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:17.351638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c62d2-5771-4a5c-8c95-388ca831403e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:17.353668 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c62d2-5771-4a5c-8c95-388ca831403e service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:17.366877 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1465/2911] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:42:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:42:22.868537 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=84,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:27.360684 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=29 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:37.684000 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ae529-ae43-4076-8bf7-622404a7485e service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:37.697390 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ae529-ae43-4076-8bf7-622404a7485e service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:37.703382 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3f82b-4445-4443-a8e1-8703facf7d6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8295272eec349f8aa38e44c861faa47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:37.704020 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3f82b-4445-4443-a8e1-8703facf7d6f service placement] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:37.704337 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3f82b-4445-4443-a8e1-8703facf7d6f service placement] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:37.704609 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3f82b-4445-4443-a8e1-8703facf7d6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:37.707242 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-73c3f82b-4445-4443-a8e1-8703facf7d6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:37.725896 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3f82b-4445-4443-a8e1-8703facf7d6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:37.728953 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3f82b-4445-4443-a8e1-8703facf7d6f service placement] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:37.750565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1447/2912] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:42:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:42:38.365068 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c62d2-5771-4a5c-8c95-388ca831403e service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:38.446147 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c62d2-5771-4a5c-8c95-388ca831403e service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:38.452287 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af2354-45a1-413d-b5e9-8d3926c11e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:38.452919 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af2354-45a1-413d-b5e9-8d3926c11e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:38.453210 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af2354-45a1-413d-b5e9-8d3926c11e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:38.453514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af2354-45a1-413d-b5e9-8d3926c11e60 admin admin] PATH_INFO: `/v3/users/b4758fd89481459699b369896d12c6eb` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:38.454631 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af2354-45a1-413d-b5e9-8d3926c11e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4758fd89481459699b369896d12c6eb)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:38.456540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af2354-45a1-413d-b5e9-8d3926c11e60 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:38.512284 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-23af2354-45a1-413d-b5e9-8d3926c11e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4758fd89481459699b369896d12c6eb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:38.523186 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-23af2354-45a1-413d-b5e9-8d3926c11e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4758fd89481459699b369896d12c6eb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:38.538527 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-23af2354-45a1-413d-b5e9-8d3926c11e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4758fd89481459699b369896d12c6eb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:38.539482 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-23af2354-45a1-413d-b5e9-8d3926c11e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4758fd89481459699b369896d12c6eb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:38.540082 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-23af2354-45a1-413d-b5e9-8d3926c11e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4758fd89481459699b369896d12c6eb'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:38.553508 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1466/2913] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:42:38 2022] DELETE /identity/v3/users/b4758fd89481459699b369896d12c6eb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:42:38.750849 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3f82b-4445-4443-a8e1-8703facf7d6f service placement] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:38.768138 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3f82b-4445-4443-a8e1-8703facf7d6f service placement] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:38.846932 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e2e81-0af0-4f22-82bc-9a7559a2857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:38.848320 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e2e81-0af0-4f22-82bc-9a7559a2857c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:38.848320 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e2e81-0af0-4f22-82bc-9a7559a2857c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:38.848320 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e2e81-0af0-4f22-82bc-9a7559a2857c admin admin] PATH_INFO: `/v3/projects/a2f897304c584bda8d25caf958d02f5f` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:38.849667 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e2e81-0af0-4f22-82bc-9a7559a2857c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f897304c584bda8d25caf958d02f5f)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:38.851605 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e2e81-0af0-4f22-82bc-9a7559a2857c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:38.903455 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-830e2e81-0af0-4f22-82bc-9a7559a2857c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f897304c584bda8d25caf958d02f5f', 'request_id': 'req-830e2e81-0af0-4f22-82bc-9a7559a2857c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:38.911906 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-830e2e81-0af0-4f22-82bc-9a7559a2857c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f897304c584bda8d25caf958d02f5f', 'request_id': 'req-830e2e81-0af0-4f22-82bc-9a7559a2857c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:38.919915 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-830e2e81-0af0-4f22-82bc-9a7559a2857c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f897304c584bda8d25caf958d02f5f', 'request_id': 'req-830e2e81-0af0-4f22-82bc-9a7559a2857c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:38.933715 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-830e2e81-0af0-4f22-82bc-9a7559a2857c admin admin] The token cache is being invalidate because project a2f897304c584bda8d25caf958d02f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:42:38.934150 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-830e2e81-0af0-4f22-82bc-9a7559a2857c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:38.934946 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-830e2e81-0af0-4f22-82bc-9a7559a2857c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:38.936695 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1448/2914] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:42:38 2022] DELETE /identity/v3/projects/a2f897304c584bda8d25caf958d02f5f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:42:38.941205 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af2354-45a1-413d-b5e9-8d3926c11e60 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:38.943115 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-23af2354-45a1-413d-b5e9-8d3926c11e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:38.958022 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af2354-45a1-413d-b5e9-8d3926c11e60 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:39.035756 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a4886-b25c-4bd1-bc23-842d49e90dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:39.037151 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a4886-b25c-4bd1-bc23-842d49e90dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:39.037701 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a4886-b25c-4bd1-bc23-842d49e90dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:39.038213 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a4886-b25c-4bd1-bc23-842d49e90dd1 admin admin] PATH_INFO: `/v3/users/8bd518112f6a4297af6a0231cd56bb56` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:39.040477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a4886-b25c-4bd1-bc23-842d49e90dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd518112f6a4297af6a0231cd56bb56)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:39.044447 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a4886-b25c-4bd1-bc23-842d49e90dd1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:39.083612 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:39.127664 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f48a4886-b25c-4bd1-bc23-842d49e90dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd518112f6a4297af6a0231cd56bb56'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:39.139463 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f48a4886-b25c-4bd1-bc23-842d49e90dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd518112f6a4297af6a0231cd56bb56'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:39.155412 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f48a4886-b25c-4bd1-bc23-842d49e90dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd518112f6a4297af6a0231cd56bb56'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:39.156281 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f48a4886-b25c-4bd1-bc23-842d49e90dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd518112f6a4297af6a0231cd56bb56'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:39.156999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f48a4886-b25c-4bd1-bc23-842d49e90dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd518112f6a4297af6a0231cd56bb56'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:39.172078 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1467/2915] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:42:38 2022] DELETE /identity/v3/users/8bd518112f6a4297af6a0231cd56bb56 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:42:39.406657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e2e81-0af0-4f22-82bc-9a7559a2857c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:39.410693 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-830e2e81-0af0-4f22-82bc-9a7559a2857c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:39.429162 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e2e81-0af0-4f22-82bc-9a7559a2857c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:39.520920 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb057d20-5f64-46b5-8a30-ea518314917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:39.521884 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb057d20-5f64-46b5-8a30-ea518314917a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:39.522237 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb057d20-5f64-46b5-8a30-ea518314917a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:39.522582 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb057d20-5f64-46b5-8a30-ea518314917a admin admin] PATH_INFO: `/v3/projects/fbb6971db2974c7bb6268933bb32f442` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:39.524151 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb057d20-5f64-46b5-8a30-ea518314917a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbb6971db2974c7bb6268933bb32f442)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:39.527655 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb057d20-5f64-46b5-8a30-ea518314917a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:39.554068 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:39.591325 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-cb057d20-5f64-46b5-8a30-ea518314917a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb6971db2974c7bb6268933bb32f442', 'request_id': 'req-cb057d20-5f64-46b5-8a30-ea518314917a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:39.601009 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-cb057d20-5f64-46b5-8a30-ea518314917a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb6971db2974c7bb6268933bb32f442', 'request_id': 'req-cb057d20-5f64-46b5-8a30-ea518314917a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:39.615115 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-cb057d20-5f64-46b5-8a30-ea518314917a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb6971db2974c7bb6268933bb32f442', 'request_id': 'req-cb057d20-5f64-46b5-8a30-ea518314917a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:39.634443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-cb057d20-5f64-46b5-8a30-ea518314917a admin admin] The token cache is being invalidate because project fbb6971db2974c7bb6268933bb32f442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:42:39.634809 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-cb057d20-5f64-46b5-8a30-ea518314917a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:39.635866 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-cb057d20-5f64-46b5-8a30-ea518314917a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:39.638505 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1449/2916] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:42:39 2022] DELETE /identity/v3/projects/fbb6971db2974c7bb6268933bb32f442 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:42:39.645664 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e0e53-81d3-4069-af6e-aa608919f4eb None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:39.646425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e0e53-81d3-4069-af6e-aa608919f4eb None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:39.646425 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e0e53-81d3-4069-af6e-aa608919f4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:39.671715 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-cb8e0e53-81d3-4069-af6e-aa608919f4eb None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:42:39.673881 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cb8e0e53-81d3-4069-af6e-aa608919f4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:39.777481 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1468/2917] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:42:39.789868 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530232f-9817-42fd-9b82-dfa695822ebe None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:39.790819 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530232f-9817-42fd-9b82-dfa695822ebe None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:39.790819 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530232f-9817-42fd-9b82-dfa695822ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:39.826776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-a530232f-9817-42fd-9b82-dfa695822ebe None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:42:39.829897 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a530232f-9817-42fd-9b82-dfa695822ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:39.842411 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1450/2918] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:42:39.849054 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e0e53-81d3-4069-af6e-aa608919f4eb None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:39.860624 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e0e53-81d3-4069-af6e-aa608919f4eb None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:39.872873 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145349d2-020f-47dd-a382-cdac94c9799d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:39.873606 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145349d2-020f-47dd-a382-cdac94c9799d admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:39.873880 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145349d2-020f-47dd-a382-cdac94c9799d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:39.874143 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145349d2-020f-47dd-a382-cdac94c9799d admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:39.874798 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145349d2-020f-47dd-a382-cdac94c9799d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:42:39.875155 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145349d2-020f-47dd-a382-cdac94c9799d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:39.876887 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145349d2-020f-47dd-a382-cdac94c9799d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:39.901326 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1469/2919] 10.222.0.52 () {58 vars in 1153 bytes} [Mon Aug 29 20:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:42:39.908007 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530232f-9817-42fd-9b82-dfa695822ebe None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:39.920519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530232f-9817-42fd-9b82-dfa695822ebe None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:39.931680 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec70e83-eebf-40f7-8506-f2ff31d79a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:39.932307 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec70e83-eebf-40f7-8506-f2ff31d79a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:39.933235 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec70e83-eebf-40f7-8506-f2ff31d79a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:39.933235 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec70e83-eebf-40f7-8506-f2ff31d79a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:39.934225 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec70e83-eebf-40f7-8506-f2ff31d79a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:39.935612 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec70e83-eebf-40f7-8506-f2ff31d79a01 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:39.976114 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1451/2920] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:42:39 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:42:39.981417 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145349d2-020f-47dd-a382-cdac94c9799d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:39.994490 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145349d2-020f-47dd-a382-cdac94c9799d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:40.082344 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543c313-7965-4469-b4e3-7ab95ec2a85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:40.083339 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543c313-7965-4469-b4e3-7ab95ec2a85f admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:40.083861 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543c313-7965-4469-b4e3-7ab95ec2a85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:40.084375 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543c313-7965-4469-b4e3-7ab95ec2a85f admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:40.085626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543c313-7965-4469-b4e3-7ab95ec2a85f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:40.089590 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543c313-7965-4469-b4e3-7ab95ec2a85f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:40.125866 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1470/2921] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:42:39 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:42:40.132565 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec70e83-eebf-40f7-8506-f2ff31d79a01 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:40.148944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec70e83-eebf-40f7-8506-f2ff31d79a01 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:40.155530 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1fa6b-52c1-4f15-a4b4-9a36094d7993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:40.156443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1fa6b-52c1-4f15-a4b4-9a36094d7993 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:40.156784 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1fa6b-52c1-4f15-a4b4-9a36094d7993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:40.157139 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1fa6b-52c1-4f15-a4b4-9a36094d7993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:40.158116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1fa6b-52c1-4f15-a4b4-9a36094d7993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:40.160207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1fa6b-52c1-4f15-a4b4-9a36094d7993 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:40.181493 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1452/2922] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:42:40.186986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543c313-7965-4469-b4e3-7ab95ec2a85f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:40.205056 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543c313-7965-4469-b4e3-7ab95ec2a85f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:40.213652 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45022ac3-093d-4ac4-8109-08338dcab369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:40.214725 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45022ac3-093d-4ac4-8109-08338dcab369 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:40.215231 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45022ac3-093d-4ac4-8109-08338dcab369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:40.215729 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45022ac3-093d-4ac4-8109-08338dcab369 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:40.216892 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45022ac3-093d-4ac4-8109-08338dcab369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:40.220400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45022ac3-093d-4ac4-8109-08338dcab369 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:40.242091 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1471/2923] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:42:40.247443 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1fa6b-52c1-4f15-a4b4-9a36094d7993 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:40.262711 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1fa6b-52c1-4f15-a4b4-9a36094d7993 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:40.268767 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64e7ae-633f-4334-b2b1-4ddfc7bfca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:40.269514 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64e7ae-633f-4334-b2b1-4ddfc7bfca78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:40.269792 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64e7ae-633f-4334-b2b1-4ddfc7bfca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:40.270068 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64e7ae-633f-4334-b2b1-4ddfc7bfca78 admin admin] PATH_INFO: `/v3/projects/ad920bcf8c574a9485da4dfb2a879ee1/users/cd3ed1e04e1949408325c1bc5053f078/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:40.289723 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64e7ae-633f-4334-b2b1-4ddfc7bfca78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad920bcf8c574a9485da4dfb2a879ee1, user_id=cd3ed1e04e1949408325c1bc5053f078, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:40.292357 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64e7ae-633f-4334-b2b1-4ddfc7bfca78 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:40.308145 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1453/2924] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:42:40 2022] PUT /identity/v3/projects/ad920bcf8c574a9485da4dfb2a879ee1/users/cd3ed1e04e1949408325c1bc5053f078/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:42:40.320400 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12872733-af75-43c0-a8b2-eaca73ccbebc None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:40.320687 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12872733-af75-43c0-a8b2-eaca73ccbebc None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:40.321049 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12872733-af75-43c0-a8b2-eaca73ccbebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:40.330072 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:40.362318 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-12872733-af75-43c0-a8b2-eaca73ccbebc None None] MFA Rules not processed for user `cd3ed1e04e1949408325c1bc5053f078`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:42:40.363588 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-12872733-af75-43c0-a8b2-eaca73ccbebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:40.452824 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1472/2925] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:42:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:42:40.458239 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64e7ae-633f-4334-b2b1-4ddfc7bfca78 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:40.540860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64e7ae-633f-4334-b2b1-4ddfc7bfca78 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:40.550448 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788a7af-6bc1-45c8-bcb6-e28828e48c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:40.551160 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788a7af-6bc1-45c8-bcb6-e28828e48c13 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:40.551640 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788a7af-6bc1-45c8-bcb6-e28828e48c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:40.552116 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788a7af-6bc1-45c8-bcb6-e28828e48c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:40.553324 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788a7af-6bc1-45c8-bcb6-e28828e48c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:40.556573 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788a7af-6bc1-45c8-bcb6-e28828e48c13 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:40.598606 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1454/2926] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:42:40 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:42:40.602947 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12872733-af75-43c0-a8b2-eaca73ccbebc None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:40.615031 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12872733-af75-43c0-a8b2-eaca73ccbebc None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:40.688380 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9085d7a-f402-494a-a3e0-312e3c636a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:40.689112 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9085d7a-f402-494a-a3e0-312e3c636a5f admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:40.689274 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9085d7a-f402-494a-a3e0-312e3c636a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:40.689599 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9085d7a-f402-494a-a3e0-312e3c636a5f admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:40.690261 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9085d7a-f402-494a-a3e0-312e3c636a5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:40.692246 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9085d7a-f402-494a-a3e0-312e3c636a5f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:40.730575 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1473/2927] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:42:40 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:42:40.735656 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788a7af-6bc1-45c8-bcb6-e28828e48c13 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:40.748106 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788a7af-6bc1-45c8-bcb6-e28828e48c13 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:40.754758 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44347f-89b4-4669-93ff-d4d43e40e81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:40.755302 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44347f-89b4-4669-93ff-d4d43e40e81f admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:40.755581 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44347f-89b4-4669-93ff-d4d43e40e81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:40.755842 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44347f-89b4-4669-93ff-d4d43e40e81f admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:40.756519 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44347f-89b4-4669-93ff-d4d43e40e81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:40.758266 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44347f-89b4-4669-93ff-d4d43e40e81f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:40.772013 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1455/2928] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:42:40.777143 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9085d7a-f402-494a-a3e0-312e3c636a5f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:40.789586 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9085d7a-f402-494a-a3e0-312e3c636a5f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:40.795255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a9bc9-a11f-4130-b041-3ec09e535c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:40.796200 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a9bc9-a11f-4130-b041-3ec09e535c97 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:40.796489 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a9bc9-a11f-4130-b041-3ec09e535c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:40.796758 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a9bc9-a11f-4130-b041-3ec09e535c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:40.797493 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a9bc9-a11f-4130-b041-3ec09e535c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:40.799197 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a9bc9-a11f-4130-b041-3ec09e535c97 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:40.810999 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1474/2929] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:42:40.816986 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44347f-89b4-4669-93ff-d4d43e40e81f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:40.828662 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44347f-89b4-4669-93ff-d4d43e40e81f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:40.834416 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de4109-17a5-4ea7-b814-519d2dcf9fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:40.835113 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de4109-17a5-4ea7-b814-519d2dcf9fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:40.835388 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de4109-17a5-4ea7-b814-519d2dcf9fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:40.835657 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de4109-17a5-4ea7-b814-519d2dcf9fdf admin admin] PATH_INFO: `/v3/projects/e4d201995ab94139bada50eb936b2a03/users/cb1b0f1653a542e68060735bdf1fdd41/roles/73f8d83949b241d2bcd58d267657768a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:40.855175 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de4109-17a5-4ea7-b814-519d2dcf9fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d201995ab94139bada50eb936b2a03, user_id=cb1b0f1653a542e68060735bdf1fdd41, role_id=73f8d83949b241d2bcd58d267657768a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:40.860933 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de4109-17a5-4ea7-b814-519d2dcf9fdf admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:40.864559 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:40.882904 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1456/2930] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:42:40 2022] PUT /identity/v3/projects/e4d201995ab94139bada50eb936b2a03/users/cb1b0f1653a542e68060735bdf1fdd41/roles/73f8d83949b241d2bcd58d267657768a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:42:40.895022 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201a99a-2e38-420f-b851-83b933102e4a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:40.895476 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201a99a-2e38-420f-b851-83b933102e4a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:40.895917 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201a99a-2e38-420f-b851-83b933102e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:40.939684 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7201a99a-2e38-420f-b851-83b933102e4a None None] MFA Rules not processed for user `cb1b0f1653a542e68060735bdf1fdd41`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:42:40.941054 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7201a99a-2e38-420f-b851-83b933102e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:41.030694 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1475/2931] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:42:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:42:41.039048 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de4109-17a5-4ea7-b814-519d2dcf9fdf admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:41.114919 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de4109-17a5-4ea7-b814-519d2dcf9fdf admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:41.119892 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62be40e-a762-462d-9ff5-42a645c37502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:41.120497 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62be40e-a762-462d-9ff5-42a645c37502 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:41.120766 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62be40e-a762-462d-9ff5-42a645c37502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:41.121035 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62be40e-a762-462d-9ff5-42a645c37502 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:41.121697 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62be40e-a762-462d-9ff5-42a645c37502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:41.123607 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62be40e-a762-462d-9ff5-42a645c37502 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:41.154109 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1457/2932] 10.222.0.52 () {60 vars in 1153 bytes} [Mon Aug 29 20:42:41 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:42:41.159335 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201a99a-2e38-420f-b851-83b933102e4a None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:41.165191 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:41.177453 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201a99a-2e38-420f-b851-83b933102e4a None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:41.258090 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e174f-3051-4943-90c8-ffe9d3a80b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:41.259127 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e174f-3051-4943-90c8-ffe9d3a80b2a admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:41.259626 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e174f-3051-4943-90c8-ffe9d3a80b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:41.260173 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e174f-3051-4943-90c8-ffe9d3a80b2a admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:41.261238 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e174f-3051-4943-90c8-ffe9d3a80b2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:41.265540 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e174f-3051-4943-90c8-ffe9d3a80b2a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:41.303534 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1476/2933] 10.222.0.52 () {60 vars in 1144 bytes} [Mon Aug 29 20:42:41 2022] POST /identity/v3/users => generated 295 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:42:41.307917 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62be40e-a762-462d-9ff5-42a645c37502 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:41.319034 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62be40e-a762-462d-9ff5-42a645c37502 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:41.324638 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadf453-61b0-4a90-a348-46e33d60956d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:41.325288 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadf453-61b0-4a90-a348-46e33d60956d admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:41.325700 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadf453-61b0-4a90-a348-46e33d60956d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:41.326048 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadf453-61b0-4a90-a348-46e33d60956d admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:41.326776 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadf453-61b0-4a90-a348-46e33d60956d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:41.328426 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadf453-61b0-4a90-a348-46e33d60956d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:41.340846 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1458/2934] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:42:41.347016 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e174f-3051-4943-90c8-ffe9d3a80b2a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:41.360372 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e174f-3051-4943-90c8-ffe9d3a80b2a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:41.365705 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b52587-0a14-4a01-a277-4ecde72ec7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:41.366389 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b52587-0a14-4a01-a277-4ecde72ec7d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:41.366671 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b52587-0a14-4a01-a277-4ecde72ec7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:41.366946 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b52587-0a14-4a01-a277-4ecde72ec7d2 admin admin] PATH_INFO: `/v3/projects/26ba35c352cb41348c2fb6be22babd73/users/9b7f1287651846afa80b30c2a1939b57/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:41.382804 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b52587-0a14-4a01-a277-4ecde72ec7d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ba35c352cb41348c2fb6be22babd73, user_id=9b7f1287651846afa80b30c2a1939b57, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:41.385514 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b52587-0a14-4a01-a277-4ecde72ec7d2 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:41.406486 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1477/2935] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:42:41 2022] PUT /identity/v3/projects/26ba35c352cb41348c2fb6be22babd73/users/9b7f1287651846afa80b30c2a1939b57/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:42:41.410818 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadf453-61b0-4a90-a348-46e33d60956d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:41.424252 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadf453-61b0-4a90-a348-46e33d60956d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:41.503538 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5933366-18ee-4a0d-b341-c4e432503e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:41.504309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5933366-18ee-4a0d-b341-c4e432503e3d admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:41.504585 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5933366-18ee-4a0d-b341-c4e432503e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:41.504853 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5933366-18ee-4a0d-b341-c4e432503e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:41.505559 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5933366-18ee-4a0d-b341-c4e432503e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:41.507238 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5933366-18ee-4a0d-b341-c4e432503e3d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:41.519039 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1459/2936] 10.222.0.52 () {58 vars in 1122 bytes} [Mon Aug 29 20:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:42:41.523888 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b52587-0a14-4a01-a277-4ecde72ec7d2 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:41.535552 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b52587-0a14-4a01-a277-4ecde72ec7d2 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:41.541638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b19588-6e00-4f7f-87ac-bfd2abb8ec50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:41.542419 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b19588-6e00-4f7f-87ac-bfd2abb8ec50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:41.542638 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b19588-6e00-4f7f-87ac-bfd2abb8ec50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:41.542883 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b19588-6e00-4f7f-87ac-bfd2abb8ec50 admin admin] PATH_INFO: `/v3/projects/26ba35c352cb41348c2fb6be22babd73/users/9b7f1287651846afa80b30c2a1939b57/roles/0d06b071c6074137916bdac5a8ef4387` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:41.544986 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b19588-6e00-4f7f-87ac-bfd2abb8ec50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ba35c352cb41348c2fb6be22babd73, user_id=9b7f1287651846afa80b30c2a1939b57, role_id=0d06b071c6074137916bdac5a8ef4387)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:41.548048 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b19588-6e00-4f7f-87ac-bfd2abb8ec50 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:41.559900 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1478/2937] 10.222.0.52 () {60 vars in 1483 bytes} [Mon Aug 29 20:42:41 2022] PUT /identity/v3/projects/26ba35c352cb41348c2fb6be22babd73/users/9b7f1287651846afa80b30c2a1939b57/roles/0d06b071c6074137916bdac5a8ef4387 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:42:41.570831 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be480c94-864c-4f0d-abee-cc6f020c0d48 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:41.571129 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be480c94-864c-4f0d-abee-cc6f020c0d48 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:41.571401 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be480c94-864c-4f0d-abee-cc6f020c0d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:41.602430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-be480c94-864c-4f0d-abee-cc6f020c0d48 None None] MFA Rules not processed for user `9b7f1287651846afa80b30c2a1939b57`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:42:41.603659 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-be480c94-864c-4f0d-abee-cc6f020c0d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:41.677895 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:41.704712 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1460/2938] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:42:41.716662 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b19588-6e00-4f7f-87ac-bfd2abb8ec50 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:41.719098 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-78b19588-6e00-4f7f-87ac-bfd2abb8ec50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:41.786682 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b19588-6e00-4f7f-87ac-bfd2abb8ec50 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:41.791188 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2ecd7-0f85-41a8-836d-375df9a8659d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:41.791821 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2ecd7-0f85-41a8-836d-375df9a8659d service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:41.792104 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2ecd7-0f85-41a8-836d-375df9a8659d service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:41.792377 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2ecd7-0f85-41a8-836d-375df9a8659d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:41.866415 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2ecd7-0f85-41a8-836d-375df9a8659d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:41.867941 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2ecd7-0f85-41a8-836d-375df9a8659d service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:41.878218 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1479/2939] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:42:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:42:43.565076 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be480c94-864c-4f0d-abee-cc6f020c0d48 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:43.567387 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-be480c94-864c-4f0d-abee-cc6f020c0d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:43.583063 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be480c94-864c-4f0d-abee-cc6f020c0d48 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:43.587248 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400eb1c-859b-452b-89df-19fbe73785f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:43.587861 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400eb1c-859b-452b-89df-19fbe73785f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:43.588110 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400eb1c-859b-452b-89df-19fbe73785f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:43.588407 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400eb1c-859b-452b-89df-19fbe73785f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:43.667379 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400eb1c-859b-452b-89df-19fbe73785f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:43.669494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400eb1c-859b-452b-89df-19fbe73785f3 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:43.683650 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1461/2940] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:42:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:42:44.347032 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2ecd7-0f85-41a8-836d-375df9a8659d service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:44.358011 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2ecd7-0f85-41a8-836d-375df9a8659d service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:44.362539 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8958d9c-8f37-4612-bdf1-b6047925931f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '960a2be5cb58461fb9fb8e99094398d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:44.363159 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8958d9c-8f37-4612-bdf1-b6047925931f service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:44.363440 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8958d9c-8f37-4612-bdf1-b6047925931f service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:44.363707 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8958d9c-8f37-4612-bdf1-b6047925931f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:44.371966 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:44.376991 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8958d9c-8f37-4612-bdf1-b6047925931f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:44.379313 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8958d9c-8f37-4612-bdf1-b6047925931f service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:44.393141 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1480/2941] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:42:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:42:48.392494 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400eb1c-859b-452b-89df-19fbe73785f3 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:48.460006 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400eb1c-859b-452b-89df-19fbe73785f3 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:48.464898 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9da38-807f-4c79-a0f7-10fcc8b76ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:48.465576 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9da38-807f-4c79-a0f7-10fcc8b76ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:48.465860 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9da38-807f-4c79-a0f7-10fcc8b76ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:48.466125 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9da38-807f-4c79-a0f7-10fcc8b76ce7 admin admin] PATH_INFO: `/v3/users/cd3ed1e04e1949408325c1bc5053f078` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:48.467314 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9da38-807f-4c79-a0f7-10fcc8b76ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3ed1e04e1949408325c1bc5053f078)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:48.469275 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9da38-807f-4c79-a0f7-10fcc8b76ce7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:48.522261 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6aa9da38-807f-4c79-a0f7-10fcc8b76ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3ed1e04e1949408325c1bc5053f078'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:48.536430 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6aa9da38-807f-4c79-a0f7-10fcc8b76ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3ed1e04e1949408325c1bc5053f078'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:48.544203 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6aa9da38-807f-4c79-a0f7-10fcc8b76ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3ed1e04e1949408325c1bc5053f078'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:48.545231 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6aa9da38-807f-4c79-a0f7-10fcc8b76ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3ed1e04e1949408325c1bc5053f078'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:48.555395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6aa9da38-807f-4c79-a0f7-10fcc8b76ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3ed1e04e1949408325c1bc5053f078'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:48.562159 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1462/2942] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:42:48 2022] DELETE /identity/v3/users/cd3ed1e04e1949408325c1bc5053f078 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:42:48.566980 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634968ea-e971-4954-94ff-57a3a5bbeb40 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:48.567522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634968ea-e971-4954-94ff-57a3a5bbeb40 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:48.567522 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634968ea-e971-4954-94ff-57a3a5bbeb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:48.588108 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-634968ea-e971-4954-94ff-57a3a5bbeb40 None None] MFA Rules not processed for user `b4834a3500ae4e84a6e9864109a0e726`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:42:48.589226 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-634968ea-e971-4954-94ff-57a3a5bbeb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:48.652580 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1481/2943] 10.222.0.52 () {58 vars in 958 bytes} [Mon Aug 29 20:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:42:48.664344 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9da38-807f-4c79-a0f7-10fcc8b76ce7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:48.665843 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6aa9da38-807f-4c79-a0f7-10fcc8b76ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:48.676952 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:48.731212 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9da38-807f-4c79-a0f7-10fcc8b76ce7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:48.735011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f34cd-80ee-4507-b9eb-84acbb32c8c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382b0ee3bd634cc8800f1769c91b7a8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:48.735608 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f34cd-80ee-4507-b9eb-84acbb32c8c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:48.735879 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f34cd-80ee-4507-b9eb-84acbb32c8c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:48.736148 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f34cd-80ee-4507-b9eb-84acbb32c8c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:48.745863 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f34cd-80ee-4507-b9eb-84acbb32c8c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:48.747305 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f34cd-80ee-4507-b9eb-84acbb32c8c2 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:48.760964 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1463/2944] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:42:49.071828 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634968ea-e971-4954-94ff-57a3a5bbeb40 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:49.073737 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-634968ea-e971-4954-94ff-57a3a5bbeb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:49.090753 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634968ea-e971-4954-94ff-57a3a5bbeb40 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:49.096162 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:49.096823 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:49.097113 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:49.097424 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1 admin admin] PATH_INFO: `/v3/projects/ad920bcf8c574a9485da4dfb2a879ee1` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:49.098778 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad920bcf8c574a9485da4dfb2a879ee1)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:49.100770 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:49.155176 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad920bcf8c574a9485da4dfb2a879ee1', 'request_id': 'req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:49.161490 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad920bcf8c574a9485da4dfb2a879ee1', 'request_id': 'req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:49.171544 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad920bcf8c574a9485da4dfb2a879ee1', 'request_id': 'req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:49.183195 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1 admin admin] The token cache is being invalidate because project ad920bcf8c574a9485da4dfb2a879ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:42:49.183510 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:49.184169 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:49.185726 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1482/2945] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:42:49 2022] DELETE /identity/v3/projects/ad920bcf8c574a9485da4dfb2a879ee1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:42:49.190019 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f34cd-80ee-4507-b9eb-84acbb32c8c2 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:49.200398 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f34cd-80ee-4507-b9eb-84acbb32c8c2 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:49.262648 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474415b-ef5a-45bc-88fd-a027a04f2194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:49.263263 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474415b-ef5a-45bc-88fd-a027a04f2194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:49.263532 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474415b-ef5a-45bc-88fd-a027a04f2194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:49.263818 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474415b-ef5a-45bc-88fd-a027a04f2194 admin admin] PATH_INFO: `/v3/users/cb1b0f1653a542e68060735bdf1fdd41` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:49.265184 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474415b-ef5a-45bc-88fd-a027a04f2194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb1b0f1653a542e68060735bdf1fdd41)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:49.267976 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474415b-ef5a-45bc-88fd-a027a04f2194 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:49.328045 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2474415b-ef5a-45bc-88fd-a027a04f2194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb1b0f1653a542e68060735bdf1fdd41'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:49.342731 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2474415b-ef5a-45bc-88fd-a027a04f2194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb1b0f1653a542e68060735bdf1fdd41'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:49.350415 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2474415b-ef5a-45bc-88fd-a027a04f2194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb1b0f1653a542e68060735bdf1fdd41'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:49.351166 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2474415b-ef5a-45bc-88fd-a027a04f2194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb1b0f1653a542e68060735bdf1fdd41'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:49.361091 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2474415b-ef5a-45bc-88fd-a027a04f2194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb1b0f1653a542e68060735bdf1fdd41'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:49.367648 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1464/2946] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:42:49 2022] DELETE /identity/v3/users/cb1b0f1653a542e68060735bdf1fdd41 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:42:49.722328 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:49.723927 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:49.740370 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b767c47-bee3-4681-b6bb-1deae2dd0cc1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:49.817168 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0eff8-dca7-44a7-be86-e44894a0e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:49.817859 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0eff8-dca7-44a7-be86-e44894a0e602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:49.818134 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0eff8-dca7-44a7-be86-e44894a0e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:49.818403 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0eff8-dca7-44a7-be86-e44894a0e602 admin admin] PATH_INFO: `/v3/projects/e4d201995ab94139bada50eb936b2a03` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:49.820027 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0eff8-dca7-44a7-be86-e44894a0e602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d201995ab94139bada50eb936b2a03)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:49.822221 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0eff8-dca7-44a7-be86-e44894a0e602 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:49.854795 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:49.881044 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e1e0eff8-dca7-44a7-be86-e44894a0e602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d201995ab94139bada50eb936b2a03', 'request_id': 'req-e1e0eff8-dca7-44a7-be86-e44894a0e602'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:49.887443 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e1e0eff8-dca7-44a7-be86-e44894a0e602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d201995ab94139bada50eb936b2a03', 'request_id': 'req-e1e0eff8-dca7-44a7-be86-e44894a0e602'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:49.898228 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e1e0eff8-dca7-44a7-be86-e44894a0e602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d201995ab94139bada50eb936b2a03', 'request_id': 'req-e1e0eff8-dca7-44a7-be86-e44894a0e602'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:49.910836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e1e0eff8-dca7-44a7-be86-e44894a0e602 admin admin] The token cache is being invalidate because project e4d201995ab94139bada50eb936b2a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:42:49.910836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e1e0eff8-dca7-44a7-be86-e44894a0e602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:49.910836 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e1e0eff8-dca7-44a7-be86-e44894a0e602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:49.912295 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1483/2947] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:42:49 2022] DELETE /identity/v3/projects/e4d201995ab94139bada50eb936b2a03 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:42:49.917502 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474415b-ef5a-45bc-88fd-a027a04f2194 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:49.919241 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2474415b-ef5a-45bc-88fd-a027a04f2194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:49.934152 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474415b-ef5a-45bc-88fd-a027a04f2194 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:49.964845 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:42:49.999260 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b4e75-299d-49c8-9a40-783dd1ef8576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:49.999922 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b4e75-299d-49c8-9a40-783dd1ef8576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:50.000207 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b4e75-299d-49c8-9a40-783dd1ef8576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:50.000432 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b4e75-299d-49c8-9a40-783dd1ef8576 admin admin] PATH_INFO: `/v3/users/9b7f1287651846afa80b30c2a1939b57` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:50.001681 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b4e75-299d-49c8-9a40-783dd1ef8576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b7f1287651846afa80b30c2a1939b57)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:50.003622 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b4e75-299d-49c8-9a40-783dd1ef8576 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:50.065754 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-607b4e75-299d-49c8-9a40-783dd1ef8576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b7f1287651846afa80b30c2a1939b57'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:50.079701 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-607b4e75-299d-49c8-9a40-783dd1ef8576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b7f1287651846afa80b30c2a1939b57'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:50.087395 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-607b4e75-299d-49c8-9a40-783dd1ef8576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b7f1287651846afa80b30c2a1939b57'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:50.088228 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-607b4e75-299d-49c8-9a40-783dd1ef8576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b7f1287651846afa80b30c2a1939b57'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:50.099011 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-607b4e75-299d-49c8-9a40-783dd1ef8576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b7f1287651846afa80b30c2a1939b57'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:50.106047 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1465/2948] 10.222.0.52 () {58 vars in 1224 bytes} [Mon Aug 29 20:42:49 2022] DELETE /identity/v3/users/9b7f1287651846afa80b30c2a1939b57 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:42:50.413401 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0eff8-dca7-44a7-be86-e44894a0e602 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:42:50.415106 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e1e0eff8-dca7-44a7-be86-e44894a0e602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:42:50.430135 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0eff8-dca7-44a7-be86-e44894a0e602 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:42:50.503226 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1177924-527a-4fe2-b457-ac82801142e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4834a3500ae4e84a6e9864109a0e726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e848cede7541492584effd880adbb5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:42:50.503769 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1177924-527a-4fe2-b457-ac82801142e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:42:50.504044 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1177924-527a-4fe2-b457-ac82801142e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:42:50.504310 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1177924-527a-4fe2-b457-ac82801142e8 admin admin] PATH_INFO: `/v3/projects/26ba35c352cb41348c2fb6be22babd73` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:42:50.505523 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1177924-527a-4fe2-b457-ac82801142e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ba35c352cb41348c2fb6be22babd73)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:42:50.507477 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1177924-527a-4fe2-b457-ac82801142e8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:42:50.558255 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a1177924-527a-4fe2-b457-ac82801142e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ba35c352cb41348c2fb6be22babd73', 'request_id': 'req-a1177924-527a-4fe2-b457-ac82801142e8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:50.565136 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a1177924-527a-4fe2-b457-ac82801142e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ba35c352cb41348c2fb6be22babd73', 'request_id': 'req-a1177924-527a-4fe2-b457-ac82801142e8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:50.577462 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a1177924-527a-4fe2-b457-ac82801142e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ba35c352cb41348c2fb6be22babd73', 'request_id': 'req-a1177924-527a-4fe2-b457-ac82801142e8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:50.589642 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a1177924-527a-4fe2-b457-ac82801142e8 admin admin] The token cache is being invalidate because project 26ba35c352cb41348c2fb6be22babd73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:42:50.590006 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a1177924-527a-4fe2-b457-ac82801142e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:50.590676 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a1177924-527a-4fe2-b457-ac82801142e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:42:50.595380 dv-cinder-854263-2-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1484/2949] 10.222.0.52 () {58 vars in 1233 bytes} [Mon Aug 29 20:42:50 2022] DELETE /identity/v3/projects/26ba35c352cb41348c2fb6be22babd73 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:43:00.102257 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=40,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:43:00.586267 dv-cinder-854263-2-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:45:15.311967 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b4e75-299d-49c8-9a40-783dd1ef8576 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:45:15.313745 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-607b4e75-299d-49c8-9a40-783dd1ef8576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:15.394944 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b4e75-299d-49c8-9a40-783dd1ef8576 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:45:15.468730 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de793d-b6e0-48c9-a3f0-aa0e76dd212b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8295272eec349f8aa38e44c861faa47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03ca2c70c46a477494884c9997540861', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:45:15.469688 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de793d-b6e0-48c9-a3f0-aa0e76dd212b service placement] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:45:15.469963 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de793d-b6e0-48c9-a3f0-aa0e76dd212b service placement] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:45:15.470862 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de793d-b6e0-48c9-a3f0-aa0e76dd212b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:45:15.472159 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a5de793d-b6e0-48c9-a3f0-aa0e76dd212b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:45:15.485039 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de793d-b6e0-48c9-a3f0-aa0e76dd212b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:45:15.487001 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de793d-b6e0-48c9-a3f0-aa0e76dd212b service placement] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:45:15.497309 dv-cinder-854263-2-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1466/2950] 10.222.0.52 () {60 vars in 1365 bytes} [Mon Aug 29 20:45:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:45:25.492815 dv-cinder-854263-2-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=58 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}